Bhumik PatelRakesh Radhakrishnan
VMworld STO2524BU
#VMworld #STO2524BU
Turbocharge All Flash vSAN on Next Generation Hardware
VMworld 2017 Content: Not fo
r publication or distri
bution
• This presentation may contain product features that are currently under development.
• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.
• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.
• Technical feasibility and market demand will affect final delivery.
• Pricing and packaging for any new technologies or features discussed or presented have not been determined.
Disclaimer
2
VMworld 2017 Content: Not fo
r publication or distri
bution
Agenda
1 All Flash vSAN Market Landscape
2 vSAN on New Hardware Platforms
3 Evolving vSAN Software for Emerging Flash Technologies
4 TECH PREVIEW: vSAN on Persistent Memory (NVDIMM) - DEMO
5 Summary + Q&A
3
VMworld 2017 Content: Not fo
r publication or distri
bution
All Flash vSAN Market Landscape
4
VMworld 2017 Content: Not fo
r publication or distri
bution
HCI is the Fastest Growing Storage Segment
Source: Wikibon Server SAN Research Project, 2016
Switch to efficient,
server economics
Extend simple server
management to storage
Unlock affordable
server-side flash
Hyperscale
HCI(Server SAN)
Traditional
Storage
2012 2026
0
$10B
$20B
$30B
$40B
$50B
Total Storage Market $60B
VMworld 2017 Content: Not fo
r publication or distri
bution
Technology Trends
CPU densities
continue to
increase
Hi-Density Flash and
NVMe will dominate
Enterprise Storage
High speed
interconnect to keep
up with fast storage
Technology is Accelerating HCI Adoption
• All Flash Market is growing at a rapid rate – 38% CAGR over last 5 years
• Enterprise customers are adopting and moving away from using magnetic drives
• Newer high speed storage & network interconnects are enabling the HCI market.
• New hardware trends deliver All Flash vSAN at the best $/IOP & $/Gig
VMworld 2017 Content: Not fo
r publication or distri
bution
Tiered Architecture: New Era of Storage Technologies
Future
• NAND Flash: the new Capacity tier
• High capacity NVMe
• Byte-addressable NVDIMMs
• Network latency >> Device Latency
Yesterday
• Low latency devices too
expensive for persistent storage
• Device latency >> Network
latency
IOPS
250K
500K
1M
750K
$/Gig
NVDIMM
DRAM DRAM
Increasing Price ->
VMworld 2017 Content: Not fo
r publication or distri
bution
Evolution of Storage Hierarchy (projection for next 3-5 years)
8
• Application performance needs are
increasing requiring millions of IOPs and
nanosecond latencies
• Application needs are driving evolution of
next gen NVMe and storage class memory
(3D NAND)
• vSAN All-Flash is being architected to take
advantage of these faster devices for in-
memory metadata and caching
Note: IOPS and Latency numbers refer to “raw storage device”IOPS and latency
VMworld 2017 Content: Not fo
r publication or distri
bution
HCI Powered by VMware vSANRuns on any standard
x86 server
Pools SSDs/HDDs into
a shared datastore
Delivers enterprise-
grade security, scale and
performance
Managed through
per-VM storage policies
Deeply integrated with
the VMware stack
vSAN Storage
Managed by vCenter
vSphere vSAN
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN Adoption: 3x Faster Than The Market
Q114 Q214 Q314 Q414 Q115 Q215 Q315 Q415 Q116 Q216 Q316 Q416 Q118 Q218
vSAN Customer Adoption
10,000 Customers
More than top 3 competitors combined
150% YoY bookings growth
VMworld Speakers
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN – By Industry
RETAIL
AIRLINES EDUCATION
HEALTHCARE MANUFACTURING
MEDIA & TECHNOLOGY
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN – By Industry
GOVERNMENT / PUBLIC SECTOR
FINANCIAL SERVICES
CLOUD PROVIDERS
OIL, GAS & POWER
TELCO
PROFESSIONAL SERVICES
VMworld 2017 Content: Not fo
r publication or distri
bution
Evolution of vSAN Workload Adoption
Business-Critical Apps Virtual Desktops (VDI)
VMware Cloudon AWS (VMC)
DR / DAManagement Clusters
Databases (SQL/Oracle)
Data Center on Wheels Containers
ROBOvSAN
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN Is Pervasive In the Data CenterWhat use cases are you currently using vSAN for?
Business critical applications and databases (SAP, MS SQL, Oracle, MySQL, etc.)
65%
44%Management infrastructure
32%Business continuity and
disaster recovery infrastructure
28%Virtual desktop infrastructure (VDI)
21%Intelligent edge and remoteoffice/branch office (ROBO)
Source: TechValidate survey of 316 users of VMware vSAN
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN on New Hardware Platforms
15
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN ReadyNode Landscape
308ReadyNodes
116Unique Server
Platforms
15OEM Server
Partners
2250Unique Drives
(NVMe, SSD, HDD)
&VMworld 2017 Content: N
ot for publicatio
n or distribution
Dell PowerEdge R740 with VMware vSAN
17
Ω
Dell PowerEdge R740
• Largest # of vSAN Ready Nodes
for Intel Xeon Scalable
Processors
• AF4, AF6, AF8
• General Purpose workhorse
optimized for workload acceleration
• Private Cloud, VDI
• R740xd for High PerformanceVMworld 2017 Content: N
ot for publicatio
n or distribution
Use Case
• VMware environment powering critical lines of business including manufacturing,
distribution, pharmacies, customer loyalty programs
• vSAN 3 Node Hybrid for ROBO across 1200 retail stores worldwide
• vSAN All-Flash for Tier-1 workloads like OLTP/SQL
• vSAN All-Flash for VDI (Full Clones)
• 32 All-Flash nodes split across 4 clusters managing 1.2 PB capacityAmerica’s largest supermarket chain runs Tier-1 Applications and worldwide ROBO infrastructure on vSAN
Challenges
• High cost of fiber-channel SAN
• Legacy 3-tier architecture made it difficult to adopt new technologies like NVMe
fast enough to remain competitive
Benefits
• 20% Lower Cost for All-Flash HCI with latest NVMe technology
• 10x reduction in footprint compared to traditional SAN
• Scalable, simple, fast ROBO solution – critical for driving customer satisfaction
and making retail stores competitive
• America’s largest supermarket chain by
revenue, second-largest general retailer, and
twenty-third largest company
• Fortune 500 Brand
Hardware Infrastructure
• Dell R730XD + Intel P3700 NVMe on 40G Network for Data Center Apps
• Lenovo System X servers for ROBOVMworld 2017 Content: Not fo
r publication or distri
bution
Use Case
• Run thousands of financial modeling & stock trading apps that require high IOPS &
sub-millisecond latency response times
• Applications require “consistent” sub- millisecond latencies in order to meet SLAs
“We want to standardize on “All NVMe
platforms” in our datacenter and vSAN on
Dell with P3700 is the right step to do that”
- IT Director
Leading Investment Banking Firm runs Stock Trading & Financial Apps on All Flash vSAN
Challenges
• Unable to meet SLAs for stock trading apps on traditional SAN
• Financial Applications were ”sluggish” due to high and inconsistent latencies on
traditional storage
• Traditional SAN was too expensive with low consolidation ratios for financial apps
Benefits
• SDDC Initiative to go 100% HCI was fulfilled by vSAN
• Early Adopters of vSAN All Flash over NVMe (Intel P3700) to benefit from
consistent and sub-millisecond response times and consistently high IOPS for
financial apps
• 30% cheaper than traditional storage
• Plan to move to “All NVMe Servers” soon
Hardware
• Dell Blades & Rack Servers with Intel P3700 NVMe managing up to 750TB
VMworld 2017 Content: Not fo
r publication or distri
bution
HCI Now Supports the Needs of All Workloads
10-20% vSAN Market; Emerging workloads expected to increase 3X in 2 years80% of vSAN Market
Storage
Dense
Compute
Intensive
Composable
Infrastructure
Archiving, video streaming,
analytics
Web apps, HPC, real time
analytics, In-memory DB
Data warehouses, Search engines
databases, Log aggregation
Rack Servers Blade Servers Composable Infrastructure
Dell – To be Announced
HPE – Apollo
Cisco – UCS S-series
Dell – FX2
HPE – Moonshot
Cisco – B-Series
Dell – To be Announced
HPE – Synergy
General
Purpose
Use cases BCA, Database, VDI,
ROBO, DR, Test/Dev
Hardware
TypeRack Servers
Supported
Hardware
Examples
Dell – R730XD
HPE – DL 380, 360
Cisco – UCS C-Series
VMworld 2017 Content: Not fo
r publication or distri
bution
Use cases:
• Storage dense workloads such as as Big Data (Apache Hadoop), Log Aggregation (Splunk, Yarn etc), Cloud Native Applications (PCF) in this category.
• File servers e.g. Exchange, Sharepoint
• Object storage
Cisco S3260 with VMware vSAN = PetaBytes of storage
Server Node 2
Server Node 1
Server Node 4
Server Node 3
Up to 960 TB of Raw capacity across 2 S3260 Chassis
VMworld 2017 Content: Not fo
r publication or distri
bution
Cisco UCS B-240 with VMware vSAN – Compute Intensive
22
Ω
Cisco UCS Ready Node
• Targets Compute Intensive
Workloads
• Total of 3 drive slots with B-240
M5 providing 7.6TB per node;
30.4TB on a 4-node cluster• Expect 2x-7x with AF space savings
features ranging from 60.8TB –
121.6TB on a 4-node cluster
• Suits workloads such as VDI,
BCA, Web Applications etc.
without moving to a rack mount
architecture
VMworld 2017 Content: Not fo
r publication or distri
bution
HPE Synergy is now certified for VMware vSAN - Composable
23
The first composable Infrastructure certified for vSAN
HPE Synergy—A perfect choice for vSAN
A core value prop of vSAN is that it aggregates all local storage disks—both SSD and HDD—
available on the hosts (compute modules) into a single data store shared by all compute modules.
With traditional rack servers, compute and storage do not generally scale independently, but with
HPE Synergy, you can scale storage and compute separately.
This makes it a perfect fit for vSAN solutions, allowing for storage capacity growth without
requiring additional compute resources to host them.
Key Benefits:
Disaggregated storage and compute
HPE Synergy with VMware vSAN provides the flexibility of thinly
provisioning software-defined storage volumes, independent of compute
resources.
Single infrastructure for any workload
HPE Synergy helps enterprises run vSAN in a single infrastructure,
addressing the needs of both traditional and emerging business applications.
High-Speed interconnect between frames
HPE Synergy provides a flat east-west Ethernet topology. This allows iSCSI
storage to be shared on a low-latency server-to-server connection,
including between HPE Synergy frames.
vSAN configuration details for our supported Ready Nodes visit the VMware vSAN Compatibility Guide for HPE
See why HPE Synergy is a winning vSAN solution in the VMware blog
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN deployment choices for HPE Synergy
24
No. of
Compute
Modules
Number of
Storage
Modules
Number of
drives in
storage
module
Number of
disk group
Disk group
layout
Type of
deployment
3 1 12 1 1 (SAS-
Cache) + 3
(SATA-
Capacity)
Entry level,
expandable
8 2 80 2 1 (SAS-
Cache) + 4
(SATA-
Capacity)
Storage dense
10 1 40 1 1 (SAS-
Cache) + 3
(SATA-
Capacity)
Compute
intenseVMworld 2017 Content: N
ot for publicatio
n or distribution
Intel Xeon Scalable Processors with VMware vSAN
25
VMworld 2017 Content: Not fo
r publication or distri
bution
Intel Xeon Scalable Processors with vSAN
▪ Intel Xeon Scalable processor systems
– 30 - 50% performance improvement vs. last generation, up to 100% for some
workloads
– Nearly 2x vs. 3 year old systems
▪ Intel Solid-State storage technology enhancements
– NVMe access, NAND flash and 3D-NAND provide higher performance,
density at lower $ / GB
– New Optane storage provides significant performance for
critical applications and workload
▪ VMware vSAN 6.6
– 2.5x VMs per cluster when deployed together, with new Intel® Optane™
SSDs and server platforms
– Combine your vendor of choice with vSAN to extend, not replace, existing
virtualization efforts.
– Intel Select Solutions for VMware vSAN provide workload optimized solutions
26
VMworld 2017 Content: Not fo
r publication or distri
bution
Iomark-VM-HC Benchmark Testing
• Testing Software
– IOmark-VM-HC - Storage specific workload and benchmark for HCI systems to measure storage performance
– Uses concept of workload replay & ‘application sets’
– IOmark-VM – VMmark 2.5 storage onlyworkload
• IOmark-VM-HC – Certifies supports for number of VM’s specified
• 8 IOmark-VM’s = 1 VMmark tile (8 vm’s per tile)
• Iomark-VM Application set
Application Guest OS Storage Capacity / Instance
Microsoft Exchange 2007 Microsoft Windows Server
2008, Enterprise, 64 bit
80 GB
Olio Database SuSE Linux Enterprise Server
11, 64bit
14 GB
Olio Web server SuSE Linux Enterprise 11,
64bit
80 GB
Idle Windows Server Microsoft Windows Server
2003 SP2 Enterprise Edition,
32-bit
10 GB
DVD Store Database SuSE Linux Enterprise 11,
64bit
45 GB
DVD Store Web Server 1 SuSE Linux Enterprise 11,
64bit
10 GB
DVD Store Web Server 2 SuSE Linux Enterprise 11,
64bit
10 GB
DVD Store Web Server 3 SuSE Linux Enterprise 11,
64bit
10 GB
Hypervisor Clone & Deploy N/A - VMware vCenter
required
15 GB
Hypervisor Storage
Migration
N/A - VMware vCenter
required
30 GB
-- -- Total = 305 GB
VMworld 2017 Content: Not fo
r publication or distri
bution
IOmark-VM Benchmark Testing
• Hardware
Hardware Features Value
Rack Footprint 8U (2U for per R2208WF system)
Number of Nodes 4 node cluster
Number of Drives per Node Cache: 2 Intel DC P4800x Optane / system = 8 total
Capacity: 4 Intel DC P4500 / system = 16 total
CPUs per system / total 2 CPUs (2.7GHz Intel 8168) per system @ 24
Hyperthreaded Cores each, for a total of 8 CPUs with
192 Hyperthreaded Cores for the cluster
Memory 768 GB / node => 3 TB for 4 node)
Networking Ports (1/10 GbE) 8 @ 10GbE Ports (2 Per Node)
28
• vSAN Configuration
vSAN Parameter Value
vSAN version 6.6
Disk groups 2 vSAN disk group per node
Total raw capacity of system under test (SUT)
29 TB (across all 4 nodes + dedupe enabled)
Each disk group used 2 x 2 TB Intel P4500 = 29 TB physical usable for 4 node cluster (capacity tier)
Thin provisioning: Yes
RAID Level(s) RAID 5, 1 (used for different workloads)
Total Cache Capacity: 3 TB (vSAN configuration dependent)
Write Cache: 750 GB / node Optane device (3.0 TB total)
Data Deduplication & Compression Enabled
Network 1 @ 10Gb Ethernet / node (vSAN interconnect)
VMworld 2017 Content: Not fo
r publication or distri
bution
More than 10x Performance w/ Latest HCI Technology on vSAN
29
80
288
480
800 800
1120
0
200
400
600
800
1000
1200
IOmark-VM’s
SSD + HDD
NVMe + SSD
All-NVMe
Optane + S3520
Optane + P4500
Optane + P4500( No Dedupe)
IOmark-VM Performance: 4-Node HC
Optane + NVMe1st Gen NVMeHybrid HCI
Hybrid HCI
1st Gen NVME
Optane + NVMe
Axis
La
be
l?
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN Database Results - TPC-C Profile
• Nearly 2X better performance and 2X lower price / performance
– 89% higher TPM Performance
– 44% lower cost per TPM
30
$0.05
4,828,595
9,116,024
-
1,000,000
2,000,000
3,000,000
4,000,000
5,000,000
6,000,000
7,000,000
8,000,000
9,000,000
10,000,000
Total TPM
Total TPM for 4-Node vSAN
P4600+P4500
Optane+P4500
$0.03
$-
$0.01
$0.01
$0.02
$0.02
$0.03
$0.03
$0.04
$0.04
$0.05
$0.05
$ / TPM HC
$ / TPM 4-Node vSAN
P4600+P4500
Optane+P4500
VMworld 2017 Content: Not fo
r publication or distri
bution
Intel Optane Performance for vSAN 6.6
31
• 70%R 30%W Random 4K workload
• Two Disk Groups each consisting:
• 1x800GB Intel Optane DC P4800x
• 3x800 GB Samsung SAS SSDs
• Max 89.1K IOPS; Latency 6ms (R+W);
VMworld 2017 Content: Not fo
r publication or distri
bution
Optane vs. SAS SSD - IOPS
0
10000
20000
30000
40000
50000
60000
70000
80000
90000
100000
SAS SSD Optane
IOPS
IOPS
32
1.5x IOPS with Optane vs SAS SSDs with 70/30 R:W ratios
with ~1ms latency
• Two Disk Groups with a total of:
• 2x400GB Intel Optane DC
P4800x
• 3x800 GB Samsung SAS SSDs
• 100GB working set per host
• Virtual SAN configured with Space
efficiency features disabled
VMworld 2017 Content: Not fo
r publication or distri
bution
Evolving vSAN to Support Emerging Flash Technologies
33
VMworld 2017 Content: Not fo
r publication or distri
bution
March 2015
All Flash
64 Node Cluster
2x Hybrid Speed
Sep 2015
Stretched Cluster
5min RPO
2-node ROBO
March 2016
Deduplication
Compression
Quality of Service
vSAN 6.0 vSAN 6.1 vSAN 6.5
Accelerating Innovation
vSAN 5.5 vSAN 6.2
Nov 2016
iSCSI Support
2-Node Direct Connect
Large Capacity Drives
VMworld 2017 Content: Not fo
r publication or distri
bution
Accelerating HCI Innovation
Native Security
Always-On Protection
Enhanced Stretched Clusters
Cloud Analytics
Intelligent Operations
Higher Performance
VUM Integration
ModernInfrastructure
6.6.x
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN Is Used For High Performance WorkloadsWhat applications do you run on vSAN today?
Microsoft SharePoint
Microsoft Exchange Server
Microsoft Applications
15%
26%
NoSQL databases (Cassandra, etc.)
Hadoop and other big data applications
NewUse Cases
9%
3%
Source: TechValidate survey of 316 users of VMware vSAN
Microsoft SQL Server
MySQL Databases
Oracle Databases
SAP
Databases
67%
38%
18%
7%
21%VMware Horizon
Citrix Xen Desktop
VDI
10%
VMworld 2017 Content: Not fo
r publication or distri
bution
Typical Business Critical Applications on All Flash and Common Requirements
OLTP
Performance
Need consistent performance
Guarantee low latencies
Provide ease of scaling without overprovisioning
ScaleReduce planning and guesswork
Eliminate overprovisioning
Reduce disruption
AvailabilityMinimize downtime
Assure low RPO/RTO
Simplify maintenance/migration
VMworld 2017 Content: Not fo
r publication or distri
bution
Turbocharging All Flash Performance –Software Enhancements in vSAN
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN 6.6 Offers 60% More Performance Than 6.5Improvements are greater as more data services are used
4 Node Cluster 2 Disk Groups/ Node – with Checksum, RAID-5, Deduplication & Compression Enabled
60% More IOPSwith checksum, RAID5 and data services enabled
And 40% latency improvement with checksum, RAID5 and data services enabled
VMworld 2017 Content: Not fo
r publication or distri
bution
vSAN Performance Enhancements – (vSAN 6.6 & 6.0U3)
40
1. Checksum Optimization:
• Improved checksum algorithms and optimizations to increase
performance on both read and write operations
2. Write buffer & Log Management optimizations:
• More efficient placement of data in write buffer & efficient
management of log entries
• Proactive destaging of data from cache to capacity reduces
impact on resync/rebuild and thereby reduce congestion
3. Deduplication and Compression improvements:
• New approach to ordering of data to be de-staged offers more
predictable performance, esp with sequential writes
4. Object management improvements:
• Efficient memory usage overhead and context switching of
cache and CPU making I/O delivery more efficient
5. Resync Rebuild Improvements
• Intelligent component selection & resync I/O throttling for
improved rebuild performance
vSphere vSAN
vSAN Datastore
VMworld 2017 Content: Not fo
r publication or distri
bution
All Flash vSAN 6.6 - small working set – 200GB per Host (All Features)
41
6.5 6.6 Improvement
IOPs IOPs IOPs %
100%
Random
Read354051 452896 27.9 %
100%
Random
Write67397 101993 51.3 %
70%
Random
Read134537 206501 53.5 %
100% SEQ
Read18923 18213 No change
100% SEQ
Write2890 3858 33.5 %
Configuration
• Working set size of 200GB per host for random
I/O
• Working set size of 400 GB per host for
sequential I/O
• Cache = 400GB /NVMe and capacity = 2.4TB
(SSD)
• 2 DG per host
• 4 hosts
• All random 4 KB
• All Sequential 256 KB
• 70/30, 4K, Random, All Features
• IOPs per DG = 26K
• Max DG = 3 (factoring in n/w CPU limits))
~ 80K IOPs per Host
VMworld 2017 Content: Not fo
r publication or distri
bution
All Flash vSAN 6.6 - Large working set – 1.7 TB per host (All Features)
42
6.5 6.6 Improvement
IOPs IOPs IOPs %
100%
Random
Read310301 373911 21 %
100%
Random
Write28443 35615 25 %
70%
Random
Read80362 131426 63.5%
100% SEQ
Read18921 18183 No change
100% SEQ
Write711 694 No Change
Configuration
• Working set size of 1680GB per host for
random I/O
• Working set size of 1680GB per host for
sequential I/O
• Cache = 400GB /NVMe and capacity = 2.4TB
(SSD)
• 2 DG per host
• 4 hosts
• All random 4 KB
• All Sequential 256 KB
• 70/30, 4K, Random, All Features
• IOPs per DG = 17K
• Max DG = 4 (factoring in N/W CPU
limits)), ~ 70K IOPs per Host
VMworld 2017 Content: Not fo
r publication or distri
bution
All Flash vSAN 6.6 Small Working Set – 70/30/4K/Random Comparison
43
6.5 6.6 Improvement 6.6 Comparative
IOPs IOPs IOPs % IOPs/DG Max DGTotal IOPs/Host
(6.5/6.6)
All Features 134537 206501 53.5% 26K 3 48K/80K
Checksum + R1 212534 368269 73% 46K 3 80K/138K
No Checksum 363502 406428 12% 50K 3 135K/150K
Comparison with different features turned on
VMworld 2017 Content: Not fo
r publication or distri
bution
All Flash vSAN 6.6 Large Working Set – 70/30/4K/Random Comparison
44
6.5 6.6 Improvement 6.6 Comparative
IOPs IOPs IOPs % IOPs/DG Max DGTotal IOPs/Host
(6.5/6.6)
All Features 80362 131426 63.5% 17K 4 40K/70K
Checksum + R5 119038 186074 56.3%% 23K 3 80K/138K
No Checksum 273372 316590 15% 40K 3 120K
Comparison with different features turned on
VMworld 2017 Content: Not fo
r publication or distri
bution
Future of vSAN All Flash
VMworld 2017 Content: Not fo
r publication or distri
bution
Next-Gen Storage Devices: Summary
46
Overview• Application performance needs are driving evolution of
fast storage such as NVMe & NVDIMM at a decreasing
price point.
• vSAN two tier architecture lacks parallelism & space
efficiency required to to take advantage of these fast
devices
• A single tier design is required for efficient use of
emerging devices like NVDIMMs for performance
oriented workloads.
Why do this?• Make NVMe more cost-effective for performance
oriented workloads
• Leapfrog competition by providing higher performance
& space efficiency with single tier design
• Enable NVDIMM as byte addressable to deliver
extremely high IOPS & micro-second latency for
performance sensitive apps
CONFIDENTIAL
VMworld 2017 Content: Not fo
r publication or distri
bution
Enabling vSAN on Next-Gen Storage
vSAN 6.6Cross Cloud
6.5
1. Introduce parallelism in
deduplication to improve overall
performance
2. Make NVMe more cost-effective
for performance oriented workloads
1. Improve performance significantly by
removing 2 tier bottlenecks
2. Improve space efficiency with cache
devices contributing to capacity & better
deduplication with single tier
Enhance existing2 Tier
Introduce new single tier architecture
Support byte-addressable NVDIMM
2017
1. Enable byte addressable NVDIMM
2. Accelerate data services by moving
high touch metadata to NVDIMM
3. Deliver microsecond latencies & high
IOPS for performance sensitive apps
Phase 1 Phase 2 Phase 3
47
1. 6.6 and
6.0u3
performance
enhancement
VMworld 2017 Content: Not fo
r publication or distri
bution
Phase 1: Deduplication Performance Enhancements in 2 tier
48
1. Reduced CPU scheduling overheads• Offload compression and hash calculations to helper threads.
• Reduces overall load on plog (context in which dedup runs) with less thrashing
• Makes dedup more streamlined and more performant.
2. Improved performance with "read ahead" • Elevator algorithm “reads ahead” next 512K blocks while dedup engine is
processing current 512K block for calculating hashes, compressing data etc
• Improves read latency with parallelization (without “read ahead” this is a
sequential operation waiting for the previous task to complete).
• CPU thrashing due to "Read ahead" is mitigated with dedup helper threads
VMworld 2017 Content: Not fo
r publication or distri
bution
Phase 2: Introduce new Single Tier Architecture
49
1. Single tier architecture with all storage devices in a given node pooled together for capacity• Much simpler disk group construct (eliminate tiers)
• Can add faster and slower devices into one single tier
• Provide host level deduplication capability.
2. Highly parallelized architecture to achieve close to raw device bandwidth/IOPS
3. One disk failure doesn’t cause entire disk-groups to be rebuilt• Metadata will be redundantly saved on the local node.
• Only missing data will need to be rebuilt from other nodes
• Reduces re-sync & rebuild traffic, so less impact on both network and storage, enabling faster recovery
from failure.
4. Enable inline dedup/compression/checksum/encryption
5. Flexibility to turn on space efficiency on a per vmdk basis• Provide flexibility to customer for max performance vs space efficiency
VMworld 2017 Content: Not fo
r publication or distri
bution
Phase 3: Support NVDIMM as byte addressable
Architecting vSAN with Persistent DIMMs
1File System purpose built for All Flash. NVDIMM supported as byte-addressable device
2
Optimized architecture for higher IOPS and better space efficiency –
a) Store metadata, reduce write amplification
b) Staging deduplication and compression, checksum tables
c) Provide faster data caching
3 Leverage Large Capacity SSDs more efficiently
4 Tune vSAN algorithms for higher efficiency and performance using NVDIMMs
5 Long Term: Enable NVDIMMs as persistent storage when the densities increase
1. Enable vSAN to take advantage of NVDIMM devices as byte addressable • In single tier mode to store high touch metadata
• Ultra high IOPS & micro second latencies for performance sensitive apps
VMworld 2017 Content: Not fo
r publication or distri
bution
TECH PREVIEW:vSAN on Persistent Memory - DEMO
VMworld 2017 Content: Not fo
r publication or distri
bution
Demo Configuration
Profile for NVMe
CPU Intel ® Xeon® E5-2687W
v3 @ 3.10GHz 10 cores
/socket, HT
Caching Tier Intel P3700 NVMe
Capacity Tier Intel S3700 SATA SSD
52
Profile for NVDIMM
CPU Intel ® Xeon® E5-2687W
v3 @ 3.10GHz, 10 cores
/socket, HT
Caching
Tier
Persistent Memory
(NVDIMM)
Capacity
Tier
Intel S3700 SATA SSD
VMworld 2017 Content: Not fo
r publication or distri
bution
Demo
53
VMworld 2017 Content: Not fo
r publication or distri
bution
Summary
54
• Leverage vSAN for all workload types
1. Majority of vSAN deployments
are for business critical
applications
2. Next-gen H/W supports specific
use cases
3. Intel Optane provides boost to
your current vSAN implementation
• Turbocharge vSAN to meet your
performance needs
• Highly optimized for Intel Xeon
Scalable Processors & Optane
• Continuous improvements for
next-gen storage
• Future is here: NVDIMM on vSAN
VMworld 2017 Content: Not fo
r publication or distri
bution
55
Call to Action Slides
VMworld 2017 Content: Not fo
r publication or distri
bution
Nerd Out With These Key vSAN Activities at VMworld
#HitRefresh on your current data center and discover the possibilities!
Earn VMware digital badges to
showcase your skills
• New 2017 vSAN Specialist
Badge
• Education & Certification Lounge:
VM Village
• Certification Exam Center:
Jasmine EFG, Level 3
Become a
vSAN Specialist
Learn from self-paced and expert
led hands on labs
• vSAN Getting Started Workshop (Expert led)
• VxRail Getting Started (Self paced)
• Self-Paced lab available online 24x7
Practice with
Hands-on-Labs
Discover how to assess if your IT
is a good fit for HCI
• Four Seasons Willow Room/2nd floor
• Open from 11am – 5pm Sun, Mon, and Tue
• Learn more at Assessing & Sizing in STO1500BU
Visit SDDC
Assessment Lounge
VMworld 2017 Content: Not fo
r publication or distri
bution
3 Easy Ways to Learn More about vSAN
57
• Live at VMworld
• Practical learning of vSAN, VxRail and more
• 24x7 availability online– for free!
vSAN Sizer
vSAN Assessment
New vSAN Tools
• StorageHub.vmware.com
• Reference architectures, off-line demos and more
• Easy search function
• And More!
Storage Hub Technical Library Hands-On Lab
Test drive vSAN
for free today!
VMworld 2017 Content: Not fo
r publication or distri
bution
HOURS
Sunday, August 27th 1:00pm – 5:00pm Monday, August 28th 11:00pm – 5:00pmTuesday, August 29th 11:00am – 5:00pm
SDDC
ASSESSMENT
LOUNGE
Four Seasons HotelDesert Willow Room
vSphere Optimization Assessments (VOA)
Hybrid Cloud Assessment
Virtual Network Assessment
vSAN Assessment
VMworld 2017 Content: Not fo
r publication or distri
bution
VMworld 2017 Content: Not fo
r publication or distri
bution
VMworld 2017 Content: Not fo
r publication or distri
bution
HPE Scalable Persistent Memory
Ideal for:− Enabling in-memory compute with persistence, faster checkpoints
and restores, HTAP, software-defined storage caching tiers and any
workload that could benefit from low-latency DRAM-level performance
Key Features:− DRAM-level performance for fastest performing persistent memory
− Flexible capacity points with capacity up to 1TB
− Complete solution using DRAM for application performance, flash tier
for persistence and backup power for moving data to persistent store
− Up to 13x reduction in database restart time preserving maximum
uptime1
− Up to 27x faster checkpoint operations enabling significantly faster
business operations2
Learn more: https://www.hpe.com/info/persistentmemory
Fastest performing persistent memory at terabyte scale
HPE Scalable Persistent Memory is an integrated
storage solution that runs at memory speeds with
terabyte capacity unlocking new levels of performance
for your business workloads.
1 HPE Internal Labs test. HPE Scalable Persistent Memory, restarting 1TB Database with MSFT SQL Hekaton prototype is as fast as restarting 200GB database, September, 2016. Up to 20x with SAS SSDs.2 TPC-C Benchmark Throughput with Checkpoint (trans/sec). Calculated Time to Checkpoint and Restore a Docker Container running MySQL, compare Persistent Memory vs. SSD, March 31, 2017
VMworld 2017 Content: Not fo
r publication or distri
bution
HOURS
Sunday, August 27th 1:00pm – 5:00pm Monday, August 28th 11:00pm – 5:00pmTuesday, August 29th 11:00am – 5:00pm
SDDC
ASSESSMENT
LOUNGE
Four Seasons HotelDesert Willow Room
vSphere Optimization Assessments (VOA)
Hybrid Cloud Assessment
Virtual Network Assessment
vSAN Assessment
VMworld 2017 Content: Not fo
r publication or distri
bution
VMworld 2017 Content: Not fo
r publication or distri
bution
VMworld 2017 Content: Not fo
r publication or distri
bution