Upload
others
View
15
Download
0
Embed Size (px)
Citation preview
#vmworld
vSAN: Data PlacementDeep Dive
Adam Sweetser, VMware, Inc.Ken Werneburg, VMware, Inc.
HCI3291BU
#HCI3291BU
VMworld 2018 Content: Not for publication or distribution
Disclaimer
2©2018 VMware, Inc.
This presentation may contain product features orfunctionality that are currently under development.
This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.
Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.
Technical feasibility and market demand will affect final delivery.
Pricing and packaging for any new features/functionality/technology discussed or presented, have not been determined.
VMworld 2018 Content: Not for publication or distribution
‹#› 3©2018 VMware, Inc. 3
“A mind that is stretched by a new experience can never go back to its old dimensions.”
Oliver Wendell Holmes, Jr.
VMworld 2018 Content: Not for publication or distribution
4©2018 VMware, Inc. 4
vSAN Datastore
What Is VMware vSAN?
Runs on any standard x86 server
Integrated into hypervisor
Pools HDD/SDD into single cluster-wide shared datastore
Easily scalable
Managed through VM storage policies
vSANvSphere
VMworld 2018 Content: Not for publication or distribution
5©2018 VMware, Inc. 5
What Is VMware vSAN?
Runs on any standard x86 server
Integrated into hypervisor
Pools HDD/SDD into single cluster-wide shared datastore
Easily scalable
Managed through VM storage policies
vSAN
vSAN Datastore
vSphere
VMworld 2018 Content: Not for publication or distribution
Agenda
6©2018 VMware, Inc.
Agenda
6
Objects
Data On Disk
Storage Policies
Maintenance Mode
VMworld 2018 Content: Not for publication or distribution
7©2018 VMware, Inc. 7
Objects
VMworld 2018 Content: Not for publication or distribution
8©2018 VMware, Inc. 8
Objects Are Pieces of VMs
Name Space – Configuration file (VMX), friendly name, and logs (vmware.log).
VMDK – Storage for the VM’s OS.
vSWP – Used during host memory contention.
Snapshot – A temporary point in time state.
Memory Snapshot – A temporary point in time of the memory state.
Default Storage Policy = One Failure to Tolerate
Name Space Component 1 Component 2
VMDK
vSWP
Snapshot
Mem Snap
VM
VMworld 2018 Content: Not for publication or distribution
9©2018 VMware, Inc. 9
Objects
Name Space – Configuration file (VMX), friendly name, and logs (vmware.log).
VMDK – Storage for the VM’s OS.
vSWP – Used during host memory contention.
Snapshot – A temporary point in time state.
Memory Snapshot – A temporary point in time of the memory state.
Default Storage Policy = One Failure to Tolerate
Name Space Mirror 1 Mirror 2
VMDK
vSWP
Snapshot
Mem Snap
Witness
VM
Component 2 Witness Component 1
Witness Component 2 Component 1
Component 1 Component 2 Witness
Component 2 Witness Witness
VMworld 2018 Content: Not for publication or distribution
10©2018 VMware, Inc. 10
Objects
Need more than 50% of the components available.
Hosts Becomes Unavailable No Problem
Name Space Mirror 1 Mirror 2
VMDK
vSWP
Snapshot
Mem Snap
Witness
VM
Component 2 Witness Component 1
Witness Component 2 Component 1
Component 1 Component 2 Witness
Component 2 Witness Witness
VMworld 2018 Content: Not for publication or distribution
11©2018 VMware, Inc. 11
Objects
Double fault - More failures than configured.
Hosts Becomes Unavailable Double Fault
Name Space Mirror 1 Mirror 2
VMDK
vSWP
Snapshot
Mem Snap
Witness
VM
Component 2 Witness Component 1
Witness Component 2 Component 1
Component 1 Component 2 Witness
Component 2 Witness Witness
Inaccessible Object
VMworld 2018 Content: Not for publication or distribution
12©2018 VMware, Inc. 12
VMworld 2018 Content: Not for publication or distribution
13©2018 VMware, Inc. 13
Data On Disks
VMworld 2018 Content: Not for publication or distribution
14©2018 VMware, Inc. 14
Data On Disks is Intelligently Distributed
Name Space – Configuration file (VMX), friendly name, and logs (vmware.log).
VMDK – Storage for the VM’s OS.
vSWP – Used during host memory contention.
Snapshot – A temporary point in time state.
Memory Snapshot – A temporary point in time of the memory state.
Default Storage Policy = One Failure to Tolerate
Name Space Component 1 Component 2
VMDK
vSWP
Snapshot
Mem Snap
Witness
VM
Component 2 Witness Component 1
Witness Component 2 Component 1
Component 1 Component 2 Witness
Component 2 Witness Witness
VMworld 2018 Content: Not for publication or distribution
15©2018 VMware, Inc. 15
Double FaultData On Disks is Intelligently Distributed
Max of 1 cache disk per disk group.
Min of 1 capacity disk per disk group.
Max of 7 capacity disks per disk group.
Max of 5 disk groups per host.
Name Space
VMDK
vSWP
C1 C2 W
C1 C2 W
C1 C2 W
No Problem
VMworld 2018 Content: Not for publication or distribution
16©2018 VMware, Inc. 16
VMworld 2018 Content: Not for publication or distribution
17©2018 VMware, Inc. 17
VMworld 2018 Content: Not for publication or distribution
18©2018 VMware, Inc. 18
Storage Policies
VMworld 2018 Content: Not for publication or distribution
19©2018 VMware, Inc. 19
• Mirroring (RAID-1)• Erasure Coding (RAID-5/6)
Failure Tolerance Method (FTM) defines data layout approach
• FTT=1 – accessible with one failure• FTT=2 – accessible with two failures• FTT=3 – accessible with three failures
Level of Failure to Tolerate (FTT) defines level of resilience
Option with Data Protection Levels and SchemesBasic concepts around “failure tolerance method” and level of “failures to tolerate”
VMworld 2018 Content: Not for publication or distribution
20©2018 VMware, Inc. 20
VMworld 2018 Content: Not for publication or distribution
21
100GB VMDK
VMworld 2018 Content: Not for publication or distribution
22©2018 VMware, Inc. 22
Storage Policies - RAID 0/FTT 0
Only one component.
Cannot tolerate a failure.
Space savings without redundancy.
100 GBs
Cannot Tolerate a Failure
100 GBRAID-0FTT=0
C1
VMworld 2018 Content: Not for publication or distribution
23©2018 VMware, Inc. 23
Storage Policies - RAID 0/FTT 0
Development environment
Non-critical VMs
Non-persistent VMs
Cannot Tolerate a Failure
100 GBRAID-0FTT=0
C1
VMworld 2018 Content: Not for publication or distribution
24©2018 VMware, Inc. 24
Storage Policies - RAID 1/FTT 1
Tolerates One Failure
200 GBs
Tolerates One Failure
100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
25©2018 VMware, Inc. 25
Storage Policies - RAID 1/FTT 1
Tolerates One Failure
200 GBs
Tolerates One Failure No Problem
100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
26©2018 VMware, Inc. 26
Storage Policies - RAID 1/FTT 1
Maybe?
Tolerates One FailureCouldn’t I Tolerate Two?
100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
27©2018 VMware, Inc. 27
Storage Policies - RAID 1/FTT 1
What other objects do I have?
Tolerates One FailureCouldn’t I Tolerate Two?
100 GBRAID-0FTT=1
C1 C2 W
W C1 C2
VMworld 2018 Content: Not for publication or distribution
28©2018 VMware, Inc. 28
Storage Policies - RAID 5/FTT 1
C1 = 33 GBs
C2 = 33 GBs
C3 = 33 GBs
P = 33 GBs
133 GBs in total
Tolerates One Failure
100 GBRAID-5FTT=1
C1 PC2 C3
VMworld 2018 Content: Not for publication or distribution
29©2018 VMware, Inc. 29
Storage Policies - RAID 5/FTT 1
C1 = 33 GBs
C2 = 33 GBs
C3 = 33 GBs
P = 33 GBs
133 GBs in total
Tolerate one failure
C1 + C2 + C3 = Parity
Tolerates One Failure
100 GBRAID-5FTT=1
C1 PC2 C3
VMworld 2018 Content: Not for publication or distribution
30©2018 VMware, Inc. 30
C1 C4C2 C3 P2P1
Storage Policies - RAID 6/FTT 2
C1 = 25 GBs
C2 = 25 GBs
C3 = 25 GBs
C4 = 25 GBs
P1 = 25 GBs
P2 = 25 GBs
150 GBs in total
Tolerates Two Failures
100 GBRAID-6FTT=2
VMworld 2018 Content: Not for publication or distribution
31©2018 VMware, Inc. 31
Storage Policies - RAID 6/FTT 2
C1 = 25 GBs
C2 = 25 GBs
C3 = 25 GBs
C4 = 25 GBs
P1 = 25 GBs
P2 = 25 GBs
150 GBs in total
Tolerates Two Failures
C1 C4C2 C3 P2P1
100 GBRAID-6FTT=2
VMworld 2018 Content: Not for publication or distribution
32©2018 VMware, Inc. 32
Can I Change Policies?
VMworld 2018 Content: Not for publication or distribution
33©2018 VMware, Inc. 33
Resync Traffic
Change from RAID 1/FTT 1 to RAID 5/FTT 1
Yes!
vSAN builds a new object on the fly
100 GBRAID-1FTT=1
C1 PC2 C3
C1 WC2
100 GBRAID-5FTT=1
VMworld 2018 Content: Not for publication or distribution
34©2018 VMware, Inc. 34
VMworld 2018 Content: Not for publication or distribution
35©2018 VMware, Inc. 35
Maintenance Mode
VMworld 2018 Content: Not for publication or distribution
36©2018 VMware, Inc. 36
Maintenance Mode - RAID 1/FTT 1
Tolerates One Failure
Full Data Migration –Migrates all data, then hosts enters maintenance mode.
Ensure Accessibility –Migrates the minimum amount of components.
No Data Migration –Just goes into maintenance mode.
Maintenance Mode
100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
37©2018 VMware, Inc. 37
Full Data Migration
VMworld 2018 Content: Not for publication or distribution
38©2018 VMware, Inc. 38
Maintenance Mode - RAID 1/FTT 1
Tolerates One Failure
Migrates ALL data
Fully compliant with storage policy.
Maintenance Mode – Full Data Migration
100 GBRAID-1FTT=1
C1 WC2
Resync Traffic
C2
VMworld 2018 Content: Not for publication or distribution
39©2018 VMware, Inc. 39
Maintenance Mode - RAID 1/FTT 1
Need at least four hosts for a full data migration.
Maintenance Mode – Full Data Migration
?100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
40©2018 VMware, Inc. 40
Ensure Accessibility Migration
VMworld 2018 Content: Not for publication or distribution
41©2018 VMware, Inc. 41
C2
Maintenance Mode - RAID 1/FTT 1
Validates we can run in a reduce state.
After 60 minutes, vSAN starts a resync.
Maintenance Mode – Ensure Accessibility Migration
100 GBRAID-1FTT=1
WC2
Resync Traffic
C1
VMworld 2018 Content: Not for publication or distribution
42©2018 VMware, Inc. 42
Maintenance Mode - RAID 1/FTT 1 + RAID 0/FTT 0
Migrates FTT 0 objects first, then puts host in maintenance mode.
After 60 minutes, vSAN starts a resync.
Maintenance Mode – Ensure Accessibility Migration
100 GBRAID-1FTT=1
WC2
Resync Traffic
C1
Resync Traffic
C2
C1C1
100 GBRAID-0FTT=0
VMworld 2018 Content: Not for publication or distribution
43©2018 VMware, Inc. 43
No Data Migration
VMworld 2018 Content: Not for publication or distribution
44©2018 VMware, Inc. 44
Maintenance Mode - RAID 1/FTT 1
Does not validate our state.
Does not check FTT 0 or already impacted objects.
After 60 minutes, vSAN starts a resync.
Maintenance Mode – No Data Migration
100 GBRAID-1FTT=1
WC2
Resync Traffic
C1 C2
C1
100 GBRAID-0FTT=0
FTT 0 Object ?Inaccessible Object
VMworld 2018 Content: Not for publication or distribution
46©2018 VMware, Inc. 46
Objects
Name Space – Configuration file (VMX), friendly name, and logs (vmware.log).
VMDK – Storage for the VM’s OS.
vSWP – Used during host memory contention.
Snapshot – A temporary point in time state.
Memory Snapshot – A temporary point in time of the memory state.
Default Storage Policy = One Failure to Tolerate
Name Space Component 1 Component 2
VMDK
vSWP
Snapshot
Mem Snap
Witness
VM
Component 2 Witness Component 1
Witness Component 2 Component 1
Component 1 Component 2 Witness
Component 2 Witness Witness
VMworld 2018 Content: Not for publication or distribution
47©2018 VMware, Inc. 47
Data On Disks
Max of 1 cache disk per disk group.
Min of 1 capacity disk per disk group.
Max of 7 capacity disks per disk group.
Max of 5 disk groups per host.
Name Space
VMDK
vSWP
C1 C2 W
C1 C2 W
C1 C2 W
VMworld 2018 Content: Not for publication or distribution
48©2018 VMware, Inc. 48
Storage Policies - RAID 1/FTT 1
Tolerates One Failure
200 GBs
Tolerates One Failure No Problem
100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
49©2018 VMware, Inc. 49
Maintenance Mode - RAID 1/FTT 1
Tolerates One Failure
Full Data Migration –Migrates all data, then hosts enters maintenance mode.
Ensure Accessibility –Migrates the minimum amount of components.
No Data Migration –Just goes into maintenance mode.
Maintenance Mode
100 GBRAID-1FTT=1
C1 WC2
VMworld 2018 Content: Not for publication or distribution
‹#› 50©2018 VMware, Inc. 50
“Now you know, and knowing is half the battle.”
G.I. Joe
VMworld 2018 Content: Not for publication or distribution
51©2018 VMware, Inc. 51
Learn About the Future of Hyperconverged Infrastructure at the
Innovating Beyond HCI Showcase Keynote#HCI3728KU
John GilmartinSenior Vice President & General Manager, Integrated Systems Business Unit,VMware
Door prizes will be awarded at each Showcase Keynote—don’t miss your chance to win!
What is the Digital Foundation?
Yanbing Li Senior Vice President & General Manager,
Storage and Availability Business Unit, VMware
How is VMware expanding to capabilities of HCI?
What are the tools for the multi-cloud world?
Join Us Tuesday at 11AM to find out:
VMworld 2018 Content: Not for publication or distribution
52©2018 VMware, Inc. 52
Visit the HCI Zone in the Solutions Exchange
#vSAN #HCIZone#vSANfan
Experience Solutions Powered by vSANEdge
Video Analytics
CloudPKS with containerized MySQL
CoreSAP HANA on vSAN
DataStax
Espresso Bar vSpeaking Podcast Daily Prizes
VMworld 2018 Content: Not for publication or distribution
PLEASE FILL OUTYOUR SURVEY.Take a survey and enter a drawingfor a VMware company store gift card.
#vmworld #HCI3291BU
VMworld 2018 Content: Not for publication or distribution
THANK YOU!
#vmworld #HCI3291BU
VMworld 2018 Content: Not for publication or distribution