41
Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved. Managing Storage for Virtual Machines using SCVMM 2008 R2 Madhu Jujare ([email protected] ) Senior software design engineer Microsoft Corporation

Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Embed Size (px)

Citation preview

Page 1: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Managing Storage for Virtual Machines using SCVMM 2008 R2

Madhu Jujare ([email protected] )

Senior software design engineerMicrosoft Corporation

Page 2: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Session Objectives

How VMM manages virtualization and storage

Walk thru of VM migrations and storage

Share challenges of a heterogeneous storage environment

Page 3: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Key Takeaways

Storage is a key pillar of virtualization

Storage and virtualization are moving targets

Limited adoption of standards for storage management

COLLABORATE WITH US TO DELIVER VALUE TO THE CUSTOMERS!

Page 4: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Topics we will cover

VMM basics

VMM & SANs

VMM & Clusters

Storage Migration and Rapid Provisioning

Post VMM plans

Page 5: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VMM BASICS

Page 6: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Self Service UserAdministrator Console

Windows PowerShell

Virtual Machine Hosts

Perimeter Network (DMZ)

Library Servers

Self Service Web Servers

Storage (local & remote)

Virtual Machine Manager: Topology

Page 7: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Manages 100s of hosts

Manages 1000s of VMs

Datacenters demand agility and availabilityVMs need to be created & deployed asapVMs need to move around with minimal or no service interruptionVMs need to be highly available (HA)

What is VMM’s challenge?

Page 8: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VM

VHDPass-thru diskPass-thru diskPass-thru disk

What storage does a VM need

Page 9: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Local

SAN

SAN

Types of VM storage

Page 10: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VMM & SAN

Page 11: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Host

VM

Pass-thru

SANVHD

HBA

SAN

VM on a SAN

Page 12: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

FC Array / ISCSI Target

VMMVDS h/w provider

HostHost

VDS

VDS

LUN LUN LUN LUN

HBA Provider

• Discovery of LUNS• Mask and Unmask• Set ISCSI CHAP

• Port to LUN mappings

• Enumerate• Rescan• Mount/UnMount• Volume to Disk mapping• Disk to LUN mapping

SAN admin tool

NPIV Provider

• Virtual to Physical port mappings• Create & delete Virtual Ports

iSCSI initiator

• Discovery of portals and targets• Log on & log off

HostHost

Host

VMM on a SAN : Technologies

Page 13: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VDS hardware provider

VM can have multiple LUNs.

Each LUN needs to be dedicated to VM.

Available for Hyper-V hosts.

SAN Migration Requirements

Page 14: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

FC Array / ISCSI Target

VMM

Host Host

LUN1 LUN2

VM1.VHD PassThrough

VM SAN Migration

VM1

Page 15: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN Migration processSetMask() VDS API is usedMask LUN from source hostUnMask LUN to target host

FC RequirementsVDS provider should be masking capable.Source and Destination hosts can see LUN

SAN Migration (FC)

Page 16: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

HBAwith NPIV

VP1

VP2

P1

NPIV (N-port Virtualization)

P1

Page 17: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN MigrationDeletes Vport from source host.Create Vport on target host.

NPIV RequirementsSource and Destination Hosts connected to same SAN (via FC fabric).Source and Destination HBA’s are NPIV capable.NPIV WMI provider installed on Host

SAN Migration (NPIV)

Page 18: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

class MSFC_FibrePortNPIVMethods- CreateVirtualPort- RemoveVirtualPort

class MSFC_VirtualFibrePortAttributesclass MSFC_FibrePortNPIVAttributes class MSFC_NPIVLUNMappingInformation

NPIV Interface

Page 19: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN Migration processSetMask() VDS API is usedMask LUN from source hostUnMask LUN to target host

iSCSI Mask migration requirementsSource and target hosts logged into ISCSI target.VDS provider is Masking capable.

SAN Migration (ISCSI Mask)

Page 20: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN MigrationiSCSI initiator logoff from source host and iSCSI initiator logon on destination host.

iSCSI Logon/Logoff migration requirementsSource and target hosts can access iSCSI target.One LUN per ISCSI Target

SAN Migration (ISCSI Logon/Logoff)

Page 21: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

iSCSI EMC, NetApp, EqualLogic, MS ISCSI

FC EMC, HP, NetApp, LSI, Compellent, Hitachi

NPIV (N-Port Virtualization)Emulex, Qlogic and Brocade HBA

SAN Vendors

Page 22: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VMM & HYPER-V CLUSTER

Page 23: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Dedicated storageWindows cluster disk resource3rd party custom disk resource (e.g. Symantec/Veritas)

Shared storageCluster Shared Volume (Win2k8 R2)3rd party cluster file systems (e.g. SANBOLIC MelioFS)

Cluster Storage

Page 24: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Host Cluster

VM1SAN

VHD

HBA

SAN

VM2

VHD

VM on a Dedicated Cluster Storage

Page 25: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Host Cluster

VM1SAN

HBA

SAN

VM2

VHD1

VHD2

VM on a Cluster Shared Storage

Page 26: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Quick Migration Win2k8, Win2k8 R2

Live Migration Win2k8 R2Live migration queuing

Hyper-V Cluster VM Migration

Page 27: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Cluster SAN Migration requirementsDedicated StorageMeets all requirements of SAN Migration.Only FC and ISCSI SAN migrations supported.

LUN MigrationDeletes Disk resource from source cluster.Disconnects LUN from all source nodes.Connects LUN to all target nodes.Creates Disk resource on target cluster.

Cluster SAN Migration

Page 28: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

STORAGE MIGRATION &RAPID PROVISIONING

Page 29: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

PurposeAllow migration of virtual storage device attached to a running VM with minimal service interruption

ScenariosLow disk spaceMigration from old SAN to new SANUpgrading & downgrading storage tierStandalone LUN CSVSite to site migration (consolidation)

Quick Storage Migration

Page 30: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

QSM Algorithm

VHD

Snapshot

VHD

Save State

Save State

VM

Snapshot

Page 31: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

MigrationType VM State When Expected Downtime

LIVE Running VM is highly available &&source and target are nodes of win2k8 r2 cluster

None

QUICK Any VM is HA &&when live migration is not possible.

< 1 Min

SAN Any Meets SAN migration requirements &&it can’t be migrated LIVE/Quick.

< 2 Mins

QSM Running VM storage is changed < 2 Mins

LAN Any When none of the above is possible. < 1 hour

VMM chooses the bestVM migration type

Migration Summary

Page 32: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

PurposeDecrease deployment time for VMs Allows customers to use SAN based LUN cloning

instead of copying VHDs over the network

Can also be used for differencing disks

ScenariosAutomated and rapid deployment of large systems

VDI large scale deployments

Automated and concurrent deployment of VMs

Rapid Provisioning

Page 33: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Rapid Provisioning Scenarios

Golden LUN

VHD

VHD

LUN1(clone)

VHD

LUN2(snapshot)

Base VHD Golden

Page 34: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Rapid Provisoning Sample script

PS C:\> Get-VMMServer -ComputerName "VMMServer1.Contoso.com"

PS C:\> $JobGroupID = [Guid]::NewGuid().ToString()

PS C:\> $Template = Get-Template | where {$_.Name -eq MyTemplate"}

PS C:\> $VMHost = Get-VMHost | where {$_.Name -eq "VMHost.Contoso.com"}

PS C:\> Move-VirtualHardDisk -IDE -BUS 0 -LUN 0 -Path "L:\OS.VHD" -JobGroup $JobGroupID

PS C:\> New-VM -Name "VM06" -Path "L:\" -Template $Template -VMHost $VMHost -JobGroup -$JobGroupID -UseLocalVirtualHardDisks

Page 35: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

POST VMM PLANS

Page 36: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Future directions

Page 37: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

WMI Server

SLP DiscoveryModule

SMI‐SModule

Host ResourceModule

WMI ServersWMI ServersWMI ServersWMI ServersSMI‐S Servers

CIM‐XML

WMI‐DCOM

WS‐Man

Storage Service (WMI Provider)

WMI ServersMicrosoft Host 

Resources Providers (SMI‐S Based)

CIM‐XMLClient

SLPClient

Microsoft Storage Management Service (Using SMI-S)

WMI ServersWMI ServersFuture SMI‐S Servers

WS‐Man

WS‐ManClient

VMM VNEXT

Storage Developer Conference 2009© 2009 Microsoft Corporation. All Rights Reserved

Page 38: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Related SDC Content

Microsoft Storage Management UpdateMohamed LawindiSoftware Development Engineer II,Microsoft CorporationMichael BrasherPrincipal Software Development Engineer, Microsoft Corporation

Page 39: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

SummaryChallenges of working across different vendors

Communicate plans, progress, statusCommunicate frequentlyCommunicate with management/dev/QATest, Test, Test

Integration paths with 3rd partiesSAN vendors:

VDS h/w provider for VMMSMI-S for VMM VNEXT

HBA vendors: SMI-S, NPIV mofClustered File SystemCustom cluster disk resourcesMonitoring: Ops Manager MP, VMM Pro PacksExtensibility and Value-Add : PowerShell + WF

Page 40: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

More information

VMM blogs by MS employees:http://blogs.technet.com/chengw/ - Cheng Wei- Senior Program Managerhttp://blogs.technet.com/rakeshm/ - Rakesh Malhotra – Group Program

Managerhttp://blogs.technet.com/jonjor/ - Jonathan Jordan - CSS Subject Matter

Experthttp://blogs.technet.com/hectorl/ - Hector Linares – Senior Program

Managerhttp://blogs.technet.com/m2/ - Michael Michael - Senior SDE

VMM communityhttp://technet.microsoft.com/en-us/scvmm/bb679926.aspx

VMM public forumhttp://forums.microsoft.com/TechNet/default.aspx?ForumGroupID=489&SiteID=17

Page 41: Managing Storage for Virtual Machines using SCVMM … · Microsoft Host Resources Providers (SMI‐S Based) CIM‐XML. Client. SLP. Client

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Q & A