Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum

2012 Storage Developer Conference. © Microsoft Corporation. All Rights Reserved.

Hyper-V Storage Performance and Scaling

Joe Dai, Liang Yang Microsoft


Survey: Top Impediment To Increased Virtualization?

Storage 45 % Memory 35 % Network 27 % CPU 0 %

*Microsoft Internal Marketing Study

2


Hyper-V Enables Multiple Storage Options At Flexible Price-Performance Points That Offer Continuously Availability & High Scalability

3

Agenda


New Hyper-V Storage Options

4


New Storage Options

5

External Storage Arrays

Remote File Servers

Storage Spaces

New in Windows Server 2012


External Storage Arrays

Virtual Fibre Channel Extends Fibre Channel Into VM’s High Performance Workloads Guest Clustering Exposes SAN Functionality

Utilizes NPIV Functionality Support

Host: Windows Server 2012 Updated NPIV HBA Driver

Guest: Windows Server 2008 or Newer

Live Migration Just Works

6

SAN

Hyper-V Host

VM VM

WWN

vHBA

WWN

vHBA

NPIV HBA


Remote File Servers

Supports All Existing Scenarios

Enables New Scenarios Shared Nothing Live

Migration Cross-Cluster Live

Migration

Requires SMB 3.0

7

File Server

Hyper-V Host

VM VM

SMB Share

VHD VHDX


Storage Spaces

Device Pooling Thin Provisioning Resiliency

Simple Space Mirror Space Parity Space

8

JBOD

Hyper-V Host

VM VM

Pool Space

VHDX

Space

VHD


Clustered PCI RAID

Host Hardware RAID In A Cluster

Resiliency To Node Failure LUN Fails Over

Resiliency To Disk Failure RAID

9

Shared JBOD SAS

Clustered

Hyper-V Host

Hyper-V Host

Cluster Shared Volume

PCI RAID

PCI RAID

SAS


Hyper-V Storage Stack Improvements

10


VHDX Offloaded Data Transfer Unmap IO Scaling

11

Storage Stack Improvements


New Virtual Hard Disk Format Latest Spec 1.0: Bing: VHDX Format Specification

12

VHDX


13

VHDX

Large Sector

Support

Enhanced Perf

Larger Block Sizes

Embed Custom

Metadata

User Defined

Metadata

Larger Virtual Disks

Enhanced Resiliency


32KB Random Writes

14

IOPS


1MB Sequential Writes

15

25% 25%


Offloaded Data Transfer (ODX)

VMs Can Fully Leverage ODX Enabled Hardware

Reduce Maintenance Time Merge, Mirror, VHD/VHDX

Creation

16

SAN

Hyper-V Host

VM

LUN LUN

VHD Stack

Token Toke

n


Unmap

Unmaps are passed from VM to Physical Layer

Increased Storage Efficiency in the Entire Storage Stack

Supported on: VHDX and PassThru Disks Virtual SCSI, FC, and IDE

17

SAN

Hyper-V Host

VM

Pool Space VHDX


IO Scaling

Liang Yang

18


Hyper-V Bottlenecks in Windows Server 2008 R2

19


Hyper-V I/O Scaling in Windows Server 2012

20

Virtual Storage Stack

VM Device

Device


Hyper-V Multi-Channel Boosts VM Performance

21

VM performance scales nicely with increased number of VM VPs VM remains perfectly responsive even under most intensive workloads.


Experimental Performance Data

22

Both synthetic and TPC-E results show significant improvement.


Hyper-V Multi-Channel With Flexible Settings

23

Advanced users can fine tune up multi-channel settings in VM for optimal performance

Maximum number of channels per VM is tied up to the number of VPs to minimize the memory overhead(of small VMs) on host and other VMs.

VP count 1 2 4 8 16 32 48 64 Default channels

1 1 1 1 1 2 3 4

Maximum channels

1 1 1 2 4 8 12 16

Maximum memory per device

10MB 10MB 10MB 20MB 40MB 80MB 120MB 160MB


One Million IOPS Virtual Machine Demo

Host Configurations(total cost excluding server: ~$10,000) Server(1x): Dell R910 Intel Xeon E7-4850(Quad Westmere-EX 10 core with HT) 80 CPUs 256G RAM SSDs(40x): Intel 520 SATA 180GB 2.5” SATA III MLC HBAs(5x): LSI PCIe Gen. 2 Mustang 9205-8e Storage Enclosures(8x): StarTech 4 Bay 2.5” 6Gbps SAS/SATA Mobile Rack Backplane

VM Configurations: 64 vCPUs, 32G vRAM, Virtual SCSI Controller(1x), Passthru(40x)

24


Thank You.

25

Documents

Hyper-V Storage Performance and Scaling · Hyper-V Multi-Channel With Flexible Settings 23 Advanced users can fine tune up multi-channel settings in VM for optimal performance Maximum