Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO

1© Copyright 2015 EMC Corporation. All rights reserved. 1© Copyright 2015 EMC Corporation. All rights reserved.

2© Copyright 2015 EMC Corporation. All rights reserved.

BEST PRACTICES FOR RUNNING

VIRTUALIZED WORKLOADS ON AN ALL

FLASH ARRAY ITZIK REICH, FIELD CTO, XTREMIO

SHANE VAN BENTUM, OPERATIONS MANAGER, VMware



XtremIO: Leading By All Measures

1,400customers

451 GROUPEMC takes the lead in strategic AFA technology

GARTNERMagic Quadrant for Solid-State Arrays

#1

IDCWorldwide All-Flash Array Revenue by Vendor, 1H14

40% OF TOP 100 & top 200

own XtremIO

#1


• Scale-out architecture

• Metadata management

• Data Services & Management

• Space reclamation in VM workload

• Virtualization efficiencies driven by AFA

BEST PRACTICES - SUMMARY


Go Fast(maybe solve economics)

WHAT PROBLEM ARE YOU SOLVING?

= +

Get SmarterUse Flash


Thousands of VMs = I/O blender

Provisioning & Cloning new VMs

VMotionOperations

A DAY IN THE LIFE OF A VIRTUAL DATA CENTER


LET ME TAKE YOU A FEW YEARS BACK


“EVERYTHING SHOULD BE MADE AS SIMPLE AS POSSIBLE BUT NOT

”SIMPLER


THE EVOLUTION OF “FLASH” ARRAYS

Performance• Dual Controller• Single Workloads• No Data Services

• High TCO• High Performance

Gen 2 - 2008

• (Sometime) Data Services• Dual Controller• Single Workloads (VDI)• Post-Process Data Services

• Lower TCO• Lower Performance

Gen 3 - 2011

• Scale Out Architecture

• Mixed Workloads

• In-Line All the Time Data

Services - Guaranteed

• Lower TCO

• High Performance

Gen 4 - 2013

Gen 1

Fla

sh S

yste

ms

Hybrid A

rrays

World of Compromise

No Compromise


A SIMPLER WAY TO LOOK AT SCALE UP VS

SCALE OUT


WHY ARE YOU BUYING THE LATEST

What’s wrong with a year old architecture, it can still run your email app, right?

12© Copyright 2015 EMC Corporation. All rights reserved. 12© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS METADATA?


CONVENTIONAL METADATA

1GB Data Chunk

Metadata record (~30 bytes)

1PB = 1,000,000 x 1GB chunks of data

1PB = 1,000,000 x 30 byte metadata records = 30MB of metadata

1PB Array1M x 1GB data chunks30MB metadata


WHY GRANULAR METADATA?

• Vastly improved space allocation

• Important for inherent load balancing

• Important for data reduction effectiveness

• Critical for effective copy data management

• Why Content Based Metadata?

PROVIDES SHORTHAND FOR WHAT’S ON THE ARRAY


METADATA DE-STAGING

Dual Controller arrays don’t have enough memory to hold granular metadata in memory So they de-stage most

metadata to the array

AND MUST ACCESS THE ARRAY TO RETRIEVE IT AS NEEDED

METADATA

METADATA

METADATA

METADATA


METADATA IN A SCALE OUT ARCHITECTURE


XTREMIO IN-MEMORY CLONING PROVISIONING

VM Provisioning in seconds!

X-COPY / ODX COMMAND

IN-MEMORYMETADATA

DATA ON SSDBLOCK BLOCK BLOCK BLOCK



AGILEWRITEABLESNAPSHOTS

INLINEDATA AT RESTENCRYPTION

XTREMIO DATAPROTECTION

INLINEDEDUPLICATION

INLINECOMPRESSION

ALWAYS-ONTHIN

PROVISIONING

XTREMIO DATA SERVICESALWAYS-ON, INLINE, ZERO PENALTY, FREE


VMware’s Private CLOUD

Shane van Bentum,

Operations manager, VMware


VMware’s PRIVATE CLOUD

VMware’s Private Cloud

Agile Global Support Geo Management

Over 220,000 VM Units deployed globally

Dedicated global team

running with VMware IT

as a customer with a

“Cloud First” policy

Current availability

maintained at 99.9%

75+ person worldwide

team with solid

experience and part of

VMware R&D

24x7 monitoring

and global support

with VMware

certified engineers


Scale & Growth

LaunchedBuilt on

vCloud Suite

10,000 VM units

65,000 VM units

120k VM Units

Timeline Capacity Run Rate

150k VM Units

200k VM Units

June 2012

January 2013

END June 2014

September 2014

December 2014


MAJOR TENANTS/USE CASES

VMware’s Private Cloud

Agile Global Support Geo Management

Field Ops

VMware Customer

Labs, PSO, etc.

Technical

Marketing

Hands-on-Labs

For customers

Corporate IT

App teams

Moving all IT

Test/Dev

GSS – Training

Reference

Environments

and Customer

Reproduction

Management Business Unit

Functional and scale testing

of our management products

Education

Extended labs and

Self-paced training

TechOps

Aggregating smaller

cloud environments for

various R&D/product

teams for Testing

purposes


Private Cloud Case Study: Education Services – Instructor Lead Training

• These workloads are typically very IO

intensive in very short bursts

• Direct user interaction with the UI therefore

requires a desktop like experience.

• Virtual machines generally only have 1 week

life span

• One Template, many Clones


100% SLA

Direct VM Console interaction

Nested Workloads

PRIVATE CLOUD CASE STUDY: VMware HANDS ON LABS

VMs Provisioned over 4 days: 100,000+

LAB Count: 10,000+

500+ concurrent users

Short vApp life

High VM Curn rate


Why XtremIO

Ability to support multiple mixed workloads that have disparate storage needs on a single consolidated platform

Consolidate 700 spindle array into only 2 x-bricks by leveraging In Memory De-dupe and Compression

Increase end user adoption of Private cloud by providing consistently superior performance, highly available and reliable solution

Integrate with monitoring and management tools to simplify operations


Successes

VMworld 2014

• 10,000+ Labs with over 100,000

VMs created over 4 days

-A VM was created every 1.6 seconds

which equals a full complex lab every

14.8 seconds!

• Very low latency

• Efficient use of Physical storage.

-Avg overall efficiency 16:1

EDU – ILT• 100 or more classes running

per week with over 1100 students

• Lab performance has increased by 3x

• Reduced classroom preparation time


Future

• XtremIO has allowed us to offer high IOPS

storage tier at relatively low cost per GB

• Formalizing this storage tier and will be

offering it to our internal tenants to run IO

intense workloads outside of the use cases

previously mentioned.


ALL FLASH ARRAY

GOTCHAS!


ACHIEVING QUALITY OF SERVICE


SPACE RECLAMATION UNMAP

QUESTIONUpon a deletion of a VM and /

or File(s) inside a VM, you would

expect the capacity to return

back to the array, right?

YES NO


In-Guest

Datastore

When using Virtual

Provisioning Storage

Array, The deletion of a

VM doesn’t cause the

array to claim back the

storage.

It’s a two layer issue,

inside the guest VM and

outside the guest VM (at

the datastore level)

SPACE RECLAMATION



YOUR CHOICE

Microsoft sdelete RAXCO Virtualization


THE NUMBER OF VOLUMES QUESTION


EMC VSI Plugin

vCenter plugin that can offload much of the array day to day tasks


INTEGRATED MANAGEMENT CONSOLE


ARRAY BASED INSIGHT USING OTHER TOOLS


THINK DIFFERENTLY ABOUT VM REPLICATION

• Software Only - Hypervisor based replication solution

• Disaster Recovery and Operational Recovery in VM-level granularity

• Test, failover, failback and production recovery to any point-in-time per VM

• Integrated Management & Orchestration with VMware’s vCenter GUI


SUMMARY

VM level replication - any PIT

• Easier OR & DR

• Flexible RPO – up to Zero Data Loss (Sync)

• No Single Point of Failure

• Batch Protection & Multi-Site

Built-in Orchestration

• Automated Discovery & Provisioning

• Resilient to HW changes

• VM power-up order

• Pre/Post Prompt & External Scripts

• VMs Re-IP


• Scale-out architecture

• Metadata management

• Data Services & Management

• Space reclamation in VM workload

• Virtualization efficiencies driven by AFA

BEST PRACTICES - SUMMARY


THE NUMBER OF VOLUMES QUESTION


USE EZT (EAGER ZEROED THICK)


WHAT ABOUT REPLICATION AND VMWARE SRM

vSphere

vCenter ServerSite Recovery

ManagervCenter Server

Site RecoveryManager

vSphere

Production Site Recovery Site


AVOIDING THE LAST PIT ISSUE


SPACE RECLAMATION IN

VM WORKLOAD

Technology

Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO