Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO

Preview:

Citation preview

1© Copyright 2015 EMC Corporation. All rights reserved. 1© Copyright 2015 EMC Corporation. All rights reserved.

2© Copyright 2015 EMC Corporation. All rights reserved.

BEST PRACTICES FOR RUNNING

VIRTUALIZED WORKLOADS ON AN ALL

FLASH ARRAY ITZIK REICH, FIELD CTO, XTREMIO

SHANE VAN BENTUM, OPERATIONS MANAGER, VMware

2© Copyright 2015 EMC Corporation. All rights reserved.

3© Copyright 2015 EMC Corporation. All rights reserved.

XtremIO: Leading By All Measures

1,400customers

451 GROUPEMC takes the lead in strategic AFA technology

GARTNERMagic Quadrant for Solid-State Arrays

#1

IDCWorldwide All-Flash Array Revenue by Vendor, 1H14

40% OF TOP 100 & top 200

own XtremIO

#1

4© Copyright 2015 EMC Corporation. All rights reserved.

• Scale-out architecture

• Metadata management

• Data Services & Management

• Space reclamation in VM workload

• Virtualization efficiencies driven by AFA

BEST PRACTICES - SUMMARY

5© Copyright 2015 EMC Corporation. All rights reserved.

Go Fast(maybe solve economics)

WHAT PROBLEM ARE YOU SOLVING?

= +

Get SmarterUse Flash

6© Copyright 2015 EMC Corporation. All rights reserved.

Thousands of VMs = I/O blender

Provisioning & Cloning new VMs

VMotionOperations

A DAY IN THE LIFE OF A VIRTUAL DATA CENTER

7© Copyright 2015 EMC Corporation. All rights reserved.

LET ME TAKE YOU A FEW YEARS BACK

8© Copyright 2015 EMC Corporation. All rights reserved.

“EVERYTHING SHOULD BE MADE AS SIMPLE AS POSSIBLE BUT NOT

”SIMPLER

9© Copyright 2015 EMC Corporation. All rights reserved.

THE EVOLUTION OF “FLASH” ARRAYS

Performance• Dual Controller• Single Workloads• No Data Services

• High TCO• High Performance

Gen 2 - 2008

• (Sometime) Data Services• Dual Controller• Single Workloads (VDI)• Post-Process Data Services

• Lower TCO• Lower Performance

Gen 3 - 2011

• Scale Out Architecture

• Mixed Workloads

• In-Line All the Time Data

Services - Guaranteed

• Lower TCO

• High Performance

Gen 4 - 2013

Gen 1

Fla

sh S

yste

ms

Hybrid A

rrays

World of Compromise

No Compromise

10© Copyright 2015 EMC Corporation. All rights reserved.

A SIMPLER WAY TO LOOK AT SCALE UP VS

SCALE OUT

11© Copyright 2015 EMC Corporation. All rights reserved.

WHY ARE YOU BUYING THE LATEST

What’s wrong with a year old architecture, it can still run your email app, right?

12© Copyright 2015 EMC Corporation. All rights reserved. 12© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS METADATA?

13© Copyright 2015 EMC Corporation. All rights reserved.

CONVENTIONAL METADATA

1GB Data Chunk

Metadata record (~30 bytes)

1PB = 1,000,000 x 1GB chunks of data

1PB = 1,000,000 x 30 byte metadata records = 30MB of metadata

1PB Array1M x 1GB data chunks30MB metadata

14© Copyright 2015 EMC Corporation. All rights reserved.

WHY GRANULAR METADATA?

• Vastly improved space allocation

• Important for inherent load balancing

• Important for data reduction effectiveness

• Critical for effective copy data management

• Why Content Based Metadata?

PROVIDES SHORTHAND FOR WHAT’S ON THE ARRAY

15© Copyright 2015 EMC Corporation. All rights reserved.

METADATA DE-STAGING

Dual Controller arrays don’t have enough memory to hold granular metadata in memory So they de-stage most

metadata to the array

AND MUST ACCESS THE ARRAY TO RETRIEVE IT AS NEEDED

METADATA

METADATA

METADATA

METADATA

16© Copyright 2015 EMC Corporation. All rights reserved.

METADATA IN A SCALE OUT ARCHITECTURE

17© Copyright 2015 EMC Corporation. All rights reserved.

XTREMIO IN-MEMORY CLONING PROVISIONING

VM Provisioning in seconds!

X-COPY / ODX COMMAND

IN-MEMORYMETADATA

DATA ON SSDBLOCK BLOCK BLOCK BLOCK

18© Copyright 2015 EMC Corporation. All rights reserved.

19© Copyright 2015 EMC Corporation. All rights reserved.

AGILEWRITEABLESNAPSHOTS

INLINEDATA AT RESTENCRYPTION

XTREMIO DATAPROTECTION

INLINEDEDUPLICATION

INLINECOMPRESSION

ALWAYS-ONTHIN

PROVISIONING

XTREMIO DATA SERVICESALWAYS-ON, INLINE, ZERO PENALTY, FREE

20© Copyright 2015 EMC Corporation. All rights reserved.

VMware’s Private CLOUD

Shane van Bentum,

Operations manager, VMware

21© Copyright 2015 EMC Corporation. All rights reserved.

VMware’s PRIVATE CLOUD

VMware’s Private Cloud

Agile Global Support Geo Management

Over 220,000 VM Units deployed globally

Dedicated global team

running with VMware IT

as a customer with a

“Cloud First” policy

Current availability

maintained at 99.9%

75+ person worldwide

team with solid

experience and part of

VMware R&D

24x7 monitoring

and global support

with VMware

certified engineers

22© Copyright 2015 EMC Corporation. All rights reserved.

Scale & Growth

LaunchedBuilt on

vCloud Suite

10,000 VM units

65,000 VM units

120k VM Units

Timeline Capacity Run Rate

150k VM Units

200k VM Units

June 2012

January 2013

END June 2014

September 2014

December 2014

23© Copyright 2015 EMC Corporation. All rights reserved.

MAJOR TENANTS/USE CASES

VMware’s Private Cloud

Agile Global Support Geo Management

Field Ops

VMware Customer

Labs, PSO, etc.

Technical

Marketing

Hands-on-Labs

For customers

Corporate IT

App teams

Moving all IT

Test/Dev

GSS – Training

Reference

Environments

and Customer

Reproduction

Management Business Unit

Functional and scale testing

of our management products

Education

Extended labs and

Self-paced training

TechOps

Aggregating smaller

cloud environments for

various R&D/product

teams for Testing

purposes

24© Copyright 2015 EMC Corporation. All rights reserved.

Private Cloud Case Study: Education Services – Instructor Lead Training

• These workloads are typically very IO

intensive in very short bursts

• Direct user interaction with the UI therefore

requires a desktop like experience.

• Virtual machines generally only have 1 week

life span

• One Template, many Clones

25© Copyright 2015 EMC Corporation. All rights reserved.

100% SLA

Direct VM Console interaction

Nested Workloads

PRIVATE CLOUD CASE STUDY: VMware HANDS ON LABS

VMs Provisioned over 4 days: 100,000+

LAB Count: 10,000+

500+ concurrent users

Short vApp life

High VM Curn rate

26© Copyright 2015 EMC Corporation. All rights reserved.

Why XtremIO

Ability to support multiple mixed workloads that have disparate storage needs on a single consolidated platform

Consolidate 700 spindle array into only 2 x-bricks by leveraging In Memory De-dupe and Compression

Increase end user adoption of Private cloud by providing consistently superior performance, highly available and reliable solution

Integrate with monitoring and management tools to simplify operations

27© Copyright 2015 EMC Corporation. All rights reserved.

Successes

VMworld 2014

• 10,000+ Labs with over 100,000

VMs created over 4 days

-A VM was created every 1.6 seconds

which equals a full complex lab every

14.8 seconds!

• Very low latency

• Efficient use of Physical storage.

-Avg overall efficiency 16:1

EDU – ILT• 100 or more classes running

per week with over 1100 students

• Lab performance has increased by 3x

• Reduced classroom preparation time

28© Copyright 2015 EMC Corporation. All rights reserved.

Future

• XtremIO has allowed us to offer high IOPS

storage tier at relatively low cost per GB

• Formalizing this storage tier and will be

offering it to our internal tenants to run IO

intense workloads outside of the use cases

previously mentioned.

29© Copyright 2015 EMC Corporation. All rights reserved.

ALL FLASH ARRAY

GOTCHAS!

30© Copyright 2015 EMC Corporation. All rights reserved.

ACHIEVING QUALITY OF SERVICE

31© Copyright 2015 EMC Corporation. All rights reserved.

SPACE RECLAMATION UNMAP

QUESTIONUpon a deletion of a VM and /

or File(s) inside a VM, you would

expect the capacity to return

back to the array, right?

YES NO

32© Copyright 2015 EMC Corporation. All rights reserved.

In-Guest

Datastore

When using Virtual

Provisioning Storage

Array, The deletion of a

VM doesn’t cause the

array to claim back the

storage.

It’s a two layer issue,

inside the guest VM and

outside the guest VM (at

the datastore level)

SPACE RECLAMATION

33© Copyright 2015 EMC Corporation. All rights reserved.

34© Copyright 2015 EMC Corporation. All rights reserved.

YOUR CHOICE

Microsoft sdelete RAXCO Virtualization

35© Copyright 2015 EMC Corporation. All rights reserved.

THE NUMBER OF VOLUMES QUESTION

36© Copyright 2015 EMC Corporation. All rights reserved.

EMC VSI Plugin

vCenter plugin that can offload much of the array day to day tasks

37© Copyright 2015 EMC Corporation. All rights reserved.

INTEGRATED MANAGEMENT CONSOLE

38© Copyright 2015 EMC Corporation. All rights reserved.

ARRAY BASED INSIGHT USING OTHER TOOLS

39© Copyright 2015 EMC Corporation. All rights reserved.

THINK DIFFERENTLY ABOUT VM REPLICATION

• Software Only - Hypervisor based replication solution

• Disaster Recovery and Operational Recovery in VM-level granularity

• Test, failover, failback and production recovery to any point-in-time per VM

• Integrated Management & Orchestration with VMware’s vCenter GUI

40© Copyright 2015 EMC Corporation. All rights reserved.

SUMMARY

VM level replication - any PIT

• Easier OR & DR

• Flexible RPO – up to Zero Data Loss (Sync)

• No Single Point of Failure

• Batch Protection & Multi-Site

Built-in Orchestration

• Automated Discovery & Provisioning

• Resilient to HW changes

• VM power-up order

• Pre/Post Prompt & External Scripts

• VMs Re-IP

41© Copyright 2015 EMC Corporation. All rights reserved.

• Scale-out architecture

• Metadata management

• Data Services & Management

• Space reclamation in VM workload

• Virtualization efficiencies driven by AFA

BEST PRACTICES - SUMMARY

43© Copyright 2015 EMC Corporation. All rights reserved.

THE NUMBER OF VOLUMES QUESTION

44© Copyright 2015 EMC Corporation. All rights reserved.

USE EZT (EAGER ZEROED THICK)

45© Copyright 2015 EMC Corporation. All rights reserved.

WHAT ABOUT REPLICATION AND VMWARE SRM

vSphere

vCenter ServerSite Recovery

ManagervCenter Server

Site RecoveryManager

vSphere

Production Site Recovery Site

46© Copyright 2015 EMC Corporation. All rights reserved.

AVOIDING THE LAST PIT ISSUE

47© Copyright 2015 EMC Corporation. All rights reserved.

SPACE RECLAMATION IN

VM WORKLOAD

Recommended