1© Copyright 2012 EMC Corporation. All rights reserved.
EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS
EMC Symmetrix VMAX 40K, EMC Symmetrix FAST VP, EMC SRDF, and VMware vSphere 5
EMC Solutions Group
2© Copyright 2012 EMC Corporation. All rights reserved.
Agenda
Solution Overview
Key Technology components
Solution Architecture and Design
Validation and Testing
Summary and Solution Benefits
Q & A
3© Copyright 2012 EMC Corporation. All rights reserved.
Solution Overview
Deploy multiple critical database applications on a VMware private cloud enabled by a VMAX 40K array running Enginuity 5876 Code and optimized by FAST VP with site protection enabled by EMC SRDF replication
Simulate a highly active customer database environment, serving multiple Tier-1 Applications
• Oracle Database 11g R2• SAP ERP 6.0 EHP 4• Microsoft SQL Server 2012
Online Transactional
Databases
• Microsoft SQL Server 2012 Data Warehouse
4© Copyright 2012 EMC Corporation. All rights reserved.
Solution Overview, continued
Managed, monitored, and optimized through EMC Unisphere for VMAX
– Simplified array management of FAST VP using “Allocation by Policy” feature of FAST VP
– Assured performance in DR scenarios enabled by SRDF-aware FAST VP (Enginuity 5876) with constant, automated tuning of application storage at both production and disaster recovery sites
Virtualized with VMware vSphere 5 update 1
5© Copyright 2012 EMC Corporation. All rights reserved.
Symmetrix VMAX 40K Array with Enginuity 5876 Operating Environment
High-end enterprise storage array with simple, intelligent, modular design that allows system to grow seamlessly and cost-effectively from entry-level configuration to world’s largest storage array
New dense configuration options with 2.5” Flash, FC, SAS drives– Up to 33% more drives in the same footprint– More performance per Watt
Virtual provisioning provides non-disruptive, on-demand thin provisioning
FAST VP provides automatic storage tiering at the sub-LUN level
FAST VP SRDF coordination ensures performance at Recovery Site
FAST VP allocate by Policy
Cascaded storage groups
Simplified configuration and management with Unisphere for VMAX
Capacity efficient snapshot capabilities with TimeFinder VP SNAP
Federated Tiered storage
FLASH
FC
SATA
6© Copyright 2012 EMC Corporation. All rights reserved.
EMC Virtual Provisioning Overview
Improves storage utilization
Reduces storage provisioning complexity and overhead
Automates processes to easily grow storage
Overprovision storage to last lifetime of application, without providing all the physical storage up front
Add capacity non-disruptively and on demand
Automatically rebalance thin pools to maintain performance
Simplifies storage management with Unisphere for VMAX
ESXi 310 TB
ESXi 210 TB
ESXi 1 10 TB
3 TB4 TB
Physicalallocation
3 TB
CommonStorage Pool
7© Copyright 2012 EMC Corporation. All rights reserved.
EMC Symmetrix FAST VP – Overview Automatic storage tiering for Virtual
Provisioning thin pools
Analysis and data movement at sub-LUN level:
– Spreads data from a single thin device across multiple pools
– Places very active parts of a LUN on high-performing Flash Drives
– Places less active parts of a LUN on higher-capacity, more cost-effective FC or SATA drives
Moves data at the extent group level (7,680 KB)
Moves data based on user-defined policies and application performance needs
Data movement is automatic and nondisruptive
SATA
FC
Flash
• Radically simplifies storage management
• Optimizes performance• Increases storage
efficiency
Symmetrix VMAX with FAST VP – Getting the right data, to the right place, at the right time
8© Copyright 2012 EMC Corporation. All rights reserved.
FAST VP SRDF Coordination
FAST VP continually monitors and adjusts data placement at production site
Performance stats captured at both sites and exchanged every hour
Decisions on data placement made on both sites using data from the active site
Symmetrix VMAX with FAST VP and SRDF Co-Ordination– Getting the right data, to the right place, at the right time at both Production
and DR Sites
9© Copyright 2012 EMC Corporation. All rights reserved.
Cascaded Storage Groups
New feature with 5876 providing the ability to nest multiple storage groups in a single masking view
Simplifies FAST VP configurations in virtual environments
Multiple application within a single masking view managed with its own storage group and FAST policy
Simplified monitoring and management at application level made easier
10© Copyright 2012 EMC Corporation. All rights reserved.
Solution Architecture Two ESXi servers
configured at each site
Oracle, SAP, and SQL Server deployed on VMs
EMC VMAX 40K storage arrays optimized by FAST VP protected by SRDF/S
8 GBs FC SAN running between hosts and sites
1 GB Ethernet network connection between hosts
11© Copyright 2012 EMC Corporation. All rights reserved.
Solution HardwareComponent Quantity Configuration
Storage array 2 EMC Symmetrix VMAX 40K, with:• 3 Engines• 384 GB Cache• 32 x 200 GB Flash drives• 126 x 600 GB 10K FC drives• 64 x 450 GB 15K FC drives• 72 x 2TB 7.2 K SATA drives
VMware ESXi servers (Production virtual environment)
2 ESXi Server with:• 8 x Ten-core Intel Xeon E7 CPU @2.4 GHz• 1 TB RAM• 2 x dual Port Brocade 825 8 GB FC HBA
VMware ESXi servers (Disaster recovery virtual environment)
2 ESXi Server with:• 4 x Ten-core CPU Intel Xeon E7CPU @2.4GHz• 128 GB RAM • Dual 1 Gb NICs• Dual 10 Gb CNAs
FC switches 2 Brocade DCX 4S 8GB FC Director Class switch
Ethernet switches 2 1 Gb/s Ethernet switches
12© Copyright 2012 EMC Corporation. All rights reserved.
Key Technology Components
EMC components: – Symmetrix VMAX 40K with Enginuity 5876– Unisphere for VMAX– Symmetrix Remote Data Facility (SRDF)– Symmetrix FAST VP with SRDF coordination– PowerPath/VE– VMware vSphere 5– VMware Storage Integrator(VSI)
Applications– Oracle Database 11g R2 Enterprise Edition– Microsoft SQL Server 2012– SAP ERP 6.0 EHP 4
13© Copyright 2012 EMC Corporation. All rights reserved.
Configuration Details
14© Copyright 2012 EMC Corporation. All rights reserved.
Storage Configuration-Virtual Pools
Thin Pool NameDrive Size/ Technology /RPM
RAID Protection
Number of Drives
TDAT SizeNumber of DATA Device (TDAT)
Pool Capacity
FLASH_3RAID5 200GB Flash RAID5 (3+1) 32 68.8 GB 64 4.2TB
FC10K_RAID1 600GB FC 10K RAID1 126 66 GB 504 32TB
FC15K_RAID1 450GB FC 15K RAID1 64 49.2 GB 256 12.2TB
SATA_6RAID6 2TB SATA 7.2K RAID6 (6+2) 72 240GB 256 60TB
15© Copyright 2012 EMC Corporation. All rights reserved.
Virtual Pool Use by Application
SAP, Oracle, and MS SQL OLTP share common Flash, FC, and SATA pools
MS SQL DSS application shares a common SATA pool with all applications but is bound to a separate FC pool
16© Copyright 2012 EMC Corporation. All rights reserved.
Configuring FAST VP
FAST VP is either enabled or disabled
Data Movement should be set to automatic
Relocation Rate controls aggressiveness of FAST
New Feature Allocate- by-Policy simplifies capacity management of thin Provisioned environments
Time windowsCreate time windows to specify when data can be collected for performance analysis and when data movements can be executed.
Recommend to have windows always open so FAST VP can use most recent analysis to optimize data placement.
17© Copyright 2012 EMC Corporation. All rights reserved.
Enable FAST VP Coordination on Storage Groups With this feature enabled, FAST VP sends device usage statistics from R1 to R2
to ensure that the FAST engine at the standby/failover site has up-to-date metrics on which to base decisions.
Enabled under storage group management in Unisphere:– Check Box: Enable FAST VP RDF Coordination
Coordination should be enabled on storage groups at both source and target VMAX
18© Copyright 2012 EMC Corporation. All rights reserved.
VMware Configuration
19© Copyright 2012 EMC Corporation. All rights reserved.
VMware Configuration
vCenterscreenshots
Reduce HBA queuing for vSphere ESXi servers by changing the queue depth
– esxcli system module parameters set -p bfa_lun_queue_depth=64 -m bfa
Virtual Machine boot LUNs configured to use LSI SAS adapter
VMware Paravirtual SCSI (PVSCSI) adapters are used to configure DATA LUNs for high performance
20© Copyright 2012 EMC Corporation. All rights reserved.
EMC Virtual Storage Integrator and VMAX 40K
21© Copyright 2012 EMC Corporation. All rights reserved.
Application ConfigurationOracle OLTP
1 Oracle DB instance, 12 vCPUs with 53 GB RAM
1 DB per VM, 2 TB capacity
SwingBench entry workload on 400 users, 60:40 R/W ratio
MSSQL OLTP (TPC-E Like)
2 SQL instances, 16 vCPUs with 32 GB RAM
1 DB per VM, 1 TB capacity
Mixed workloads to simulate hot, warm applications, 85:15 R/W ratio
MSSQL OLAP (DSS, TPC-H Like)
1 SQL instance, 32 vCPUs with 128 GB RAM
1 DB per VM, 2 TB capacity
2 concurrent loads, 100% Read
SAP OLTP
3 SAP ERP 6 IDES EHP 4 instances, 16 vCPUs with 32 GB RAM
1 Oracle DB instance at 845 GB capacity
1000 LoadRunner Update users + local client copy simulation, 80:20 R/W ratio
22© Copyright 2012 EMC Corporation. All rights reserved.
FAST VP PoliciesThe table below details the FAST VP Policies set for our baseline configuration:
Both MSSQL1 and MSSQL2 applications share the same FAST policy
Policies restrict Flash tier to prevent any single application from dominating Flash resources
Storage group FAST policy name Flash FC SATA
MSSQL1_OLTP MSSQL_OLTP 5% 40% 100%
MSSQL2_OLTP MSSQL_OLTP 5% 40% 100%
MSSQL_DSS MSSQL_DSS 0% 100% 100%
Oracle Oracle 15% 35% 50%
SAP SAP 10% 80% 10%
23© Copyright 2012 EMC Corporation. All rights reserved.
Validation and Testing• Application Performance Validation• Online Policy Tuning• SRDF Coordination• Application Failover with Rapid Ramp-Up
24© Copyright 2012 EMC Corporation. All rights reserved.
Application Performance Validation
25© Copyright 2012 EMC Corporation. All rights reserved.
OLTP Application
Server Transactions Per Minute
Average Read Response Time
Oracle 97,846 5.5 ms
MSSQL1 37,920 10 ms
MSSQL 2 139,020 11 ms
DSS/OLAP Application Average Throughput
MSSQL DSS 808 MB/s
ApplicationServer Transactions
Per MinuteAverage Dialogue
Response time
SAP 2894.8 929.93 ms
Build Validation—All Applications Running
26© Copyright 2012 EMC Corporation. All rights reserved.
FAST VP Responsiveness and Flexibility
At 7:40am SQL OLTP policy adjusted to add additional Flash capability
After 30 minutes performance improvements were seen
SQL txn/sec increased and latency dropped
After 2 hours the SQL performance stabilized
Zero impact observed by other running applications
27© Copyright 2012 EMC Corporation. All rights reserved.
Validating FAST VP SRDF Coordination
SRDF coordination – Balance at Source
and target– Similar tier usage at
both sites
Solid lines are source devices
Dotted lines are target devices
28© Copyright 2012 EMC Corporation. All rights reserved.
SRDF Coordination, continued
Device has been balanced across all tiers in a similar distribution on both R1 and R2
[root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 541
Symmetrix ID: 000195700541
Enabled Capacity (Tracks) : 1826068704Bound Capacity (Tracks) : 1048590
S Y M M E T R I X T H I N D E V I C E S---------------------------------------------------------------------- Pool Pool Total Bound Flags Total Subs Allocated WrittenSym Pool Name ESPT Tracks (%) Tracks (%) Tracks (%)---- ------------ ----- ---------- ----- ---------- --- ---------- ---0426 FC10K_RAID1 F..B 1048590 0 570996 54 1044492 100 FLASH_3RAID5 -.-- - - 352524 34 - - SATA_6RAID6 -.-- - - 120972 12 - -
Total ---------- ----- ---------- --- ---------- ---Tracks 1048590 0 1045620 0 1044754 00
Source Array
Disaster Recovery
Array
29© Copyright 2012 EMC Corporation. All rights reserved.
Failover Test
Oracle & SAP Running at R1
Oracle & SAP Failed over and running at R2
Application loads were run for extended periods at R1 site and FAST VP balanced storage groups on both arrays
RDF links split to simulate failover
SAP and Oracle were brought up on remote ESXi Server
Performance was monitored before and after failover
30© Copyright 2012 EMC Corporation. All rights reserved.
Failover Test, continued
Following failover performance at application levels were on par with production
Transactions per minute and response times observed were equal
31© Copyright 2012 EMC Corporation. All rights reserved.
Summary and Solution Benefits VMAX 40K provides an ideal platform for virtualized critical database
applications, running varied workloads.
Cascaded storage groups enable simplified management of ESX environments with FAST VP.
FAST VP is tunable and responsive. By adjusting FAST policies, performance can be tuned to meet changing business performance needs. Increased performance within 30 minutes with no negative impact to other running workloads.
End-to-end visibility with VMware Storage Integrator from EMC enables simplified management and identification of VMAX devices direct from vCenter
SRDF coordination with FAST VP ensures production level performance at the R2 site in FAST VP environment in the event of a failover when configurations are similar. This delivers the performance and cost benefits of FAST VP at both production and disaster recovery sites.
32© Copyright 2012 EMC Corporation. All rights reserved.
Questions?