Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
The Giant Array.
Hans Timmerman
Country Technology Officer
EMC The Netherlands
The leap to the giant array
Agenda:
� What is the challenge?
� What is the role of storage?
� A new Architecture for virtual Storage
� New products EMC has introduced
� The next step . . . .
Agenda:
� What is the challenge?
What is the Challenge?
• We are Evolving to a Cloud OS
• That gives us possibilities to build Private Clouds
• Vendors have to deliver solutions:
• Internal enablement
• External enablement
• End-to-end Automation
• Proven ROI and TCO demonstration
• Many Data Centers are ready for the next steps
• Need is real Scalability, Agility and Flexibility . . . . . . .
Industry leaders VMware, Cisco and EMC created an alliance to accelerate customers and partners to realize that private cloud model.
Virtualized Data Center
Security
Virtualization
Information CloudComputing
PrivateCloud
VirtualClient
VirtualClient
VirtualClient
VirtualClient
Virtual Applications
AppLoads
AppLoads
AppLoads
AppLoads
AppLoads
Federation
External CloudInternal Cloud
ScalabilitySecurityAvailability
vNetworkvStoragevCompute
VMware vSphere 4.0vCenter 4.0
Infrastructure APIs
Application APIs
Multiple APIs
Simplified Provisioning
Data-path utilization
Aut.Fault Recovery
Ultrascale
V-Max
Ultraflex
Quality of services
Virtual Provisioning
Virtual Storage
Storage Viewer
SRM Failback
VDI Plug-in
Conf. Management
Autm. Discovery
Compliance Analyzer
Server Config Mgt.
Unified Computing Services
Root Cause Analysis
Network embedded Security
Authentication
Access Control
Monitoring
Data Leakage
Deduplication
Replication
Back up
Data Protection
3 Million IOPs32 TB RAM4,096 Processor Cores32 Nodes per ClusterAutomatically Balanced Pool
100+ ServiceProvider Partners
Broad Compatibility Built on vApps
Application andInfrastructure VMs
App
OS
App
OS
App
OS
App
OS
App
OS
FederationCloud vServices
• On-demand Procurement
• Private Cloud
• Public Cloud
• Federated
Capacity Management
VMware InfrastructureVirtual Datacenter OS from VMware
Infrastructure vServices
vNetworkvStoragevCompute vCloud
vStoragevStorage API’sAPI’s
to all VMwareto all VMware
SolutionsSolutions
PowerPath
Thin Provisioning • Multi-pathing
• SRM
• Backup
• Multi-pathing
• SRM
• Backup
IO Dedupe
Replication Manager
VM object awareness
SRAs across replication product lines
Avamar
Storage VSAs
What’s Coming from EMC vStorage
Security Suite for the Virtualized Datacenter
vCenter Integrated Compliance, Log Analysis (Today)
vCenter Integrated Compliance, Log Analysis (Today)
Integrated with vCenter and VMware View – VM Appliance
(Today)
Integrated with vCenter and VMware View – VM Appliance
(Today)
Encryption – at rest, in motion, in transit (tomorrow)
Encryption – at rest, in motion, in transit (tomorrow)
Deep inspection at vmkernel of every action (tomorrow)
Deep inspection at vmkernel of every action (tomorrow)
Security
Securing vSphere
VMSafe• vCenter API
• ESX CIM API
• VMsafe
Envision integration
Authentication Manager
VM Encryption
Flow-based security
VirtualInfrastructure
VirtualWorkplace
User world as starting point
serverserver
ne
two
rkn
etw
ork
storagestorage
Physical world
3 market leaders present a joint vision and a standardized architecture for the Data Center of the Future
PhysicalPhysical worldworld
Service request‘Object/overview/process’
VMVM
VLUNVLUN
result
• Available• Secure• Scalable
User User worldworld VirtualVirtual worldworld
ServiceOrchestrator
Virtual world
• Available• Secure• Scalable
scale-out cloud operating systemdynamic and flexible
scale-out network and computedynamic and flexible
scale-out enterprise storagedynamic and flexible
The need for extreme scaling out . . . . .
The leap to the giant array
Agenda:
� What is the challenge?
� What is the role of storage?
� A new Architecture for virtual Storage
� New products EMC has introduced
� The next step . . . .
Agenda:
�
� What is the role of storage?
Guest DriverV
irt. Po
rt
Virt. P
ort
Virt. P
ort
Physical Port
Host Driver
vStorage enables Storage Consolidation
What is it?• VMware-ready consolidated
storage infrastructure
Customer Benefits• VMotion™ compatible:
storage policies remain consistent when VMs move
• Base policies on what you’re running rather than where you’re running it
with NPIV
VSAN1 – Tier 1
VSAN2 – Tier 2
Intelligent Services
Tier2
Tier1
MDS
10 GbE
10 GbE DCE
Fibre Channel
10 GbEFCoE/DCE
LAN
Cisco Nexus5000
Converge storage and networking traffic
What is it?• Converge storage and networking into
a single 10G cable using Fibre Channel over Ethernet (FCoE)
Customer Benefits• Simplifies cabling • All servers can access storage network
(no HBA needed)• VMotion™ without FC HBA• Enables more effective resource pooling
with DRS• Every host can mount any storage device• Ubiquitous connectivity
SAN
V-Max is storage for the private cloud
start small
� 8 ports
� 8 processor cores
� 64 GB of memory
� 48-256 drives
engine
virtualmatrix
can be uniquely assembled into
extremely large arrays
+
grow big
�hundreds of ports
�hundreds of cores
�TB’s of memory
� thousands of disks
engine
engine
engine
engine
engine
build a large arrayfrom smaller ones
virtualmatrix
get really big
� thousands of ports
� thousands of cores
�hundreds of TB of memory
� tens of thousands of disks
�multiple frames, multiple locations
a single, virtual, giant enterprise array
future
engine
virtualmatrix
engine
engine
engine
engine
engine
The leap to the giant array
Agenda:
� What is the challenge?
� What is the role of storage?
� A new Architecture for virtual Storage
� New products EMC has introduced
� The next step . . . .
Agenda:
�
�
� A new Architecture for virtual Storage
SANSAN
Core Core
Core Core
CPUComplex
GlobalMemory
Disk Ports
Back End
SANSANSANSAN
Host Ports
Core Core
Core Core
Front End
Host & Disk Ports
Core Core
Core Core
Core Core
Core Core
CPUComplex
Front End Back End
GlobalMemory
BA
Virtual MatrixInterface
New Architecture needed
Host & Disk Ports
Core Core
Core Core
Core Core
Core Core
GlobalMemory
CPUComplex
Virtual MatrixInterface
Front End Back End
BA
In In 2003 2003 fromfrom a a Bus Bus ArchitectureArchitecture
toto the Direct Matrixthe Direct Matrix
Symmetrix V-Max Engine Building Block
Integrates industry standard components with uniqueSymmetrix technologies and capabilities
Host & Disk Ports
Core Core
Core Core
Core Core
Core Core
CPUComplex
Host & Disk Ports
Core Core
Core Core
Core Core
Core Core
GlobalMemory
CPUComplex
Virtual MatrixInterface
Virtual MatrixInterface
Front End Back End Front End Back End
GlobalMemory
BABA
Single, flexible building block
Symmetrix V-Max EngineVirtualMatrix
A high-availability Symmetrix director pair provides the base configuration
Additional Symmetrix director pairs can be added to scale-out system resources
Virtual Matrix architecture enables CPU, memory, disks, and host ports to be shared across all directors
VMware and the Virtual Matrix
VM
VLUN
ESXESX
VirtualVirtual MatrixMatrix
VM
VLUNvSwitchvSwitch
server server server
vCenter
ESXESX
VirtualVirtual MatrixMatrix
V-Max
serverServicerequest
Scale up
Scale up
Scale out
Scale out
DRS/Vmotion
Virtual LUN’s
SAN
VLUN
VM
VirtualInfrastructure
server
ne
two
rk
storage
VM
VLUN
ServiceOrchestrator
future
Start with a Single Symmetrix V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
scale-out enterprise storage dynamic and flexible
scale-out cloud operating system dynamic and flexible
Hundreds of Thousands of Terabytes
Hundreds of V-Max Engines
Tens of Millions of IOPS
Tens of Thousands of Disk Drives
Hundreds of Thousands of Virtual Servers
One Virtual Matrix
The leap to the giant array
Agenda:
� What is the challenge?
� What is the role of storage?
� A new Architecture for virtual Storage
� New products EMC has introduced
� The next step . . . .
Agenda:
�
�
�
� New products EMC has introduced
3x More PerformanceMore Front End & Back End IOPS,
Increased Systems Bandwidth,More Usable Global Memory
2x More Connectivity Twice as many host ports
Up to 3X more IOPS per port2X more initiators (256) per port
3x More Capacity Up to 2PB of Usable Capacity,4X larger volumes (256GB),
2X more hyper volumes (512)
Unified Storage for virtual data centers
Purpose Built for the Virtual Data Center
20% Less Power per TBReduced Power and Cooling
requirements via multi-core and
new system packaging
NewNew
33x Faster Local Replicationx Faster Local ReplicationFaster Copy Updates reduces time to complete
TimeFinder Clone operations
5050% More Affordable Distance Replication% More Affordable Distance ReplicationSRDF/EDP reduces infrastructure costs for multi-site
and extended distance replication requirements
2020x Faster Data Mobilityx Faster Data MobilityNew Virtual LUN capabilities enables 1000s
of concurrent volume migrations
8080% Faster Provisioning% Faster ProvisioningAuto Provisioning Groups reduces configuration steps
for initial set up and future changes
Reduce Cost While Increasing Performance
Resources are dynamically shared to maintain high, predictable performance
With twice the performance for applications that need it
…when they need it
V-Max Engine
V-Max Engine
V-Max Engine
V-Max Engine
Global Memory
CPU Resources
System Bandwidth
OLTP2 WorkloadFull System Configurations
RAID 5 Fibre Channel Disks
2.6 timesmoreIOPS
IOP
SSymmetrixDMX-4 4500
Symmetrix V-Max
EMC: Industry Leading VMware Affinity
Virtual LUNsDRSVMotion
Non-disruptive mobility of information
Auto ProvisionVirtual Provisioning
VMware Infrastructure
Quickly provisionon demand
PowerPathHAvStorage
Policy based resource management
vCenterControlCenter
and VC Plug-in
Central management and control
Fully Automated Storage Tiering
automates movement and placement of data based on
changing needs
vStorage and vApp Policy integration
FAST
SATA
FibreChannel
Flash
Tiered Storage
Nondisruptive Mobility Across Storage Tiers
Virtual LUN Technology
Executes and monitors migrations across all drive and RAID types
No disruption to data protection, replication, or application availability during migration
Enables further tiered storage consolidation
Optimize back-end layout for performance
Continuous operations during migration
FlashAny RAID Type
FibreChannelAny RAID Type
SATAAny RAID Type
V-LUN
V-LUN
Auto-provisioning GroupsNew
15 clicks to completeSimplifies initial configurations and all future changes and additions
Port A
Port B
Port C
Port D
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
DEV
DEV
DEV
DEV
DEV
DEV
DEV
DEV
DEV
Single Setup to Build and Associate Groups
Traditional Mapping and Masking
Easy, Quick, and Automated Storage Provisioning
40 Individual Masking Operations5 ESX servers x 2 HBAs x 4 storage ports
~160 clicks to completeIncludes initial configuration and repeated for every change or add
Port A
Port B
Port C
Port D
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
HBA
DEV
DEV
DEV
DEV
DEV
DEV
DEV
DEV
DEV
Identifying Flash and SATA drive targets
Lower Costs and Optimize Service Levels
D8C 46D 270 4C6 D73 D8A 44C 2EE 4A6 356 5A3 BF2 96F 8E3 857 7CB 73F 6B3 627 9FF A5E BAD C92 D22 DEF F0D F99 14D0 144D 13C9 1345 12C1 123E 11BA 1136 10B2 102F 0A6 01A
220
210
200
190
180
170
160
150
140
130
120
110
100
90
80
70
60
50
40
30
20
10
0
Flash drivetargets?
SATA IItargets?
Devices Total IOPS (Maximum)
Device Activity Reports Identify Target Devices for Flash and SATA Drives
65 TB
528* 146 GB15K Fibre Channel drives
65 TB
32* 1 TB SATA drives
104* 400 GB 10K Fibre Channel drives
Ac
qu
isit
ion
$
38 percent more drive IOPSAnd more aligned with workloads
384 fewer drives144 Flash drives plus Fibre Channel drives plus SATA drives versus 528 Fibre Channel drives
32 percent less power and coolingAnd more efficient use of space
17 percent lower storage costsAnd reduced maintenance and software costs
17%
8* 200 GB Flash drives
The leap to the giant array
Agenda:
� What is the challenge?
� What is the role of storage?
� A new Architecture for virtual Storage
� New products EMC has introduced
� The next step . . . .
Agenda:
�
�
�
�
� The next step . . . . building references . . . .
EMC Statistics
4068 VMs on 272 ESX servers
First Rollout - 5:1 (adhoc)
New Norm - 40:1 using vPods
Virtual Desktops – 800 now, 100% EOY
100% Virtualized EOY, including 60K Exchange 2007 mailboxes
dation
$42M saved from Storage Consolidation
$13M saved from Server Virtualization ($80M cost avoidance)
$30M datacenter build avoided
64% Reduction in Power Consumption
Depl. time reduced from 8 weeks to 3 days
Cisco Statistics
14,250 servers, 3,780 apps
2,720 VM’s on 162 ESX Servers
50% of existing,
75% of all new servers virtualized
$19+ Million in Server Virtualization
$50+ Million from Storage Consolidation
Deployment time reduced from 8-12 weeks to 3 days
Savings Savings
Our Own Experiences With Data Center Virtualization
^
Back up slides