Upload
vnu-exhibitions-europe
View
109
Download
1
Embed Size (px)
DESCRIPTION
Citation preview
Copyright © 2010 Hitachi Data Systems. All rights reserved.
November 2010
Storage Trends and Directions
Hubert Yoshida
Vice President and Chief Technology Officer
Hitachi Data Systems
Agenda
Signs of a Coming train wreck
Major new trends that impact the Data Center
Requirement for scale up and scale out storage
Dynamic Tiering
Media trends
Summary
Gartner – Signs of A Coming IT Train wreck
Aging IT systems and infrastructures
– Creating an increasing burden to maintain
– Switching to new systems and infrastructure
becomes more disruptive and resource intensive.
Information becomes increasingly difficult
to access and analyze
– Business is forced to work without the
information it needs to make decisions.“
New interfaces drive up transaction loads and require legacy
storage systems to scale up
– Storage systems are long term investments and changes are
increasingly painful and expensive
Compliance and regulatory pressures puts businesses with
legacy systems at risk
Power, cooling, and floor space limitations demand change
$0
$50
$100
$150
$200
$250
$300
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Installed Base
(M Units)
Spending
(US$B)
New Hardware spending
Hardware spending has remained flat while overall costs continue to increase
HW mgmt. and admin costs x4
Power and cooling costs x8
0
5
10
15
20
25
30
35
40
45
50
Better
Utilization:
Reduces
Capital Costs
Better
Management:
Reduces
Operational
Costs
Trend Number 1: IT Spend Is Changing
$0
$50
$100
$150
$200
$250
$300
Spending
(US$B)
New Hardware spending
HW mgmt. and admin costs
Power and cooling costs
0
5
10
15
20
25
30
35
40
45
50
Capital
Costs
Operational
costs
A Sustainable Future Requires Virtualization
Sustainable IT Requires Continuous
Reduction in Operational costs
Costs
Technologies that address operational costs: Virtualization, dynamic or
thin provisioning, archive
Trend Number 2: Exploding Data Growth
Compounded Annual Growth Rate of 66%
32.3%
63.7%
(Exabytes)
121.1%
43.9%
Source: IDC 2008
Understanding the types of data
will help to address costs
Trend Number 2: Exploding Data Growth
Compounded Annual Growth Rate of 66%
32.3% Structured
(Exabytes)
121.1% Content
43.9% Replicas
Source: IDC 2008
Understanding the types of data
will help to address costs
63.7% Unstructured
Application Growth is Exploding
Applications will need to offload more
work to storage systems
They will be motivated by the need to
scale
– Millions of users and exabytes of data
– Must provision new applications immediately
Examples of Application offloads
– Content Management systems offloading
data to storage systems for ingestion and
preservation
– Exchange 2010 eliminates backup by
duplicating data bases and archiving
– Symantec provides information to storage to
recover deleted files.
– VMware provides VAAI to format VMDK,
Clone vMotion VMDK, and eliminate SCSI
Reserve Bottleneck
Mobile Cloud Applications
Storage Can Relieve Application Bottlenecks
VMware must issue a SCSI
Reserve when one VM does an
update to VMFS.
– All other VM’s are locked out
– Affect s New VM Creation,
vMotion, Snapshots, Thin
Provisioning., Powering on VM
VAAI Atomic Test and Set
enables Storage to lock at Logical
Block Number
– Frees up other VMs to access
VMFS
– Can increase consolidation of VM
by 25% to 35%
Trend Number 3: A Perfect Storm In Compute
Processor technology is scaling up
– New Intel Architecture
• Multi-core – Dual, Quad,16 way
• SMT – Simultaneous Multi Thread
• L1, L2, L3 cache
Virtual Servers and hypervisors
– Multiple Virtual Machines per physical server
– Multiple VM I/O streams per physical server
• Increasing I/O load
• Increasing randomness of I/O
Network bandwidth is increasing
– FC 4Gbs going to 8Gbs to 16 Gbs
– FCoE 10Gbs to 40Gbs to 100Gbs
• Scale-up Storage is required to support virtual servers and networks
Loosely Coupling of Storage is Not the Answer!
Switch
Port Port
Cache
Port Port
Cache
Port Port
Cache
Port Port
Cache
This approach requires a rip and replace
of existing infrastructure
Transition To Virtual Servers for Production
Customer
Requirement
Integrated Storage
Virtualization
Integrated
Management
Courtesy of 451 Group
Scale up to meet increasing server demands
Port Port
RAID RAID
Cache
Port Port
RAID RAID
Cache
Port Port
RAID RAID
Cache
Port Port
RAID RAID
Cache
3D Scaling: Scale Up with Tight Coupling
Cache Cache Cache
3D Scaling: Scale Out with Safe Multi-tenancy
Port
RAID RAID
Cache
Port Port
RAID RAID
Cache
Port
Cache
Port
RAID RAID
Cache
Port
Cache
Port
RAID RAID
Cache
Port
Scale out to meet distributed server demand
with load balancing and safe multi-tenancy
3D Scaling: Scale Deep with External Virtualization
Servers are connected to storage silos
Storage resources can not be shared
3D Scaling: Scale Deep with External Virtualization
A virtualization storage controller can create a common
Pool of shared storage resources
3D Scaling: Scale Deep with External Virtualization
Virtualize external storage for data mobility
and storage migration
Virtualized vs Non-Virtualized Storage Services
Virtualized Storage Services Non-Virtualized Storage services
NAS CAS VTLVirtual
Servers
Physical
Servers
NASCAS
VTL
Enterprise
Midrange
Cloud
Virtualize Devices into a pool of
capacity and allocate by pages
Dynamically provision new servers
in seconds
Eliminate allocated but unused
waste by allocating only the pages
that are used
Extend Dynamic Provisioning to
external virtualized storage
Convert Fat volumes into thin
volumes by moving then into the
pool
Optimize Storage performance by
spreading the I/O across more
arms
LDEVLDEVLDEVLDEVLDEVLDEVLDEVLDEV
HDP Pool
HDP Volume
(Virtual LUN)
LDEVs
Dynamic Provisioning
Today: Automated Tiering of Storage Volumes
Tier 0
Tier 1
Tier 2
Multiple storage tiers in
separate pools
SSD, SAS, SATA
We assign volume to tiers
of storage based on data
classification
Use virtualization to move
volumes without disruption
Automated with policy
based management
But moving large volumes
is a heavy task
SAS
SATA
EFD/Flash
Introducing Dynamic Tiering at the Page Level
TIER 1
TIER 2
TIER 0
POOL A
Last Referenced
Last Referenced
One pool of 42 MB pages
now spans multiple tiers of
storage
Volume Data is written to the
highest performance tier first
Less active volume pages
migrate to lower tiers
Pages can be promoted
Volumes no longer have to
be moved to optimize
performance
Volumes will be able to span
across tiers on external
storage
Cost Comparison of 36 TB Single Tier Vs Multi-Tier
Drive Type Qty Total
Cost
%
Capacity
Rack
cost
HDT
Cost
Total
cost
IOPs
300 GB
HDD
120 $145,000 100% $75,000 0 $220,000 36,000
Drive Type Qty Total
Cost
%
Capacity
Rack
cost
HDT
Cost
Total
cost
IOPs
200 GB
SSD/SAS
4 $40,000 2% $28,000 $75,000 $183,000 158.000
300 GB
HDD/SAS
10 $12,000 8%
1 TB HDD
SATA
32 $28,000 90%
Single Tier HDD
Multi-Tier SSD/SAS/SATA
Comparison Between FC Loops and SAS
– 4 FC Loops per controller
• Half duplex arbitrated loops
• 8 FC Loops @ 2 Gb/s
– Drawers are added to the loop
• FC and SATA drawers are separate
– 4 SAS wide cables per Controller
• 4 full duplex links per cable
• 32 SAS Links @ 3 Gb/s
– Drawers are connected point-point
• SAS and SATA can be intermixed
SATA Loop
FC Loop
Technology Transition Roadmap
Time
Are
al
Den
sit
y
Longitudinal
Recording
100-130
500-800
1,000-3,000
2,000-15,000
Perpendicular Recording
Patterned Media (PM)
Thermally Assisted Recording (TAR)
2006 2010 2014
50 Years
>50 Million increase in areal density
10,000 Gb/in2 = 10 Tb/in2
50 TB 3.5-inch drive
12 TB 2.5-inch drive
1 TB 1-inch drive
New Technologies will increase Densities
Will Prices decline at the same rate?
Denser Packaging
13U
Standard 19” rack
• Front to back cooling
• Up to 6 racks
Dense packaging
• 13u x 19 inch
• 80 x 3.5in drives
• 128 x 2.5in drives
• SSD, SAS and SATA
Power and cooling
• 40% less power than
equivalent capacity Universal
Storage Platform® V
28
Data Centres Will Need to Provide More Scale While Also Addressing:
Capital
Costs
Administrative Burdens
Availability
Power & Cooling
Courtesy of IDC 2010
29
Technologies That Can Help
II: Intelligent Storage Tiers
Automated data
movement
between tiers of
storage
III: Outsourcing
Cloud
SaaS
IV: Resource Pooling
I: Storage Optimization
Dynamic
Provisioning
Thin Provisioning
Wide Striping
Storage Virtualization
Scale up, out, and
deep
D.C. DensityCourtesy of IDC 2010
• Sustainable IT costs requires
virtualization to contain
operational cost
• Sustainable IT costs can be
achieved through
– Server Virtualization for server
consolidation
– Storage and File Virtualization
for data mobility, consolidation,
migration, tiered storage
– Capacity virtualization for
dynamic provisioning,
automated performance, and
increased utilization
Summary
$0
$50
$100
$150
$200
$250
$300
$0
$50
$100
$150
$200
$250
$300
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 20101996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Installed Base
(M Units)
New Hardware spendingNew Hardware spending
Worldwide IT Spending on Hardware, Power and
Cooling, and Management/Administration
HW mgmt. and admin costsHW mgmt. and admin costsHW mgmt. and admin costs
Power and cooling costsPower and cooling costsPower and cooling costsPower and cooling costs
0
5
10
15
20
25
30
35
40
45
50
IDC 2008
Vernon Turner