VSP Tech 01_065966

Embed Size (px)

Citation preview

  • 7/24/2019 VSP Tech 01_065966

    1/58

    2010 Hitachi Data Systems. All rights reserved.

    Hitachi VirtualStorage PlatformTechnical Overview

    September 2010

    Your Name Here.Your Title Here.

  • 7/24/2019 VSP Tech 01_065966

    2/58

    2

    AGENDA

    Data center transformation

    Whats new, whats different

    3D scaling architecture

    Hitachi Virtual Storage Platform physical description

    Feature drilldown

    Summary

  • 7/24/2019 VSP Tech 01_065966

    3/58

    3

    Data Center Transformation

    Transition to Virtual

    Environment

    Reduce capital andoperational expenditures

    Increase flexibility to be moreresponsive to the business

    Improve service levels

    Silos of independent physical devices

    Closed, inflexible monolithic environment

    SustainableCostly, legacy systems

    Cloud-ready

    Manage physical devices independently Automated

    Virtualized

    From Managing Infrastructure Technology

    Physical,Legacy Environment

    To Providing Infrastructure Services

  • 7/24/2019 VSP Tech 01_065966

    4/58

    4

    Industry Leading Results

    Only 3D scaling

    3D

    48% Less

    Power

    Automated

    Dynamic

    Tiering

    Twice the

    Connectivity

    IndustrysHighest

    Performance

    15x Larger

    Volume Size

    VMware VAAI

    Integration

    Most External

    Virtualized

    Capacity

    40% Higher

    Density

    NewSeptember2010

  • 7/24/2019 VSP Tech 01_065966

    5/58

    5

    3D Scaling Architecture vs. Others

    Separate application data and control

    data

    +

    Volume components and specialized

    offload ASICs

    +

    Write mirrored global memory;

    Variable bandwidth+

    Switching interconnects with

    messaging latency (nanoseconds)

    +

    High density packaging; Selectable

    increments of specialized controller,cache, host and disk I/O blades

    +

    Full array virtualization features;

    Compatible with external storage

    Full volume and sub-volume tiering

    Optimized

    Enterprise wide consolidationMission critical volatile workload

    Common application data and control path

    +

    Off the shelf components and processors

    +

    Mirrored global distributed memory; Fixed

    bandwidth+

    Switching interconnects with messaging

    latency (microseconds)

    +

    Midrange packaging; Dual controller

    increments with fixed cache, host and diskI/O ports

    +

    Partial array virtualization features

    compatibility; Full volume tiering

    Commodity

    Application with linear growth ofcapacity and performance

  • 7/24/2019 VSP Tech 01_065966

    6/58

    6

    Evolution of an Architecture

    Lightning 99002000 - 2003

    Continuous enhancement in bandwidth, connectivity and scalability

    Efficient global cache management

    New 3D scaling architecture

    Lightning 9900V2002 - 2005

    TagmaStore

    Universal Storage Platform2004 - 2007

    Hitachi Univ

    ersal Storage

    Platform V/VM 2007 - 2011

  • 7/24/2019 VSP Tech 01_065966

    7/587

    2 to 4 Virtual Storage Director blades 8 to 16 cores 2 to12 FED blades with 16 to 96 ports 2 to 8 cache adapters with 32 to 512! cache " to 4 !ED blades with " to 32 S#S li$%s

    8 Virtual Storage Director blades 32 cores 24 FED blades with 192 ports 16 cache adapters with 1&"24! cache 16 !ED blades with 64 S#S li$%s

    VSP Architectural View Configuration

  • 7/24/2019 VSP Tech 01_065966

    8/588

    3D Scaling Architecture

    5thgeneration networkcrossbar switch

    New control memoryarchitecture

    2.4x OLTP performance

    Greater connectivity andchoice

    79% increase inbandwidth

    Scale up, scale out, scaledeep growth path

    2x single image globalcache

    Backward compatibleBasic Operating System V(BOS V) operating system

    Virtua

    lStor

    ageDirec

    tor Fro

    ntEndDirector

    BackEndDirector Ca

    cheAd

    ater

  • 7/24/2019 VSP Tech 01_065966

    9/589

    Control Memory Architecture LatencyHierarchy

    28 ! 'o$trol

    (e(or)

    *S+ V

    VS+

    'o$trol

    (e(or)'o$trol

    (e(or)'o$trol

    (e(or)4 ! 'o$trol(e(or)

    'e$trali,edDistributed

    Latency reduction driven by new architecture

    8-

  • 7/24/2019 VSP Tech 01_065966

    10/5810

    ac r ua orage a ormSingle Image Global Cache with Dynamic CacheAssignment

    E!!icient cache management e"ecuted by each #irtual storage director

    $lobal cache is a#ailable to any #irtual storage director

    %o storage and !orward messaging o#erhead

  • 7/24/2019 VSP Tech 01_065966

    11/5811

    3D Scaling Scale !"

    Increase performance,capacity and connectivitytightly coupled through aglobal cache to meet

    increasing server demands.

    3D

    Solution Capabilities

    Host servers can access all the resources that are

    dynamically added to the base configuration.

    All the resources can act as one system for

    maximum performance and capacity.

    Managed as one common pool of resources for

    more efficient utilization of resources

    Dynamically scale for performance, capacity,

    connectivity without disruption

    Business Value

    Industrys highest OLTP performance for open and

    mainframe environments.

    Grow from a small data center footprint 19 rack

    Front to rear airflow for most efficient floor planning

    Highest density storage using 2.5 drives

    &ost transarent migration !rom'to multi#endor

    storage at () ercent less e!!ort and cost

  • 7/24/2019 VSP Tech 01_065966

    12/5812

    Solution Capabilities

    Build out the storage system by combining

    multiple units into a single logical system

    Dynamically scales out to support the needs

    of different servers by prioritizing the

    common storage resources

    Ensure safe multitenancy and quality of

    service through partitioning of cache and port

    address space.

    Business Value

    Tailor for increasing workloads without

    compromise Consolidate resources for virtual server

    environments

    Highest data center density and lowest power

    consumption for the capacity stored

    Increase aggregate

    performance, capacity,throughput, and connectivity

    by dynamic allocation of

    storage resources to satisfy

    multiple distributed host

    server requirements.

    3D

    3D Scaling Scale #ut

  • 7/24/2019 VSP Tech 01_065966

    13/5813

    Solution Capabilities

    External storage joins the storage pool with all

    the functionality of the storage system

    Offloads less demanding data to lower cost

    external storage

    Simplifies management of external storage with

    common management, data protection, and

    search

    Allows use of existing or legacy assets over

    200 storage systems and up to 255PB

    Business Value

    Increase value and useful life of existing assets Reduce OPEX costs through a common

    management framework

    Reduce CAPEX using lower cost tiers of

    external storage

    Storage virtualization can

    provide a third dimension ofscaling for consolidating

    externally attached storage

    systems with virtual servers.

    3D

    3D Scaling Scale Dee"

  • 7/24/2019 VSP Tech 01_065966

    14/58

    14

    Hitachi Virtual Storage Platform Rack Structure

    The maximum number of racks is 6:

    2 control chassis and 16 drive chassis

    * All channel configuration,* *#)+

    Rack-00

    Rack-01

    Rack-02

    Rack-10

    Rack-11

    Rack-12

    Controller 0

    Controller 1

    3,610mm

    2,006mm

    1,100mm

    1 control

    chassis

    2 control

    chassis

    HDD (2.5) 0 - 1,024 0 - 2,048

    HDD (3.5) 0 - 640 0 - 1,280

    Ports 16 - 96* 16 - 192*

    Cache Up to 512GB** Up to 1,024GB**

  • 7/24/2019 VSP Tech 01_065966

    15/58

    15

    42U 19 inch rack

    Reduces width 20% from UniversalStorage Platform V

    14U control chassis cabled from the rear

    Fan thermal control has 3 levels to reducenoise

    14U

    13U

    13U

    42U Rack (19inch)

    Control Chassis2,006mm

    610mm

    1,100mm

    Hitachi Virtual Storage Platform Rack Structure

    Rear

    14U

    Front

  • 7/24/2019 VSP Tech 01_065966

    16/58

    16

    Increased overall airflow while requiring less powerful fans

    Front to back flow results in more even and consistent airflow

    Configuration provides more effective use of hot/cold rows

    Airflow Efficiencies: Enabling Hot/Cold Rows

    HotAisle

    HotAisleCold

    Aisle

    Raised Floor

    Return Air Plenum

  • 7/24/2019 VSP Tech 01_065966

    17/58

    17

    Most Flexible Building Block

    Scale u" "roce$$ing "ower and cache bandwidth

    Highly granular scalability

    Virtual StorageDirectors " ,

    VirtualStor

    age

    Director

    DataCach

    eAdater

    Data Cache

    Adater " (

    Front view

  • 7/24/2019 VSP Tech 01_065966

    18/58

    18

    Main processors and operational

    control data memory

    Stores and manages internal

    operational metadata and state

    Array groups, LDEVs, external LDEVs,

    runtime tables, mapping data for

    various software products

    Overall state of the system stored,

    referenced and executed

    Distributed to the appropriate I/O

    offload processors

    Virtual Storage Director

  • 7/24/2019 VSP Tech 01_065966

    19/58

    19

    Single Image Global Cache With Dynamic Cache Assignment

    Data 'ache S)ste( .lobal 'ache/

    Caches user data blocks from drives via theBED during a read

    Caches data from the FED as part of a datawrite operation

    All write data is mirrored in cache

    Only one copy of cached data when performingread operations

    Up to 128GB of data cache and a total of512GB in a single control chassis

    2 chassis can contain 1TB of cache memory

    Non-volatile data protection

    Back up cached user data

    Also used to protect meta data

    Allows for three copies: one operationaland two backup copies (mirrors)

    Backed up to an onboard flash drive

  • 7/24/2019 VSP Tech 01_065966

    20/58

    20

    Most Flexible Building Block

    Interconnected directors deliver tailoredscalability

    Independently grow

    $rid Switch ,

    Back End

    Director +

    Front End

    Director ,

    Front End Director ,

    Back End Director +

    BackEndDir

    ector

    FrontEnd

    Director

    GridSwitch

    Scale !" Connectivity% Ca"acity% &andwidth

    Back view

  • 7/24/2019 VSP Tech 01_065966

    21/58

    21

    Back End Director and Front End Director Pairs

    Operational control data is distributed to L2 memory Data accelerator processors

    Transfer data to and from cache

    Execute host command requests

    Dual core, special purpose I/O processors built into a unique data accelerator ASIC

    Designed to accelerate I/O and operational performance

    Offload latency sensitive processing tasks directly onto the BEDs and FEDs

  • 7/24/2019 VSP Tech 01_065966

    22/58

    22

    Virtual Storage Director Advantage$

    Scaling Throughput

    VSD cores for host I/O Mixed core

    Total : 400%Host I/O : 350%

    100% 100% 100%

    50%

    50%

    VSD

    Front end director Back end director

    100%

    20%

    75%

    5%

    85%

    15%

    80%

    20%

    Total : 400%Host I/O : 350%

    Heavywork

    load

    VSP

    Total : 140%Host I/O : 120%

    VSD cores for host I/O Core for async processing

    40% 40% 40%20%

    VSDUSP V

    Total : 140%Host I/O : 120%

    Front end director Back end director

    40% 30%

    5%5%

    30%

    5%

    20%

    5%

    Host I/O processing

    Copy processing

    Lowworkload

    No change in operating rate of MP used for host I/O and for PP Throughput is not changed by separation of cores

    Perform both host I/Oprocessing and copyprocessing (Asyncprocessing) in each core

    Perform copyprocessing (Asyncprocessing) in adedicated core

    S! " niversal Storage !lat#orm $S! " $irt%al Storage !lat#orm

  • 7/24/2019 VSP Tech 01_065966

    23/58

    23

    Virtual Storage Director Advantage$

    VSP

    VSD cores for host I/O Core for async processing

    40% 40% 40%20%

    VSD

    Average response:SmallResponse is stablebecause host I/Oprocessing and copyprocessing are notmixed.

    USP V

    Target MP Initiator MP

    40% 30%

    5%5%

    30%

    5%

    20%

    5%

    Averageresponse: SmallNote that whenlarge copyprocessingtakes placeduring host I/Oprocessing, I/Owith largeresponse ismixed.

    Scaling Throughput

    Host I/O processingCopy processing

    Lowworkload

    Average response:

    MediumI/O response ofmixed coresbecomes large, butno impact of mixedcores because allMPshave heavy load

    60%

    VSD cores for host I/O Mixed core

    55% 65%

    20%

    VSD

    20%

    Heavy

    workload

    When the average operatingrate exceeds a threshold(ex:50%), inflow of host I/Oprocessing starts in core usedfor async processing.

    50%

  • 7/24/2019 VSP Tech 01_065966

    24/58

    24

    Virtual Storage Director Advantage$

    !ecause 0irtual storage director .VSD/ is i$depe$de$t o FED a$d !ED port& $o i(pact o$ oS duri$g (icrocode e-cha$ge

    FED FED BED BED

    VSD air

    ..

    rocessing

    &/S0 1/

    rocessing

    2icrocode

    e"change

    &/S0 1/

    rocessing

    Data #cceleratorData #ccelerator

    &

    (pact o$ (icrocode e-cha$ge

    FED FED BED BED

    VSD air

    ..rocessing

    &/S0 1/

    rocessing

    &/S0 1/

    rocessing

    &/S0 1/rocessing

    Data #cceleratorData #ccelerator

    .er!orm micro-code e"change er 3 core During micro-code e"change o! core

    dedicated to .. rocessing4 other core

    takes o#er the rocessing

    Because 2. is indeendent o! .ort4 no

    imact on other ort during micro-code

    e"change

    FED FED BED BED

    VSD air

    ..rocessing

    2icrocodee"change

    &/S0 1/

    rocessing

    &/S0 1/rocessing

    Data #cceleratorData #ccelerator

    '

    FED FED BED BED

    VSD air

    2icrocodee"change

    &/S0 1/

    rocessing

    &/S0 1/

    rocessing

    Data #cceleratorData #ccelerator

    ..rocessing(

    FED FED BED BED

    VSD air

    ..

    rocessing

    &/S0 1/

    rocessing

    &/S0 1/

    rocessing

    Data #cceleratorData #ccelerator

    2icrocode

    e"change )

    .er!orm micro-code e"change er 2.

    Since 2. is indeendent o! .ort4 2..5 continues

    rocessing 1/ during micro-code e"change6

    ++processi$g

    icrocodee-cha$ge

    icrocodee-cha$ge

    ++processi$g

    ++

    processi$g

    icrocode

    e-cha$ge

    ++

    processi$gicrocode

    e-cha$ge

    During micro-code e"change o! core dedicated to

    .. rocessing4 other core becomes a core

    dedicated to .. rocessing and takes o#er the

    rocessing

  • 7/24/2019 VSP Tech 01_065966

    25/58

    25

    Hard Disk Drive Support

    2.5 drive cost crosses over 3.5

    SAS interface becomes dominant

    Fibre channel will decline on performance drives

    Flash drives for performance alternative

    Worldwide performance Optimized HDD for Enterprise ApplicationsAverage price per Gigabyte Form Factor, 2009 - 2014

    Worldwide HDD Shipment for Enterprise ApplicationsBy Interface, 2009 - 2014

    Comparison:UniversalStoragePlatformVFibreChannel

  • 7/24/2019 VSP Tech 01_065966

    26/58

    26

    Comparison: Universal Storage Platform V Fibre ChannelLoops vs. Virtual Storage Platform SAS

    Controller 1

    4 SASLinks

    Controller 0

    4 SASLinks

    4 SASLinks

    4 SASLinks

    Expander

    Expander

    Enclosures

    15Disks SAS

    HDDSlot 0

    SASHDDSlot 1

    SASHDDSlot 2

    SASHDDSlot 3

    SASHDDSlot 4

    SASHDDSlot 13

    SASHDDSlot 14

    Universal Storage Platform V with 64 FibreChannel (FC) loops 4 FC loops percontroller

    4 FC loops per back end director

    Half duplex arbitrated loops

    32 FC loops pair at 4 Gb/s

    Virtual Storage Platform with 64 SAS links 8 SAS paths per back end director blade

    32 full duplex links per control chassis

    64 SAS links at 6 Gb/s

    Chassis are connected point-to-point

    SAS and SATA can be intermixed

  • 7/24/2019 VSP Tech 01_065966

    27/58

    27

    Most Flexible Building Block

    768 in dri#es " ,) " +

    or

    +68 in dri#es " 9, " +

    Increases capacity per square foot

    Decreases power and OPEX

    13 U

    Late$t Di$' and (la$h Drive )echnology

  • 7/24/2019 VSP Tech 01_065966

    28/58

    28

    Princi"al Characteri$tic$

    (1) At v02 (2) All channel configuration (3) Orderable in clustered pair

    VSP minimumVSP

    maximumUSP V

    VSP vs.

    USP V

    Number of Drives 0 1280/ 2048 1152 +77%

    Virtual Capacity - 255PB 247PB +3%

    FED Ports(8G)

    FC, FICON, FCoE(1)16 (FC) 192 (FC)(2)

    192 (FICON)(2)

    96 (FCoE)

    FC4 224 / FC8

    112(2)

    FICON4 112

    +70% (FC8)

    BED Links(6G) 0 64 64 (FC-AL 4G) +50%

    Cache Size 32 GB 1TB(1) 512GB 2x

    Cache Protection Flash (+ battery) Flash (+ battery) Batteries

    Virtual Storage Director(3) 2 8 Not Available

    Chassis Internal

    Bandwidth (Data and

    Control GB/s)

    - 128/64 68/39 +79%

    Power Consumption

    (Fully Configured)

    - 30 KW (one phase) 33.2 KW (three

    phase)

    -48% (W/TB

    600GB HDD)

  • 7/24/2019 VSP Tech 01_065966

    29/58

    29

    Performance com"ari$on &ac'end Mi*+,-.-/0'& 12#PS

    +reli(i$ar) results

    i- .6"4" 7eadrite ratio/

    3*

    45.*

  • 7/24/2019 VSP Tech 01_065966

    30/58

    30

    Performance com"ari$on &ac'end 0'&12#PS

    +reli(i$ar) results

    7eads rites

    657*458*

    3* .5,*

  • 7/24/2019 VSP Tech 01_065966

    31/58

    32

    3D Management

    Manage Up, Manage Out andManage Deep

    Hitachi Command Suite v7

    3DM tM U

  • 7/24/2019 VSP Tech 01_065966

    32/58

    33

    3D Management: Manage Up

    Solution Capabilities Automate data placement for higherperformance and lower costs

    Ability to manage up to 5M logical objectsand 255PB of virtualized capacity

    Manage large storage resource

    management deployments with agentlesstechnologies

    Scale up virtual server deployments byeliminating shared resource contention

    Business Value

    Significant CAPEX and OPEX savings bymoving data to lower cost tiers

    Increase storage utilization up to 50%

    Easily align business application needs tothe right cost infrastructure

    HighActivity Set

    9ormal:or'ing Set

    ;uietDataSet

    Storage )ier$ Data Heat2nde*

    !ni

  • 7/24/2019 VSP Tech 01_065966

    33/58

    34

    3D Management: Manage Out

    Solution Capabilities

    Unified management for block, file, and

    content across all Hitachi storage

    Common management of virtualized

    heterogeneous storage assets

    Endto-end visibility and correlation of

    applications, virtual machines, virtual servers,

    and logical storage devicesfor traditional andVMware environments

    Roadmap to comprehensive IT management

    system starting with orchestration layer

    Business Value

    Properly monitor and plan resource needs forvirtual server farms

    Consolidate multivendor storage management

    Integrated, open solution with orchestrated

    management lowers complexity and costs

    Single management

    framework with the breadth

    to manage storage, servers

    and the IT infrastructure

    3DM tM D

  • 7/24/2019 VSP Tech 01_065966

    34/58

    35

    3D Management: Manage Deep

    :etwor%

    Solution Capabilities Consistent implementation of

    management operations toreduce human errors

    Persistent logical grouping forefficient management practices

    Service level managementincorporating both capacity and

    performance Common GUI, usability, datarepositories and task workflows

    Business Value Simplify operations with up to

    50% fewer managementoperation steps

    Reduce manual provisioningand reporting processes

    Reduce IT deployment timesand risks significantly and gainbusiness agility

    Deep integration within Hitachi Command

    Suite for the highest level of operationalefficiency to manage the complexities oftodays data centers

    Improved Scalability and Performance:

  • 7/24/2019 VSP Tech 01_065966

    35/58

    36

    Improved management performance with parallel refreshes ofmanaged subsystems

    Test results show parallel refreshes improves refresh speeds by 6 times HDS lab tests with 12 subsystems refreshed in parallel versus sequential

    p S tyEnhanced Management Performance

    6ti(

    es1aste

    r

    ) 8)) 3))) 38)) +))) :Sec;

    Se;ue$tial

    7eresh

    +arallel

    7eresh

    Hit hiC dSit C St M t

  • 7/24/2019 VSP Tech 01_065966

    36/58

    37

    Hitachi Command Suite: Core Storage Management

    Business View of Storage infrastructure

    Policy manager for Tiered Storage Policy Manager for Replication

    Performance Problem Management Services

    Storage Configuration Services

    Heterogeneous Resource Services

    Heterogeneous Reporting Services

    Backup Reporting Services

    &itachi Virtual Ser#er

  • 7/24/2019 VSP Tech 01_065966

    37/58

    38

    Hitachi Dynamic Provisioning

    Virtualize devices into a pool of capacity

    and allocate by pages

    Dynamically provision new servers in

    seconds

    Eliminate allocated but unused waste by

    allocating only the pages that are used

    Extend Dynamic Provisioning to external

    virtualized storage

    Convert fat volumes into thin volumes by

    moving then into the pool

    Optimize storage performance by

    spreading the I/O across more arms

    Single LDEV Windows LVM HDP Pool

    716% more transactions

    0

    Transactions (IOPS)

    20

    40

    60

    80

    100

    ResponseTime(ms)

    0 1,000 2,000 3,000 4,000 5,000 6,000 7,000

    120

    LDEVLDEVLDEVLDEVLDEVLDEVLDEVLDEV

    HDP Pool

    LDEVs

    HDP Volume(Virtual LUN)

    Today:AutomatedDataMobility

  • 7/24/2019 VSP Tech 01_065966

    38/58

    39

    Today: Automated Data Mobility

    )ier -

    )ier 6

    )ier 4

    2nfra$tructure=

    bloc' level

    #b>ect=