IBM DS8000 Enterprise Storage - Guide Share Europe …conferences.gse.org.uk/attachments/presentations/9TRw1j_1480376894… · IBM DS8000 Enterprise Storage Roger G. Hathorn IBM Systems

IBM Systems© 2016 IBM Corporation

IBM DS8000 Enterprise Storage

Roger G. HathornIBM Systems USA

02/11/2016Session DK


Agenda

DS8880 storage family current features – release 8.1

DS8880 release 8.2 announcement

2


DS8880 Release 8.1 (2Q+ 2016) § DS8888 All Flash Array - Model 982 and 98F Expansion Unit

− Up to 2.5M IOPS and ~200 microsecond latency for typical workloads§ Three phase power option§ DS8000 Copy Services Manager (CSM) feature on the HMC§ RAID 10 support for fully populated High Performance Flash Enclosures (HPFE)§ New drive capacity options for DS8870, DS8884 and DS8886

− 1.8 TB 10K rpm drive sets− 6 TB 7.2K rpm drive sets

§ Functional enhancements− Small Extents− Thin Provisioning for CKD devices− SuperPAV− DB2 Castout Accelerator− User interfaces for PE package and statesave offload− Media error recovery enhancements for PPRC secondary devices− Native LDAP support via CSM− SSD Home tier and Warm Promote for Easy Tier − Key Management Interoperability Protocol (KMIP) as an alternative encryption key manager

3


Fast Hybrid-Flash Block StorageDS8884

Lowestentrycostformidrangeenterprises§HybridFlashstarting§256GBCache(DRAM)§64Ports§768HDD/SDD+120flashcards§19”Rack§Singlephase

Faster Hybrid-Flash Block StorageDS8886

§Highperformanceforlargeenterprises§HybridFlash§2TBCache(DRAM)§128Ports§1536HDD/SDD’s+240flashcards§19”Rack§Single/threephase

Fastest All-Flash Block StorageDS8888

§Industry’sfastestT1Subsystem§All-flash§2TBCache(DRAM)§128Ports§480Flashcards§19”Rack§Threephase

IBM introduced a member to the DS8880 family, a new business-critical all-flash data system to offer a wide range of price points. The family is powered by the next generation of IBM's proven DS8000 platform and delivers critical application acceleration, uncompromising availability and industry-leading capabilities.

The DS8880 family

4


DS8880 Power

§ The DS8888 will support three phase power

§ A new three phase power option will be available for the DS8886− This will take more space in the DS8000 rack

so number of drives on initial frames will be reduced

§ The DS8884 will remain as single phase only

5


SuperPAVs§ Today Alias devices can be used within LSS which means that the number of aliases must be

sized individually for each LSS.

§ SuperPAVs will enable alias devices to be shared among multiple LSS so long as− The devices are assigned to the same DS8000 server (odd/even LSS)− The devices share a path group on the z/OS system

§ Using SuperPAVs will provide benefits especially with a large number of LPARs or many LSS sharing a path group

− Any existing IOSQ peaks should reduce as a larger pool of aliases are available− Existing LSS can have more capacity added without increasing the number of aliases− New LSS can be planned to have a larger amount of capacity per alias

§ There is still a need for at least one base device per LSS so with this release it is not possible to define an alias only LSS

6


DB2 Castout Accelerator

§ DB2 writes long chains of writes when it performs castout processing which typically contain multiple locate record domains. Today each IO in the chain will be synchronised individually affecting both simplex and Metro Mirror performance. The syncs cause performance delays (>150us per page) that are not required.

§ Other applications such as ZFS that do long chains of scattered writes can also benefit from this enhancement

§ Media manager can tell us that there is a "single logical locate record domain", even though there are multiple imbedded locate records. The data hardening requirements for the entire IO are as if this was a single LR domain so one PPRC sync is done for the entire chain.

§ zHPF only

§ Prototype code results showed a 49% improvement in performance with Metro Mirror for typical write chains similar to DB2 castout and 70% for simplex devices.

7


Media Error Recovery on PPRC secondary§ For environments with multiple site replication environments media errors or other data loss events can occur

on any of the replicated copies. HyperSwap protects against events on the production copy but manual actions are currently needed if there is an event such as a RAID rebuild failure on other copies of data.

§ When a media error occurs on the secondary the DS8000 will log the track range lost and suspend the pair showing suspend reason x’11’ which will result in a GDPS freeze. Reason code x’3B’ will also be provided on the event notification for the suspend− For Global Copy and Global Mirror auto unsuspend will add the track range to the OOS and the tracks will

be recovered on resync.− For Metro Mirror resynchronisation will add the track range to the OOS and the tracks will be recovered on

resync.§ In the initial release only a subset of data loss events will be covered by this functionality.

− Only media error events will be covered (ESCs 4910 and 4920)− Only up to 500,000 tracks will be able to be handled− Failover/failback conditions can cause the information about lost tracks to be lost− Call Home events will notify support and the user about status and if there are data loss conditions not

handled by this functionality

8


Create & Offload PE Package & Statesave§ Out Of Band generation & offload of Statesaves, ODD dumps, PE Package, PE Package by Area

§ Performed via DS-CLI or ReSTful API− Default is offload last available− Can list and select any available

Examples:dscli>offloadfile -dev IBM.2107-1300861 –pepackagedscli>offloadfile -dev IBM.2107-1300861 -statesave

§ Automation opportunities previously discussed as part of Restoring Storage Resilience• GDPS HyperSwap occurs• Issue commands to offload PEPkg/SS automatically• Data for Analysis is available far sooner / Problem Resolved sooner / Swap Back sooner

9


Small extent size

10

127

45 6

§ReduceextentsizeonDS8000from1GBto16MB(1113cyls to21cyls forECKD)–Largermemorysizesonnextgenerationsystemsallowforsmallerextentallocationwithoutperformancepenalties

–z/OSallocationunitforEAVdevicesis21cyls sodatasetallocationwillmatchextentboundary

§Improvesefficiencyoftieringfunctionality,copyservicesaswellasprovidingmoreefficientcapacityusage

§Improvesbalanceamongrankresourcesevenatveryshorttimeintervalssignificantlyimprovingperformancestabilityevenforverybursty workloads

§AllowsforuseofSpaceEfficientFlashCopywithGlobalMirrorwithimprovedperformancecomparedtothecurrentTrackSpaceEfficientFlashCopy–SignificantreductionincostforhighperformanceGlobalMirrorenvironments

814

92 3

5811

69 10


Small Extents with Flash Copy

§ ESE Flash Copy with Small Extents replaces TSE Flash Copy– more space efficient than ESE with large extents– better performance than TSE Flash Copy

§ Pool with small extents supported for Flash Copy Target volumes

§ Supported for Global Mirror Journal Volumes

§ For optimal performance include 10% Flash in the small extent pool

11


Easy Tier enhancements§ SSD Home Tier

− As the price of Flash/SSD reduces clients are configuring larger percentages of Flash in tiered environments. Given a larger percentage of Flash the initial allocation of extents on flash makes better sense

− SSD Home tier will change Easy Tier behaviour in the following ways• Extent allocation will be performed on tier0 then tier1 then tier2• Cold Demotion will be performed from tier0 to tier1• Additional space will be reserved on tier0 for thin provisioned volume allocations (currently 24 extents)

− SSD Home Tier will be an optional switch provided at the DS8000 box level

§ Warm Promote− Environments using Nearline drives have occasionally seen problems where there is a significant amount of data on Nearline

that suddenly becomes active. The same could also apply with larger Enterprise drives − Warm Promote will act in a similar way to Warm Demote and if the 5 minute average performance shows a Nearline (or

Enterprise) rank is overloaded will immediately start to promote extents until the condition is relieved.− As the Nearline performance profile is somewhat conservative this is quite likely to occur if there is any significant activity

on Nearline ranks but for Enterprise ranks is less likely

12


Thin Provisioning for ECKD in DS8880

13

StoragePool

§ Once allocated provides the same performance as fully provisioned devices for both random and sequential workloads

− Allocating writes require metadata updates as each extent is allocated

§ Unallocated extents do not have to be copied with replication functionality or migrated with Easy Tier

§ Simplify configuration by standardizing device sizes without wasting space

− Unused/unallocated devices can be included in replication configuration avoiding frequent changes

§ Allow for sharing of spare storage capacity across sysplexes or between storage groups

300GBdrives 300GBdrives

3TBdrives

SSDdrives

123

45 6

1

2 3

45

6

1

A001DB1234A002

SPARE1

1


IBM® DS8880Roger HathornSTSM IBM Systems

IBM DS8880 Release 8.2Release Announcement Summary

14


DS8880 R8.2 Announcement Summary§ HPFE Gen 2§ Flash overview and history§ HPFE Gen2 hardware and benefits

§ CKD Thin Provisioning enhancements − Extent level space release− PPRC from Full to ESE

§ Enhanced FICON IU pacing− For better performance with higher speed links at distance.

§ Miscellaneous items of interest− DSCLI support for z/OS – can run under UNIX system services− RAID Options and New Model Numbers

15


NAND Flash technology is used across the IBM Systems Flash

Storage PortfolioFlash Memory provides important advantages over tradition Hard Disk Drives:

üFaster read and write operationsüNon-volatileüLess prone to damageüPhysically small üLow power consumptionüInherently rugged

NAND Flash comes in many types

ü Single-level cell (SLC) - Highestperformanceü Multilevel cell (MLC) - Good balance between

performance and costü Triple-level cell (TLC) - Lower cost for read

intensive workloads

MLC1 NAND Technology is used across the IBM Systems Flash Storage portfolio

1Enterprise MLC (eMLC) or IBM enhanced MLC

16


SSD refers to a flash media based storage device that is accessed and managed as a logical disk drive, consisting of a standard disk drive interface (such as SAS or SATA). Their sizes are 1.8 and 2.5 inches

Flash technology can be used in many forms …

IBM Systems Flash Storage Offerings

All-flash array (AFA)

Mixed (HDD/SSD/CFH)

All-Custom Flash Hardware (CFH)All-SSD

Hybrid-flash array (HFA)

CFH defines an architecture that uses optimized flash modules to provide better performance and lower latency than SSDs. Examples of CFH are:

• High-Performance Flash Enclosure Gen2• FlashSystem MicroLatency Module

• All-flash arrays are storage solutions that only use flash media (CFH or SSDs) designed to deliver maximum performance for application and workload where speed is critical.

• Hybrid-flash arrays are storage solutions that support a mix of HDDs, SSDs and CFH designed to provide a balance between performance, capacity and cost for a variety of workloads

The DS8880 Family offers All-flash and Hybrid-flash with CFH, SSD and HDD configurations designed to satisfy a wide range of business needs from superior performance to cost efficient requirements

Source: IDC'sWorldwideFlashintheDatacenterTaxonomy,2016

17


Flash brings real benefits that justify the investment by far …

Besides the performance benefits, there are additional compelling advantages when adopting Flash technology

Source: Justifying Investment in All-Flash Arrays. IDC August 2016

1.Meet or exceed the performance level agreements with far fewer devices

2.Flash requires lower energy and less floor space consumption

3.Fewer servers are required due to better CPU utilization

4. Fewer servers require less spending on software licenses

5. Lower operating and administrative costs

6. Better reliability since flash is based on electronic rather than mechanical media

18


Source: Worldwide External Enterprise Storage Systems Forecast, 2016–2020, Publication Date: IDC Jul , 2016

Future view of the All-flash and Hybrid-flash market …

74.5% of the business revenue will be flash-based (AFA and HFA) by 2020

All Hard Disk Drive

Hybrid Flash

All Flash5.64%11.20%16.28%20.38%24.05% 27.38%29.28%

42.11%41.70%42.64%43.85%44.66% 45.63%45.25%

19


IBM DS8880 R8.2 Announcement Summary

20

ü Enables faster decision making with up to 2x performance improvement per enclosure1 on real-time analytics, cognitive computing and traditional IO intensive workloads

ü Manages business data growth with up to 6 times more capacityper enclosure for storage consolidation and high-data-volume workloads2

ü Improves data protection for superior business continuity where integrity is critical by using RAID 6 as default

1.- High-Performance Flash Enclosure Gen2

1Two times more performance per enclosure compared with the previous generation of High-Performance Flash Enclosures. The performance is 2.5M IOPS per DS8880 system 2 Six times more capacity per enclosure considering the previous generation of High-Performance Flash Enclosures with 30 x 800 GB Flash Cards ( 24 TB) and the new generation of flash enclosures with 48 x 3.2 TB Flash Cards ( 153.6 TB)

2.- Thin Provisioning space release for z System volumes

High-PerformanceFlashEnclosureGen2

ü Provides better synergy with z Systems by enabling space release functionality for Count Key Data (CKD) volumes

ü Improves storage efficiency by releasing free extents and making them available for reuse


IBM DS8880 R8.2 Announcement Summary

4.- Enhanced FICON at extended distances on long read and write operations1

ü Improves customer satisfaction and business continuity by increasing the throughput up to 4 times on z/OS Global Mirror (zGM) initial copy or re-synchronization, as well as improving performance of DFSMSdss, DB2 Utilities and other software using long FICON chains especially in in multi-site parallel sysplex environments

1 Applies only to 16Gb FC Host Adapters

3.- Improved DS8000 Storage Manager Graphical User Interface

ü Helps organizations in accelerating the storage deployment process by simplifying the definition and configuration of new host servers

ü Provides advanced collaborative tools to storage administrators in order to work more efficiently with support, enabling problem determination in a fraction of the time

Automatic creation based on unassigned

host ports

21


CKD Thin Provisioning specifics

§ Space Release − DFSMSdss SPACEREL utility to release dataset extents for volumes or storage

groups− Protected by RACF FACILITY Class profile, STGADMIN.ADR.SPACEREL− Supported on Metro Mirror primaries (or simplex devices) only at this time

§ PPRC from standard to ESE volumes for migration− Secondary volume becomes fully provisioned (if the same size)− SPACEREL after relationship termination

22


High-Performance Flash Enclosure Gen2 is a breakthrough in technology

1 to 1

High-PerformanceFlashEnclosure High-PerformanceFlashEnclosureGen2

Size 1U 4UFlashcardoptions 400/800GB 400/800/1600/3200GBNumberofsupportedflashcards

16or30(1.8”) 16,32or48(2.5”)

Maxrawcapacity 24TB1 153.6TB2 Over6xRAIDprotection 5/ 10 5/6 /10Attachment Two PCIeGen2 • Two PCIeGen3forattachmenttotheIO/MicroBay

• EightSAS6GbforattachmenttotheGen2enclosureInstallgroups 2installgroupsof16Flashdriveand14FlashDrives(4arraysites) 3installgroupsof16Flashdriveeach(6arraysites)Increments Populate inincrementsofasingleHigh-PerformanceFlash

EnclosurePopulateinincrementsofasinglestoragegroup consistingof:OneHigh-

PerformanceFlashEnclosureGen2+TwoIO/MicroBaysPerformance IOPS Throughput IOPS Throughput

Read 340,000 3.8GB/s Read 650,000+90% 8GB/s+ 110%Write 200,000 2.7GB/s Write 300,000+50% 5GB/s+85%

1 30 flash cards x 800 GB2 48 flash cards x 3.2 TB

23


Total raw flash capacity comparison between the previous and the new DS8884 and DS8886 models

HPFE HPFE Gen2DS8884 96000 307200DS8886 192000 614400

96000

192000

307200

614400

0

100000

200000

300000

400000

500000

600000

700000

DS8884 DS8886

TB

HPFE HPFEGen2

Over 3 times the flash capacity of the

previous models

24


DS8888 Performance – zHPF

25


DS8888 Performance – All Flash

26


RAID 6 for mission-critical protection

Drive media is rapidly increasing in capacity to 10TB and more. The greater density provides real cost advantages but requires changes in the types of RAID protection used

1 2 3 4 5 6 P S

Traditionally RAID 5 has been used over RAID 6 for Enterprise and Flash media because:

ü Performs better than RAID 6ü Provides more usable capacity

RAID 5

However as the drive capacity increases , RAID 5 exposes enterprises to increased risks, since higher capacity drives are more vulnerable to storage media errors during array rebuild

ü Data will be lost, if a second drive fails while the first failed drive is being rebuiltü Media errors experienced on a drive during rebuild result in a portion of the data being non-recoverable

1 2 3 4 5 Q P S

RAID 6 RAID 5 uses one parity drive whereas RAID 6 uses two

27


The DS8880 family takes the increased risks posed by high capacity drives very seriously

RAID 6 ensures business continuity for mission-critical applications because:

ü Data is still protected event if a second drive fails while the first failed drive is being rebuiltü Information placed in unreadable regions in a specific drive can be detected, isolated and recovered

from the remaining drivesü RAID 6 provides a 1000x improvement over RAID5 for impact risk

In order to improve data availability, IBM moves protection to the next level by enabling RAID 6 as default in the GUI for all drive types

The use of RAID6 rather than RAID5 can dramatically reduce the probability of drive failures providing increased protection for workloads where data integrity is critical

28


IBM DS8880 Family: All-flash and Hybrid-flash Made for Business-Critical Workloads

DS8884 DS8886 DS8888

Affordablehybrid-flashblockstoragesolutionformidrangeenterprises

Fasterhybrid-flashblockstorageforlargeenterprisesdesignedtosupportawidevarietyofapplicationworkloads

Fastestall-flashblockstoragewithsuperiorperformancedesignedtoaddressthemostdemandingbusinessworkloads

Model 984 985(Single Phase)986(ThreePhase) 982

Cache 256GB 2TB 2TB

FC/FICONports 64 128 128

Media 768HDD/SSD96flashcards

1536HDD/SSD192flashcards 480Flashcards

Maxrawcapacity 2.6PB 5.2PB 384TB

BusinessClass

EnterpriseClass

AnalyticClass

IBM DS8880 is the business-critical storage family designed to offer a wide range of price points. This enterprise storage data systems are powered by the next generation of IBM's proven DS8000 platform and deliver critical application acceleration, uncompromising availability and industry-leading capabilities

29


Only the IBM DS8880 family provides the deepest integration with IBM® z Systems™ while supporting IBM Power Systems, and Distributed Systems under a single management point

Efficiently consolidate all your business-critical applications

Enable your business to efficiently address the widest variety of workloads:

Cognitive: All-flash and hybrid configurations to support operational decisions and optimize business processes in real-time

Business Analytics: Superior performance and unparalleled availability for analytics applications and real-time decision making

Cloud: RESTful and OpenStack APIs to enable critical workloads applications in private and public cloud environments

I/O-intensive: Improved data speed access for databases, enterprise resource planning systems, online transaction processing systems and data warehouse applications

30


31

Workloads and Use Cases: IBM DS8000 family

CognitiveA Health institution turns its IT department into an affiliate company that offers specialized IT services to other health insurers and adds USD 5 million in income. This institution uses IBM z/OS and IBM System Storage DS8000 to develop a solution with a market-leading interface powered by IBM Watson Explorer Enterprise Edition cognitive search. This solution learns from searches over time, refining results based on the success of past interactions

Business AnalyticsAn energy corporation accelerates audits by 98 percent, gains insights into customer behavior and eliminate the manual reporting tasks integrating SAP, ERP, SAP for utilities and SAP Business Warehouse software by connecting the servers to multiple IBM System Storage DS8000 solutions

CloudA Health institution successfully opens its first clinic by an aggressive deadline and gains a reliable IT infrastructure for its clinical applications and facilitates smooth operation of the new clinic by designing and building a storage infrastructure based on IBM SmartCloud Control Desk and IBM System Storage DS8000

I/O-intensiveA restoration services company in Germany improved the performance for most mission critical SAP applications and the underlying DB2 databaseby up to 50 percent and decreased backup times from 3.5 hours to two minutes, a 99 percent reduction. All of this using the IBM Systems Storage DS8000

I/O-intensive

Cognitive Analytics

Cloud


Notices and DisclaimersCopyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.

Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.

IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”

Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.

Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.

Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.

It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law

32


Notices and Disclaimers Con’t. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectualproperty right.

IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.

33


Session feedback

§ Please submit your feedback at

http://conferences.gse.org.uk/2016/feedback/dk

§ Session is DK

34

Documents

IBM DS8000 Enterprise Storage - Guide Share Europe …conferences.gse.org.uk/attachments/presentations/9TRw1j_1480376894… · IBM DS8000 Enterprise Storage Roger G. Hathorn IBM Systems