26
Adrian Booth Client Technical Specialist IBM FlashSystem Team [email protected] IBM FlashSystem Storage Simply efficient, simply consistent, simply reliable

IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

Adrian Booth

Client Technical Specialist – IBM FlashSystem Team

[email protected]

IBM FlashSystem Storage

Simply efficient, simply consistent, simply reliable

Page 2: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 2 IBM FlashSystem © 2016 IBM Corporation

Traditional workloads New workloads

Market shifts change data economics

Systems of Engagement

Require massive scale and rapid pace

Accelerate business insights

Rely on data elasticity, supporting diverse hardware

Systems of Record

Benefit from simplified infrastructure

Require cost efficiency through improved virtualization and automation

Drive controlled data growth

Transactional systems

ERP, CRM, eMail

Virtual servers and desktops

Social and media

Mobile applications

Big Data & Analytics

Integrated approach

Page 3: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 3 IBM FlashSystem © 2016 IBM Corporation

Flash Performance can help your business How some customers are deriving significant value!

Application response time greatly reduced

− Higher transaction rates with lower capacity, cost, footprint (One government agency saw 6X improvement)

− Consistent and predictable performance for transaction processing (10X Latency improvements have been seen..

− Eliminates spikes and long rates by doctors, or customers at retail outlets, or . . . .

− Continue to serve transactions while updating prices (Travel reservations for example)

Reducing Batch windows for end of day, month, quarter, year processing.

− One labour union saw 89% reduction in batch windows (Another Insurance provider dropped from 24 hours to 3 hours)

Analytics accelerated

− Insurance companies and banks able to comply with risk analytic directives

− Beverage company shortened batch window for determining what product was needed leaving more time for advanced analytics.

Virtual Environment improvements

− Boot storms handled – 67% improvement in login times.

− Enables more VSIs and VDIs on servers

− Drastically increases performance of VDI

Page 4: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 4 IBM FlashSystem © 2016 IBM Corporation

Tremendous savings to be had operationally How some customers are deriving significant value!

Storage Admin simplification

− Capacity planning can just involve real capacity needed and not worry about IOP

load

− No tuning for performance like copying data to multiple RAID ranks

− Electronic healthcare record software provider has a 60 page manual to follow if the

system will be on HDD systems

Can Save SAP, Oracle, other software license fees

− One low cost airline saved $1.23M in licensing costs

− CPU utilization improve due to no wait time and therefore, less servers needed!

As much as 97% reduction in rackspace/floorspace

Savings on power and cooling

Can avoid costly DB redesign or software redesign

Page 5: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 5 IBM FlashSystem © 2016 IBM Corporation

What is the FlashSystem Differentiation

Performance

− Highest IOPs and lowest response time in every workload real and random

− Consistent IOPs regardless of load, spikes, etc

IBM Enhanced Endurance MLC Flash

− Buy NAND Flash directly from supplier

− Provide Endurance with our secret sauce

Extremely rich and hardened features and advanced functions

− Copy services, Easy Tier, Hyper Swap, Hyper Scale, Snapshots, data reduction, Virtualization, Data Migration, etc

− Flash optimize more and more over time

Hardware Data Path − Gives consistent and high performance – Grid Scale

− Contributes to lowest power solution

− FPGAs give inflection points for optimization

Simplicity

− Ordering, Setup, configuration and support

− Easy to quantify value

1 #

Page 6: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 6 IBM FlashSystem © 2016 IBM Corporation

|

6

IBM led the market in

capacity shipped with

62 PB of flash sold in

20142

IBM led the market in

capacity shipped with

170 PB of flash sold in

20153

The Flash Industry is Growing…IBM Flash is Leading

2Gartner, Market Share Analysis: SSDs and solid-State Arrays, Worldwide, 2015; May 2015. 3Gartner, Market Share Analysis: SSDs and solid-State Arrays, Worldwide, 2015; May 2016

Page 7: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 7 IBM FlashSystem

DS8888 FlashSystem

A9000

IBM FlashCore™ Technology Optimized

FlashSystem A9000R

Storwize V7000F

Storage services and

selectable data reduction

Mid-Range

• Extreme performance

• Targeting database acceleration &

Spectrum Storage booster

Cloud service providers

• Full time data reduction

• Workloads: Cloud, VDI,

VMware

FlashSystem 900

All flash array for application acceleration

Storwize V5030F

Entry /

Mid-Range

Large deployments

• Full time data reduction

• Workloads: Mixed and

cloud

High End

Server

-Mainframe

-Power

DeepFlash 150

All Flash for

Big Data

-High capacity

-High density

Improved

FlashSystem V9000

Improved Improved

IBM All-Flash Solutions The foundation for cloud and cognitive business

Page 8: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 8 IBM FlashSystem © 2016 IBM Corporation

Innovative ECC algorithm corrects very high bit error rates (does not require additional reads)

−Latency does not degrade as parts age

Health binning and heat segregation − FlashCore technology continually assesses

health by monitoring several key parameters − Hotter data placed in healthier blocks –

Up to 57% improvement in endurance! − Write Amplification reduced by up to

45% by grouping like heat levels

The IBM and Micron collaboration provides special access to the Flash − Extensive characterization determined optimal

read offsets to set as block ages

Powerful checks on entire data path, including inside the flash modules

Variable Stripe RAID reduces what needs to be retired

IBM MicroLatency™ Module Key Differentiators

Results:

Large endurance gains w/o latency penalty

Asymmetrical wear leveling results in higher

endurance in real life workloads!

As the part ages and we determine the health

of each block, the ideal voltage levels are

set in order to minimize errors!

Outstanding data reliability

and improved endurance

Page 9: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 9 IBM FlashSystem © 2016 IBM Corporation

Benefits of IBM Enhanced MLC

Raw MLC

IBM Enhanced Flash

Endurance Gain: 9.41X Raw MLC Endurance

Commodity ECC

IBM Enhanced MLC

With IBM ECC

Red line: Nominal thresholds Worst block (block of

lowest endurance)

Endurance gain • Threshold shifting • Strong ECC • Health binning • Heat Segregation

Page 10: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 10 IBM FlashSystem © 2016 IBM Corporation

IBM FlashSystem 900 System Block Diagram Concurrent Code Load (CCL) and maintenance

• Engineered for Flash

• Hardware RAID

• Fully redundant with

no single point of failure

• Data path is entirely independent

of the control path

• Full Active-Active design

• Fine Grain Grid architecture

Maximize Business Uptime Canister-1 Canister-2

XBAR 0

FC-1

MC-2MC-1

FC-3 FC-4FC-2

V

S

R

2-Dimensional RAID5 (10+P+S)

Page 11: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 11 IBM FlashSystem

IBM FlashSystem 900 the next generation in our lowest latency offering

• IBM MicroLatency™ with up to 1.1 million IOPS

• 40% greater capacity compared to previous generation

• IBM FlashCore™ technology, our secret sauce

Technical collaboration with Micron Technology – flash chips

• IBM enhanced flash technology

• MLC NAND flash offering and Flash Wear Guarantee

Improved integration with VMware ‘Neighborhood’

management in GUI

Performance at-a-glance

Minimum latency

Write 90 µs

Read 155 µs

Maximum IOPS 4 KB

Read (100%, random) 1,100,000

Read/write (70%/30%, random) 800,000

Write (100%, random) 600,000

Maximum bandwidth 256 KB

Read (100%, sequential) 10 GB/s

Write (100%, sequential) 4.5 GB/s

Module type 1.2 TB 2.9 TB 5.7 TB

Modules 4 6 8 10 12 6 8 10 12 6 8 10 12

RAID 5 capacity 2.4 4.8 7.2 9.6 12 11.6 17.4 23.2 29.0 22.8 34.2 45.6 57.0

Raw Capacity 7.1 10.7 14.2 17.8 21.4 26.3 35.1 43.9 52.7 52.7 70.3 87.9 105.5

Page 12: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

World Class Flat Performance – FS 900 Random 4K IOPs

All Performance measurements are taken while garbage collection is in place!

Workloads improved from 13 to 50%! • 70/30 - 13% • 50/50 - 25% • 0/100 - 50%

Page 13: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 13 IBM FlashSystem © 2016 IBM Corporation

Flash Optimized Tier One Storage

Truly Integrated Storage System

Integrated management, RAS, Service, Data services.

Scales from 2 to 8 nodes - concurrently

From one to 8 Flash Drawers. 4 to 456TB uncompressed

Up to 2.2PB with compression

Disaster Recovery services including, Global Mirroring, Metro Mirror and Active Active Hyperswap

Virtualization of other Storage

− Data Migration and workload balancing

V9000!

Page 14: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 14 IBM FlashSystem © 2016 IBM Corporation

IBM FlashSystem V9000

Macro Efficiency

Enterprise Reliability

• Scalable to 2.5 million IOPS

• Scalable to 19.2 GB/s

• Mixed Workload Consolidation

• 2x Real-time Compression

performance improvement

• Advanced Data Services

• Copy Services, mirroring,

replication, external virtualization,

VAAI

• 8, 16 Gb FC, 10 Gb FCoE/iSCSI

• Hot swappable architecture

• AES 256, HW-based encryption

• Fully redundant controllers

• Scale up to 57TB usable and

up to 285TB effective

capacity in only 6U

• Scale up to 456TB usable

and up to 2.28PB effective

capacity in only 34U

• Effective capacity possible

with optional Real-time

Compression

• IBM Real-time Compression

• IBM Easy Tier®

• Thin provisioning

• Copy services

• Data Virtualization

• Highly available configuration

Accelerate applications with enterprise-class,

advanced storage capabilities

IBM MicroLatency™

• 200 µs response time

• Flash-optimized design

Extreme Performance

Page 15: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 15 IBM FlashSystem © 2016 IBM Corporation

Two-dimensional scaling Scalable Performance

Maximum Performance

Scaled Out (100% Read, 4 Building

Blocks) *

Latency (4K) 200µs

IOPS (4K) 2,520,000

Bandwidth (128K) 19.2 GB/s

Maximum Performance

Scalable Build Block (100% Read, Cache Miss)

Latency (4K) 200µs

IOPS (4K) 630,000

Bandwidth (128K) 6.2 GB/s

Maximum Performance

Fixed Build Block (100% Read, Cache Miss)

Latency (4K) 200µs

IOPS (4K) 526,000

Bandwidth (128K) 6.2 GB/s

Scalable Performance

Page 16: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 16 IBM FlashSystem © 2016 IBM Corporation

FlashSystem V9000 Options for Deployment

• Great for Tier 1 disk replacement

• Scale up and out for more

processing, more capacity and

more I/O

• Up to 2.5M IOPS, 200µs

• Up to 320TB Usable, 1.6PB

Effective

Public or Private Cloud

• Great for database and VDI

workloads

• Accelerate, migrate, tier, clone,

snapshot, replicate, compress

existing storage

• Up to 630K IOPS, 200µs

• Up to 40TB Usable, 200TB

Effective

Small Data Center

• Great for large data sets with big

I/O requirements and needing

storage services

• Scale up for more all flash

capacity

• Up to 630K IOPS, 200µs

• Up to 200TB Usable, 1PB

Effective

Application Accelerator

• Great for data centers with

heterogeneous storage

• Extends core feature set to other

storage arrays

• Up to 2.5M IOPS, 200µs

• Up to 3 Exabytes virtualized

Virtualized Data Center

Page 17: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 17 IBM FlashSystem © 2016 IBM Corporation

• Real-time Compression typically delivers 65% savings and helps reduce: – Storage purchase costs, Rack space, Cooling, Software costs, Other operational cost (staff, etc.)

• Reducing data written to Flash storage adds even more value: – Drives down cost per TB (Flash for less than disk)

– Increases effective usable Flash capacity (better efficiency & density)

– Minimizes Write Amplification of Flash (better endurance)

• Market leading Flash, Virtualization, and Compression in FlashSystem V9000 – SVC advanced features enable easy deployment of Flash & RtC

– Compress existing data non-disruptively to accelerate ROI

– Consolidate more workloads to Flash

– Mature solution, field-proven, track-record availability

• RACE technology delivers ultimate performance for real life workloads • RtC performance effectiveness was designed and purpose built for primary application workloads

• RtC has a very innovative mapping structure which uses temporal locality of most workloads to store the mapping information together

• Therefore real workloads will tend to get more cache hits and deliver great performance

• The primary advantage of RtC is better performance and effectiveness with real life workloads

Real-time Compressing in FlashSystem V9000 How RtC Differentiates and Adds Value to FlashSystem

Page 18: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 18 IBM FlashSystem © 2016 IBM Corporation

Controller Upgrade Program

IBM FlashSystem V9000 for today and tomorrow

• IBM FlashCore technology already supported up to 7 years

• Now Extend your FlashSystem controller lifecycle to match, supporting the

latest in software enhancements

• Free non-disruptive controller upgrades for FlashSystem V9000

• Automatically included for all new Premium Warranty customers

• Received with the purchase/extension of 3 years additional years of

warranty/maintenance

Current Enclosure– AE2

Current Controller– AC2

Current Controller– AC2

Buy Now

Includes 3 Year Premium Warranty

New Controller Upgrade

New Controller Upgrade

After 3 years: Upgrade to New Controllers with maintenance extension

3 years of additional Warranty / Maintenance

3 year Software Mainenance 3 year of additional Software Maintenance Software

Current Enclosure– AE2

Software

Additional

Flash Memory

Additional

Flash Memory

Optional Anytime Upgrades:

• Scale Up - Additional Enclosures

• Scales Out – Additional Systems

Keep your business competitive with the fastest

controllers and all the software features

No painful upgrades (always non-disruptive)

Predictable maintenance pricing with no late life

price gouging

Page 19: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 19 IBM FlashSystem © 2016 IBM Corporation

• Designed to simplify the lives of the DBA and Storage Admin

• Designed to perform spectacularly – without tuning - especially in real world workloads

• Designed to give fantastic data efficiency

• Deduplication, Compression and Pattern Removal

• Designed to take advantage of IBM FlashCore™ technology

• Designed with help by Cloud Providers for Cloud Providers!

• Designed to have exceptional quality and availability IBM FlashSystem A9000R

IBM FlashSystem A9000

Introducing the Newest Tier 1 All Flash Array IBM FlashSystem™ A9000 and IBM FlashSystem™ A9000R

Page 20: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 20 IBM FlashSystem

1Based on a 5.26 to 1 data reduction ratio; 270/30 read write

Flash Enclosure-60 Flash Enclosure-150 Flash Enclosure-300

Effective Capacity 1 60 TB 150 TB 300 TB

IBM MicroLatency®

modules 12 x 1.2 TB 12 x 2.9 TB 12 x 5.7 TB

IOPS2 Up to 500,000

Minimum latency 250 µs

Host interface 8 or 16 Gb Fibre Channel + 10 Gb iSCSI,

or 10 Gb iSCSI

Introducing IBM FlashSystem A9000 Simply efficient, simply consistent, simply reliable

• 8U modular offering

• Composed of 3 grid controllers & 1 flash enclosure

• Scales via IBM Hyper-Scale Manager

Page 21: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 21 IBM FlashSystem © 2016 IBM Corporation

A9000 Performance Low Latency, High IOPS, Most of All, Consistent

• Use hardware accelerators throughout design

• Compression accelerator cards

• Hardware IO accelerators and RAID

• Flash controllers with hardware data paths

• Provide sufficient hardware resources

• Powerful processor complexes

• Large memories

• Fast internal low latency RDMA fabrics

• Ingenious and innovative design elements

• Upper and lower caches

• Temporal locality and intelligent storage of metadata

• Search hard for duplicates – but don’t go overboard!

• Spread everything out in a Grid fashion

• Grid caching

• Grid data distribution

• Fine grain grid in the FlashCore

Page 22: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 22 IBM FlashSystem © 2016 IBM Corporation

The Grid Provides Consistency Oracle Production Database

Oracle Database #2

SAP

VSI

VDI

Writes to the A9000 are distributed in a Grid fashion to the caches of the various Grid Controllers. Two copies of each cache entry are kept!

The Grid Controllers then destage To Flash Enclosures on a large grain Grid. And the flash enclosures distribute to all Flash controllers on a small grain grid.

Page 23: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 23 IBM FlashSystem © 2016 IBM Corporation

The Science Behind Simple!

• FlashSystem engineers absorbed the complexity so the

product would be simple to use

• Take Grid to a whole new level to eradicate the need for

any tuning or special placement

• Service and support are as simple as just letting us in the

data center!

• CLIs, Copy Services have their heritage in XIV to enable

rapid deployment, provisioning, Replication, etc

• Manage many FlashSystem A9000s from one screen and

migrate data simply and seamlessly.

Simple is

beautiful.

Page 24: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 24 IBM FlashSystem © 2016 IBM Corporation

FlashSystem A9000 Data Reduction that Performs!

• Keeping with simplicity as an imperative – Compression and Deduplication are always on.

• Which then puts responsibility on US to ensure low latency by minimizing accesses to backend.

• Background processes can kill consistent performance.

• So FlashSystem A9000 compresses extremely well on the way in and then lets it rest.

• FlashSystem A9000 will optimally find the duplicates on way in and then lets the data rest.

• Deduplication is across volumes and across grid controllers and flash enclosures.

Page 25: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 25 IBM FlashSystem © 2016 IBM Corporation

Flash Systems advantage vs other AFAs

• Hardware accelerators for compression enabling high performance inline data reduction • No background activity is required for data reduction

• Hardware RAID with no software involved in the I/O path for extremely low latency

• Handles boot storms and workload spikes extremely well because no processors are overloaded

• Does not need to use Enterprise MLC SSDs (expensive) like some other AFAs because proprietary algorithms extend the life of regular MLC to be as long as the more expensive eMLC.

• Lower write amplification than SSDs due to proprietary algorithms and ECC • Helps endurance but also prevents performance spikes that can happen from boot storms

• Some AFAs use cheap MLC SSDs without any extra technology

• Susceptible to performance that can get worse as the box fills up with data or when the box ages • A9000 has no such worry

• End to end checking throughout the data path

Page 26: IBM FlashSystem Storage Simply efficient, simply ...€¦ · IBM FlashSystem V9000 for today and tomorrow •IBM FlashCore technology already supported up to 7 years •Now Extend

| 26 IBM FlashSystem © 2016 IBM Corporation

Any Questions

ibm.com/systems/storage/flash