31
IBM Cloud Object Storage Turn massive storage challenges into a business advantage. Joe Krotz IBM CTS – Cloud and Storage Systems August 2016

Cleversafe august 2016

Embed Size (px)

Citation preview

Page 1: Cleversafe august 2016

IBM Cloud Object Storage

Turn massive storage challenges into a business advantage.

Joe KrotzIBM CTS – Cloud and Storage Systems

August 2016

Page 2: Cleversafe august 2016

2Page© 2016 IBM Corporation

Today, data is everything

2Page

Page 3: Cleversafe august 2016

IBM has acquires Cleversafe – The Leading Object Store Provider!Software Company• Founded in 2004 in Chicago• Shipping product since

2008

Software Defined Object Storage• Over 100 people dedicated

to software development

Runs on Industry Standard x86• Certified platforms to

provide enterprise grade experience, predictable performance and support

Over 300 Patents AwardedObject Storage Leader two years in a rowMultiple Exabytes in Production

Acquired by IBM 2015

Notable Milestones

Page 4: Cleversafe august 2016

IDC Report onObject Storage MarketDecember 2014• Customer spending growing

27% per year• Total market projected to be

$28B in three years• Cleversafe highlighted

as “Market Leader and Market Share Leader”

Gartner Report – Object Storage – March 2016• Cleversafe highlighted as

leader in Critical Capabilities

Page 5: Cleversafe august 2016

Unstructured Data is growing exponentially which is exactly why Cleversafe is so critical

* Ex

abyt

es

2009 2010 2011 2012 2013 2014 2015 2016 20170

20

40

60

80

100

120

Unstructured Data

Structured Data

Source: IDC

Unstructured data growth of60–80%

per year creates

Web-scale storage needs

*1 exabyte = 1,000 petabytes =1 million terabytes = 1 billion gigabytes

Problem - Traditional and Legacy Storage Designed for Transactional, Not Unstructured Data

Page 6: Cleversafe august 2016

Web-scale requires a new storage architecture Objects 1000x larger

HD videos/images/audio Genomic/seismic data Internet of Things/social media

Large and growing storage requirementUp to exabytes with always-on availability and zero-touch, carrier-grade security

Legacy storage won’t scale and is less cost-effective Traditional storage requires copies, replication, mirroring and disaster recovery

(DR) to protect data—Cleversafe can help eliminate those requirements, and can help lower both cost and complexity

Can also reduce requirements for power, cooling and management for lower TCO

Cleversafe provides web-scale performance/capacity at any time with zero downtime operations

Multiple Interface: customer deployment flexibility Industry standard object API compatibility

Page 7: Cleversafe august 2016

Cleversafe has the strengths and differentiators our customers demand!

Availability – No downtime during software upgrades, hardware refreshes, and in the face of disk, node, and site failures.

Security - Encryption for data at rest provides government grade security, no single disk, node or site contains enough information to constitute a data breach with built in key management.

Scalability – Scale performance and/or capacity at any time with no downtime to operations

Efficiency – Less raw storage means less power, cooling and floors pace resulting in lowest TCO

Manageability– No RAID sets or replication schemes to manage. Manage more petabytes with less people.

Page 8: Cleversafe august 2016

Object storage EFFICIENCY is defined by Cleversafe.

$70% +

TCO Savings

How to build a highly reliable storage systemfor 1 Petabyte of usable data?

RAID 6 + Replication

Cleversafe®

Original1.20 PB Raw

Onsite mirror1.20 PB Raw

Remote copy1.20 PB Raw

1 PB3.6 PB

9003.6x3.6x

3 FTEReplication/

backupExtra Software

Usable StorageRaw Storage4TB Disks

Racks RequiredFloor SpaceOps Staffing

1 PB1.7 PB4321.7x1.7x.5 FTENoneNone

567 TB Raw 567 TB Raw567 TB Raw

Page 9: Cleversafe august 2016

Deployment Options – Traditional on PremiseSingle Site

Site B

Two Site

Geo Dispersed

Site A

Site B

Site C

Site AMost efficient storage for customers who do not need site tolerance

Mirroring for customers who require a more traditional deployment

Best mix of efficiency and availability providing site tolerance

Most Cleversafe customers are deployed in three or more sites

Page 10: Cleversafe august 2016

Original Data

Accesser® ApplianceAccesser®

Encrypted, Erasure Coded

Slices654321

10

1211

7

98

Slicestor® Appliances

SITE 1 SITE 2 SITE 3Storage Nodes

2432

876

121110

1 5 9

The Accesser® can be a physical appliance, virtual appliance, Accesser Application, Docker Container or Embedded Accesser.

The Accesser® transforms objects into slices and vice versa.

The Slicestor® stores slices of objects. (No more than one slice of a given object)The Slicestor® is a physical appliance.

Slicestor® and Accesser appliances are built using commodity hardware components, and are available from Cleversafe and certified partners.

The Cleversafe Architecture

Page 11: Cleversafe august 2016

Original Data

Accesser®

Encrypted, Erasure Coded

Slices654321

10

1211

7

98

Slicestor® Appliances

SITE 1 SITE 2 SITE 324

32

876

121110

1 5 9

The Cleversafe Architecture Expansion FactorThe number of slices created from an object by the Accesser is the IDA width (12 here)

The IDA (7 of 12 here) is configurable, providing the flexibility to optimize reliability, availability, and efficiency.

The smaller number of slices required for the Accesser to read the stored object is the IDA threshold (7 here)

Width divided by threshold (12/7 or 1.7 in this example) is called the IDA expansion factor and ranges from 1.3 to 1.8. Usable storage capacity times expansion factor equals raw storage required.

Accesser® Appliance

Page 12: Cleversafe august 2016

Original DataEncrypted

Data

Writing Data to Cleversafe

Erasure Coded Slices Erasure

coding is used to transform the data into a customizable number of slices

2

7654321

7654321

12111098

Original object is encrypted1

Page 13: Cleversafe august 2016

Original Data Encrypted Data

Writing Data to CleversafeErasure Coded Slices

Erasure coding is used to transform the data into a customizable number of slices

2

7654321

654321

SITE 1 SITE 2 SITE 3

Storage N

odes

Each slice is written

to a separate

storage node. In this example, the storage nodes are geographically dispersed across 3 sites.

32432

876

121110

10

1211

7

98

1 5 9

Original object is encrypted1

Page 14: Cleversafe august 2016

Reading Data from Cleversafe

Reads can be performed using any 7 of the 12 slices• The number of slices created on write is called the width

(12 here)• The number of slices required to read is called the

threshold (7 here)• This example is a “7 of 12” Information Dispersal

Algorithm (IDA)7654321

SITE 1 SITE 3

Storage N

odes

2

2 43

7

1 6

SITE 2

9x9s redundancy creates one of the most robust Object Storage solutions on the market today!

Page 15: Cleversafe august 2016

Reads can be performed using any 7 of the 12 slices• The number of slices created on write is called the width (12 here)• The number of slices required to read is called the threshold (7 here)• This example is a “7 of 12” Information Dispersal Algorithm (IDA)

7654321

SITE 1 SITE 3

Storage N

odes

2

2 43

7

1 6

SITE 2

Even an entire site outage (plus one additional storage node outage) can be tolerated!

Reading Data from Cleversafe

Page 16: Cleversafe august 2016

Cleversafe Reliability Perspective Reliability is at the heart of Cleversafe development.

Cleversafe erasure coding is inline so you can be assured data is at its fullest protection level once ingested. It is not a post process.     

24x7 background rebuild processes & PerfectBits™ mitigate against unrecoverable read errors on a disk as well as recover from disk and node failure.

Cleversafe systems can be designed with over 10 9’s of permanent reliability

Page 17: Cleversafe august 2016

Cleversafe Use Cases

Page 18: Cleversafe august 2016

Initial Deployment Options

On-premise Dedicated/Hybrid Public• Cleversafe based product

offering with S3 and Swift accessibility managed by customer’s operations staff

• Dedicated: Cleversafe based product offering with S3 and Swift accessibility in SoftLayer facilities managed by IBM

• Hybrid: Cleversafe based product offering with S3 and Swift accessibility in combined on-premise and SoftLayer deployments managed by customer and IBM SoftLayer resources

• Standard: Swift based shared offering with full Swift accessibility and standard object price/SLA

• Nearline: Cleversafe based shared offering with full Swift accessibility and nearline price/SLA

• Select: Cleversafe based shared offering with partial S3 and Swift accessibility and standard object price/SLA

Page 19: Cleversafe august 2016

Active Archive

Backup

Enterprise Collaboration

Storage as a Service

Content Repository

…….. via a set of flexible, scalable deployment models: on-premise, hybrid cloud or appliance

Value

Benefits

Value

Benefits

Value Value

Benefits

Benefits

Scalable backup and always-on data availability for dependable recovery and security at lower infrastructure costs.

Keep content accessible with a scalable, reliable and secure always accessible data archive.

Fuel workplace productivity across the globe with secure, distributed access to valuable content

Deliver new levels of storage capacity and availability with carrier-grade security.

Entrust business-critical data to a reliable, scalable, safe and secure storage platform with built in fault tolerances.

• Efficiently distributed backups across sites.

• Secure data at rest without replication

• Restore and recover from disasters faster.

• Easily manage storage costs and security.

• Provide global data access through a variety of platforms

• Reduce storage mgmt costs and complexity

• Efficiently scale system to customer demands

• Easily integrate mgmt into existing workflows.

• Store a single digital copy of digital assets

• Access content globally

• Efficiently manage content.

• Real time access to entire data set.

• Strong reliability and availability provide continuous access to data even in the event of site outages

Scalability Reliability Availability Efficiency Security Manageability

Benefits

Value

Page 20: Cleversafe august 2016

Enterprise Storage as a Service

NAS ServicesFile synch and shareArchive

Services Video On Demand services

• Scale: PB+ and expanding. New services• Security: zero touch security for all content• Availability: always-on availability for 2.5 years and new capacity in

minutes• Manageability: lower overall data center cost with high service levels• Economics: 80% savings over old (legacy storage) approach and 43%

over AWS• Key Decision Makers: Corporate IT and storage team

Page 21: Cleversafe august 2016

Active Archive – Web Based Photo Sharing

Users upload photo and video content via web based application

Photo and video objects are sent to Cleversafe via REST based protocols

Metadata is captured and stored

• Scale – 130 petabytes and growing: more than 50 Billion images stored• Security – 50,000+ uploads per minute with zero touch security • Always-on availability – SLA of 100% download on demand – even during

CA to Nevada datacenter move• Manageability – 3 Administrators manage entire environment• Economics – Operating costs reduced by more than 70%• Key decision makers – Technical team backed by financial cost cutting

mandates

Page 22: Cleversafe august 2016

Mobile Services Content / Voicemail Backup

S3 compliant phone backup application protects cell phone

content by copying to Cleversafe

• Scale: 25PB serving 10M mobile - Service is now expanding to deliver enterprise services for mail and storage on demand.

• Security: Main driver and requirement for the customer• Availability: 24x 7 availability.• Economics: a reliable 80% savings means that KDDI can expand its

business profitably without IT in the way.• Key Decision Makers: Technical teams

Page 23: Cleversafe august 2016

Scale your offerings without hesitationDeliver competitive enterprise and consumer services by cost-efficiently storing, analyzing, and accessing data at scale with 100% confidence. That's why Cleversafe provides an object storage platform for unlimited service expansion and agility that's easy to manage and easy to scale. With Cleversafe, service providers can focus on developing and managing their offerings, and eliminate concerns about the storage infrastructure underneath.

Content Repository Backup Enterprise

Collaboration Archive

Solutions for Service Providers

Page 24: Cleversafe august 2016

Create consistent, engaging experiencesFrom 4K resolutions to on-demand expectations, the size and volume of media files has exploded. Media and entertainment companies are under increasing pressure to quickly produce, deliver and store new content across multiple distribution channels. As volumes swell to petabyte+ levels, companies are relying on Cleversafe's accessible, reliable cloud storage solutions to protect digital assets such as feature-length movies, production content, imagery, documents, and more. Our massive object storage repository enables users to generate the content they need to meet production demands today—and support business goals tomorrow.

Content Repository Enterprise Collaboration

Archive

Solutions for Media and Entertainment

Page 25: Cleversafe august 2016

Put medical progress firstIn the healthcare industry, life depends on data. That's why Cleversafe delivers innovative cloud storage solutions built for the next medical breakthrough. With Cleversafe's always accessible and secure data repositories, health and life science organizations can get back to focusing on what really matters: treating patients and conducting research.

Backup Enterprise Collaboration

Solutions for Health Care & Life Sciences

Page 26: Cleversafe august 2016

Secure customer trust and business complianceIn an increasingly competitive mobile landscape, protecting customer data is a business imperative. Cleversafe's secure, scalable cloud storage solutions help financial and insurance organizations eliminate data vulnerability at scale and meet increasingly strict compliance regulations.

Backup Enterprise Collaboration Archive

Solutions for Financial Services

Page 27: Cleversafe august 2016

Serve the public good with cloud efficiency, world-class security, and always-on availability.Leverage cloud storage at petabyte-and-beyond scale—and drastically reduce cost. Cleversafe, backed by In-Q-Tel, offers government agencies object storage with perpetual software licenses and meets COOP & DR requirements with out replication. So you can efficiently store and access sensitive data with total control, knowing that information is secure and inaccessible to unauthorized users—even in the unlikely event of a site or server compromise.

Backup Enterprise Collaboration Archive

Solutions for Government

Page 28: Cleversafe august 2016

Cleversafe economics beat AWS and legacy storage!

480 TB 960 TB 1920 TB 3840 TB$0

$2,000,000

$4,000,000

$6,000,000

$8,000,000

$10,000,000 S3

dsNet

Cost: 29–61%+ lower

Current NAS DR protected

Current NAS single copy

NAS Gateway and dsNet

dsNet object protected

$8,400

$4,210

$1,613

$1,053

Cleversafe

Cleversafe vs AWS S3 Cleversafe vs NAS

Cost: 80%+ lower

Cleversafe

S3

Page 29: Cleversafe august 2016

Cleversafe’s Competitive Differentiators

DISK LIFECYCLE MANAGEMENT

Predict drive failures and take appropriate

action

Zero-Touch Encryption

No need for 3rd party encryption or key

management

Flexible, Reliable ECData is strongly

consistent and fully protected on write

Flexible Licensing Model

On-premise perpetual or dedicated/public

subscription

Software Defined / Hardware Aware

Robust management window

SOFTWARE PACKAGED WITH OSNo need to install and manage a separate

OS

Flexible Deployment Model

On-Prem, Off-Prem & Hybrid

Proven at Massive Scale

Customers with well over 100PB in

production

Reduce Cost & Complexity

Less HW, facilities, staff leads to

efficiency at massive scale

Page 30: Cleversafe august 2016

Cleversafe Business Value

Half the Storage Footprint

Cleversafe's requires 50% less storage capacity than traditional storage approaches, which means lower overhead costs such as power and cooling expenses.

Increased Business Flexibility

Nine nines system reliability and 100% uptime enables businesses to expand, relocate and deploy new data centers with less risks and lower costs.

At Least 15x More Efficient to Manage

Cleversafe's intuitive software allows storage architects and administrators to scale and manage the storage environment easily, freeing up time for other mission-critical tasks.

Page 31: Cleversafe august 2016

For more information:Websites:

https://www.cleversafe.com/

http://www-03.ibm.com/systems/storage/

http://www.ibm.com/cloud-computing/us/en/

Product Pages:

http://www-03.ibm.com/systems/storage/flash/

http://www-03.ibm.com/systems/storage/storwize/

http://www-03.ibm.com/systems/storage/disk/xiv/

IBM RedBooks

https://www.redbooks.ibm.com/

Thank you!