Building-21st_Century_Cloud_Storage_Service_John_Sing_V4

© 2013 IBM Corporation

Building 21st Century Cloud File Storage Service Best Practices

John Sing, Executive ConsultantIBM Systems and Technology Group Session CL-1465 Monday, June 10, 2013 10 June 2013

Goal:

Provide framework, big picture for this week’s Technical Edge Cloud

sessions


IBM Storage Solutions for Cloud

2

John Sing 31 years of experience with IBM in high end servers, storage,

and software– 2009 - Present: IBM Executive Strategy Consultant: IT Strategy and

Planning, Enterprise Large Scale Storage, Internet Scale Workloads and Data Center Design, Big Data Analytics, HA/DR/BC

– 2002-2008: IBM IT Data Center Strategy, Large Scale Systems, Business Continuity, HA/DR/BC, IBM Storage

– 1998-2001: IBM Storage Subsystems Group - Enterprise Storage Server Marketing Manager, Planner for ESS Copy Services (FlashCopy, PPRC, XRC, Metro Mirror, Global Mirror)

– 1994-1998: IBM Hong Kong, IBM China Marketing Specialist for High-End Storage– 1989-1994: IBM USA Systems Center Specialist for High-End S/390 processors– 1982-1989: IBM USA Marketing Specialist for S/370, S/390 customers (including VSE and VSE/ESA)

[email protected]

You may follow my daily IT research blog

– http://www.delicious.com/atsf_arizona

You may follow me on Slideshare.net:

– http://www.slideshare.net/johnsing1

My LinkedIn:

– http://www.linkedin.com/in/johnsing



33

Agenda

What is a 21st Century Storage File Service?– Sounds simple. But what has to happen in the background?

The Cloud-enabled data center– Journey along the maturity model– Workflows and patterns, organizational – process - skill changes

Architecting a 21st Century Cloud File Storage Service– Ideal planning vs. pragmatic planning (a template)– Storage components in Cloud macropatterns and micropatterns– Cloud storage taxonomy and storage classes – Fit for purpose: two modern types of IT architectures

Summary– Learning Points– Applicable IBM Storage Cloud hardware and software products

Source: If applicable, describe source origin

Goal:

Provide framework, big picture for this

week’s Technical Edge Cloud

sessions


IBM Presentation Template Full Version

44

A modern Cloud File Storage Service….

Sounds simple, right?...

Building 21st Century Cloud File Storage Service



5

Today’s Storage Cloud



6

Value delivered

Storage Provisioning

Continuous Access to data

From traditional

Weeks

To cloud

Minutes

For usersFor users

Reduced storage admin

costs

Up to 50% savings

For ITFor IT

Reduced energy costs Up to 36%

Increased storage utilization Up to 90% From 50%

Localized, any time

any where

Dynamic (Elastic)

Centralized

FixedStorage Capacity

Stating the obvious – modern 21st Century Cloud Business Value



7

Scalable capacity Virtual resources - mobile,

efficient Smart allocation - deduplicated,

compressed, thin provisioned

Cross-site data mobility Operational management centralized Multi-site file distribution, synchronization

Pay per use Storage services catalog Self-service administrator provisioning

Hyper-Efficient Storage

Automation and

Management

Optimization

Storage Service (“I need capacity to store my data”)



8

Sounds straightforward. But what has to happen in background?

Some would say that virtualization = cloud

Some IT traditionalists would say that cloud is nothing more than much better managed centralized, automated data centers

Unfortunately, such statements significantly undersize the magnitude of the necessary significant shift in:

– Organizational lines

– Processes

– Workflows

– Required skill sets

This is all solvable, once you understand and act on the proven best practices, patterns, workflows of the cloud.



99

The Cloud-enabled Data Center




10

Pre-req’s for modern cloud IT: 4 Stages of Data Center Efficiency

http://public.dhe.ibm.com/common/ssi/ecm/en/rlw03007usen/RLW03007USEN.PDF

http://www-935.ibm.com/services/us/igs/smarterdatacenter.html

April 2012

Power profile determines 80% of CAPEX to construct

new data center

Power profile determines 80% of CAPEX to construct

new data center



11

Today, most have accomplished virtualization foundation….

But there’s something else still holding many IT organizations back. What is it?

It is: Cloud = new set of challenges and opportunities:

– Requires establishment of an IT service catalog– Developing new automated processes that harness the cloud, connecting it to

business it supports– Requires a new organization structure that establishes new set of roles and skills

that match your cloud

As opposed to keeping the organization as-designed when they were physically deployed

Cloud doesn’t enable an IT service catalog, or simplify it – Cloud **IS* the service catalog

Let’s see what these simple statements mean………



12

This is the cloud-enableddata centerjourney

1. Virtualized

2. Deployed

3. Optimized

4. Enhanced

5. Monetized

Cloud adoption maturity

levels

Level of cloud capability(macropatterns)

http://www.redbooks.ibm.com/abstracts/redp4893.html

IBM Redpaper



13

3. Optimized

2. Deployed

1. Virtualized

Cloud adoptionmaturity level

Level of cloud capability (macropatterns)

Cloud-oriented organizational process changes

Cloud-oriented organizational

process changes



14

5. Monetized

4. Enhanced

3. Optimized

Cloud adoption maturity levels

Level of cloud capability(macropatterns)

Cloud-oriented organizational process

changes



15

Thankfully, we can build cloud macropatterns step by step

4. ITIL ManagedIaaS

3. AdvIaaS

1. Simple IaaS

2. CloudMgmt



16

What’s most important: macropattern workflows

1. Simple IaaS

4. ITIL ManagedIaaS

2. CloudMgmt

3. AdvIaaS



17

Are you ready?

What’s most important: micropattern workflows Storage-specificmicropatterns



18

Key cloud workflow learning point:

Cloud involves re-alignment of IT organization, skills

Re-alignment of IT processes, management, monitoring, delivery around service and service catalog

– Aligned with the Lines of Business (requiring full-time liason positions)– Requiring new roles within IT operations

Creation of service catalog requires IT to invest more/different efforts into design/automation of IT capability

– Typically new, additional skill requirements

Governance that address risk of unauthorized or rogue access to services– Only appropriate approvals and credentials, thus new emphasis on network + security

Addressing resistance to change within IT organization is the biggest success factor



19

19

Architecting a 21st Century Cloud File Storage Service




20

Integration into IT ManageBusiness Line Prioritization

StrategyDesign

Current IT inventory

Businessprioritization

Pain points, goals

Cloud readiness

Needs/goals

Goals

•Maturity Model

•Measure ROI

•Roadmap for Program

ProgramDesign

Current

Capability

Implement programvalidation

Continuous

testing

CloudProgram

Management

Awareness, Regular Validation, Change Management, Quarterly Management Briefings

Business processes drive strategies. They are integral to the planning of Cloud-based Business Operations.

Organizationchanges

Orchestrateprocesses

Disasterrecovery

Highavailability

1. People2. Processes3. Plans4. Strategies5. Networks6. Platforms7. Facilities

Application, database design

Cloud servers

Cloud storage

Clouddesign

Review ”Ideal” Cloud Planning Process



21

Now that you know what best practices cloud workflows look like….

What’s the best way to organize, plan, and implement … My own specific version of cloud?



22

Integration into IT ManageBusiness Line Prioritization

StrategyDesign

Current IT inventory

Businessprioritization

Pain points, goals

Cloud readiness

Needs/goals

Goals

• Maturity Model

• Measure ROI

• Roadmap for Program

ProgramDesign

Current

Capability

Implement programvalidation

Continuous

testing

CloudProgram

ManagementAwareness, Regular Validation, Change Management, Quarterly Management Briefings

Organizationchanges

Orchestrateprocesses

Disasterrecovery

Highavailability

1. People2. Processe

s3. Plans4. Strategie

s5. Networks6. Platform

s7. Facilities

Application, database design

Cloud servers

Cloud storage

Clouddesign

Here’s how to handle: use six key IT Cloud Planning Steps

For today’s real world environment

i.e. how to streamline this “ideal” process?1. Collect information for prioritization

2. Business prioritization, cloud readiness, scope

3. Define Cloud targets, organization, req’d processes

4. Recommend strategy, organization, processes, roadmap

5. Cloud solution options: design and evaluation

6. Recommend solutions, products to fit strategy

5. Cloud solution options: design and evaluation

6. Recommend solutions, products to fit strategy

Rest of this conference

This session



23

Streamlined Cloud Planning ActionsInput Output

2. Business priorities,cloud readiness, scope

List business priorities Defined priorities alignedwith business goals

3. Define cloud targets,organization, processes

Existing cloud readiness, maturity, KPIs, desired goals and targets

Defined cloud goals, organization, processes, architecture, decision and success criteria

5 Cloud solution design, evaluation

Cloud technologies and solution options

Solutions mapped to cloud goals,organization, process, skills

6. Recommend solutions, products

Identified solutions that meet criteria

Recommended cloudsolutions and benefits

1. Collect info forprioritization

Business processes, Key business goals and metrics, IT inventory

Scope, Resource Business Impact

Component effect on business processes

4. Recommend strategy and roadmap

Budget, major project milestones, resource availability, organization change strategy

Baseline Cloud strategy, organization and process roadmap, benefits, challenges,financial implications andjustification

Overview



24

Determine for Cloud Storage architecting:

Understand if the cloud tooling needs to reside:

In an external shared storage stack

Or if it belongs in the virtualized server, direct attach storage, application stack

Both are appropriate, but they must be matched to the proper environment



25

Two different types of Cloud

Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/

Transactional ITInternet scale wkloadsInternet scale wkloads



26

Cloud Types, Characteristics, Positioning

Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/ Transactional ITInternet scale wkloads



27

How industry (Provider, Architect) often builds today’s clouds

Source: http://it20.info/2012/02/the-cloud-magic-rectangle-tm/

Transactional ITInternet scale wkloads



28

Two different types of cloud tooling

Cloud storage tooling will most likely reside: In the external shared storage stack for policy-based traditional transactional IT:

– External IBM Smarter Storage hardware and software for block and file storage In the virtualized server, direct attach storage, application stack for design-for-fail:

– IBM SmartCloud software, IBM participation in Open Stack and Softlayer Both are appropriate, match to proper environment

Transactional ITInternet scale wkloads

http://www.slideshare.net/johnsing1/s-bd03-infinitybeyond2internetscaleworkloadsdatacenterdesignv6speaker



29

Macropatternsreview……

4. ITIL ManagedIaaS

3. AdvIaaS

1. Simple IaaS

2. CloudMgmt



30

Example:IBM products

4. ITIL ManagedIaaS

3. AdvIaaS

1. Simple IaaS

2. CloudMgmt

Compute, Storage, and Network Virtualization layer

Examples: SVC V7000 TPC FlashCopy Mgr XIV SONAS V7000 Unified



31

Are you ready?

Architecting Storage portion of Cloud workflows Storage-specificmicropatterns



32

Storage in Clouds - Taxonomy

Transaction capable

General purpose

Cloud Service Storage Cloud- Public or private- Scale of tenants/users

Storage Cloud- Public or private- Scale of tenants/users

Storage Container Service

BackupArchiveService

Records Mgt

Service

Storage w/o Application

“Storage Cloud” withGateway/VPN/Web

API

Storage + Application“Compute Cloud”

Embedded Storage

Remote Storage Service

Local External Storage

Backup / Archive

Transaction capable

General purpose

Stream CollectService

Stream ExportService

Compute Cloud - Public or private - Scale of tenants/users

Compute Cloud - Public or private - Scale of tenants/users

Tools &

Enablers



33

Storage Classes for CloudStorage Class

(as seen by Guest VM)Req’s Notes

Block - Transaction Attach to Hosted VMslow latency

high I/Ops, low capacity

Enterprise class attributes in performance and availabilityUsually fibre channel connected

More complex to manage with many limitations

Block - General Purpose

Attach to Hosted VMsmedium latency

medium I/Ops, general purpose

General purpose, cost effective storageUsually NAS+Block Virtualization for cost, ease of management, and

scalability

Block - Ephemeral

Allocated to hosted VMs for duration of VM instance

medium latencymedium I/Ops, Typically boot images

Storage allocated as private to a VM, disappears when VM instance is deleted.

Used for boot images or VM specific private disksCan be created by cloning boot image templates from service catalogue

Storage for Analytics

Achieve performance and scale required to meet client expectations

May require unique hardware infrastructureMay require batch-oriented usage model

Network Attached Storage

Attach to hosted VMs or over VPNmedium latencymedium I/Ops

NAS/FIle accesslarge capacity

For dedicated solutions multi-tenancy at the NAS storage device may not be required

For shared solutions fine grained multi-tenancy is a key requirement

Fixed Content Object Storage

Med - high latencyMed - low I/Ops

Local/WAN/Internet accessvery low costlarge capacity

Requires fine grained multi-tenancyREST API assumed as the carrier

Storage as seen by the virtual machine guest:Block storage: A virtual block disk provisioned to the guest VMNAS storage: A network mountable file system to the guest VMFixed content: A network mountable data store to the guest VM that is write once oriented

Storage as seen by the virtual machine guest:Block storage: A virtual block disk provisioned to the guest VMNAS storage: A network mountable file system to the guest VMFixed content: A network mountable data store to the guest VM that is write once oriented

Each storage class could have one or more tiers of storage behind it.

Each storage class could have one or more tiers of storage behind it.

33



34

IBM Redpapers: Building Cloud Enabled Data Center / Service Provider

http://www.redbooks.ibm.com/abstracts/redp4912.html

http://www.redbooks.ibm.com/abstracts/redp4893.html http://www.redbooks.ibm.com/abstracts/redp4873.html



35

35

IBM Cloud Storage components, tools, offerings




36

Compute Cloud Storage Cloud Backup Cloud Archive Cloud

IBM SmartCloud Storage

Build It

Run It

Consume It

• Flex System™ V7000 Storage Node

• SmartCloud Virtual Storage Center

• Tivoli Storage Manager for Virtual Environments

• Storage and Data Services for Cloud

• SmartCloud Managed / Hosted

• SmartCloud Enterprise - persistent storage

• SmartCloud Storage Access

• Storwize V7000 Unified and SONAS with IBM Active Cloud EngineTM


• SmartCloud Managed / Hosted

• SmartCloud Enterprise - object storage

• Tivoli Storage Manager Suite for Unified Recovery with Front-safe portal


• SmartCloud Managed Backup


• Tivoli Storage Manager Suite for Unified Recovery Archive with Front-safe portal


• SmartCloud Content Management


Comprehensive portfolio

Work together with IBM or IBM Business Partners to efficiently

build your Storage Cloud

See appendix in this presentation + other sessions for IBM SmartCloud products



37

OptimizeCloud Ready

Integrated virtualization management with IT service delivery processes

Elastic scaling Pay for use Self-service

provisioning Simplified deployment

with virtual appliances

Consolidate and Virtualize

Virtualization must become strategic across all platforms – servers and storage

Monitor the virtualized environment

Discovery, dependency and change tracking

Automate and Manage

Automated provisioning / de-provisioning

Pool standardized virtualized building blocks

Capture and catalog virtual images used in the data center

Management of the virtualized environment

App

OS

Image

App

OS

Image

App

OS

Image

App

OS

Image

Image Library

STANDARDIZATION

LIFE CYCLE MANAGEMENT

SECURITY

Sequence of Enterprise Cloud Adoption



38

38

Learning Points

Cloud is a significant paradigm shift in:

– Organizational lines

– Processes

– Workflows

– Required skill sets

The Cloud-enabled data center

– Is a journey along a maturity model

– Is composed of modified workflows and reproduceable best practices patterns

Architecting a 21st Century Cloud File Storage Service

– Understand the ideal planning cycle, so that you can do a pragmatic planning exercise

– Implement storage components as part of staged Cloud macropatterns and micropatterns

– Take advantage of proven cloud storage taxonomy and storage classes

– Understand / identify whether you are in Traditional Transactional IT, or Design for Fail

Summary

– Apply IBM SmartCloud expertise, workflows, patterns, to IBM Storage Cloud-enable hardware and software products

– Please see the many other excellent Technical Edge 2013 sessions in the Cloud trackSource: If applicable, describe source origin

This….is the Big Picture!



39



40

Trademarks and disclaimers© IBM Corporation 2011. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

ZSP03490-USEN-00



41

Appendix



42

Capability Req’s Platform Assets

Tier 0 Highest PerformanceServers, Storage with integrated SSDs

IBM Direct Attach SSDs

IBM FlashSystems

Tier 1 Transactional Storagelow latency, high I/Ops

block access

low capacity

Virtualized Block SAN Storage: XIV, DS8000, V7000, SVC, TPC

Tier 2 Persistent Storagemedium latency, I/Ops

VDisks to Virtual machines

SAN: V7000, XIV

NAS File Storage: SONAS, V7K Unified, TPC, Smart Cloud Storage Access

Tier 3Network Attached Storage

medium latency, I/Ops

NAS/FIle access

large capacity

NAS File Storage: SONAS, V7K Unified, TPC, Smart Cloud Storage Access

Tier 4Fixed Content/ Archive Storage

high latency, low I/Ops

NAS/API access, very low cost

large capacity

SAN or NAS storage as appropriate

IBM FileNet Enterprise Content Mgmt

Object store protocol (future) ,

Example of cloud storage tiers using IBM Storage, with file in blue



43

SmartCloud Virtual Storage Center • Bundled, lower total price offering of SAN block

storage and software for cloud computing• Easy to buy and deploy• Pay-as-you-go pricing

IBM cloud-enabled SAN block storage

SAN

Tivoli Flashcopy Manager

Tivoli Flashcopy Manager

SAN Volume ControllerVirtualization

Metro/Global MirrorFlashcopy

SAN Volume ControllerVirtualization

Metro/Global MirrorFlashcopy

Tivoli Storage Productivity Center

Data, Disk, Fabric, Replication, Storage Analytics

Tivoli Storage Productivity Center

Data, Disk, Fabric, Replication, Storage Analytics

Incredible Ease of Use

Expanded Flexibility

Automated Data Protection

43



44

Software: IBM SmartCloud Storage Access self-service portal

Self-service – Capacity provisioning, monitoring, reporting

Web-based access– Simple GUI via Internet

Capacity elasticity– Automated or policy-driven

Monitoring and reporting capability– End-user and administrator

Service Class– Gold, Silver, Bronze

Secure– Access controls

Approval– Complete approval control process

Supports file storage today– IBM V7000 Unified and SONAS

Enables private cloud storage service Enables private cloud storage service



45

Software: SmartCloud Storage Access Statement of Direction

Self-service provisioning support for SVC, Storwize V7000, and XIV block storage

– Supports IT staff, application owners, developers and specialized users in provisioning block storage

– Streamlines provisioning by eliminating need to coordinate with other teams

Storage usage metrics export function– Enables chargeback capability to using departments– Supports IBM SmartCloud Cost Management and other

third party accounting and billing tools

Independent Software Vendor integration through a storage cloud (REST) API

– Integration points available to support industry specific applications

IBM's statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM's sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

SVC

V7000

IBM Confidential until announcement

XIV



46

Software: IBM SmartCloud Cost Management

An integral part of an organization’s IT Management Accounting and Reporting systems

(Shared resources, Reporting/Invoicing, Product Profitability, ERP Integration, Cost Allocations, Activity Based Costing, Resource & Cost Trending, etc.)

Used across multiple platforms

(Including Mainframe, Unix, Linux, Windows, Cloud, etc.)

Supporting multiple sub-systems

(DB2, Oracle, SQL Server, CICS, Virtualization, Web, E-Mail, Networks, Storage, Print Servers, Energy, etc.)

Internet enabled

(Web-Based Reporting & Drill-Down and multiple outputs)

46



47

Software: IBM SmartCloud Orchestrator automates the cloud enabled data center

47