Embed Size (px)
Citation preview
Ciber
Storage
2015
Storage Shifts and
Software Defined Storage (SDS)
MRMUG
Chris Walker
Solution Architect
Storage 2015 BIO
Ciber – Solution Architect
• 27 years working in IT in an assortment of
roles including: Systems Administrator,
Programming, Software Engineering, Critical
Problem Support, technical Sales, and most
currently a Solution Architect for Ciber, Inc.
• Tennis, Guitar, Jet Skiing(new), going out to
eat!
• I have lived in many different places but
most recently have lived in the Boston area
and moved to Northern Kentucky a little over
3 years back. I am married and have one
daughter who recently graduated college and
I just bought the farm!
Storage 2015
Agenda – Presentation Topic Outline
• The New Storage Directions and Driving Forces
• Software Defined Storage – What is it?
• How can it be done?
• Why do it?
• An Example of SDS from the IBM portfolio
• Converged and Hyper-converged IT
• Q&A
Storage 2015
60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 347,000 Tweets
693,800 GB of IP Data is Transferred
571 New Websites Created
Over 2 million Google search queries
47,000 Apple Store App downloads
77,244 Wi-Fi connections made on iPhone
217 New Web Mobile Users
600 New Videos on YouTube
60 www Domains Registered
20 New Victims of Identity Theft
1,500 Blog Posts
More Than 200 Million E-Mails
510,000 Comments on Facebook
More Than 370,000 Minutes of Voice Calls on
Skype
Gone In 60 Seconds
Storage 2015
Welcome to the world of….
Cloud, Analytics, Mobile and Social
4
2.5 Billion Gigabytes of
data per day
Data
Explosion
90% of data
created in
last two years
Mobile
95% of mobile traffic is data
Social
500 million Tweets a day;
7 million apps and websites integrated with Facebook
Big Data & Analytics
2,500 petabytes of big data are being generated every day
Today’s Business
Cloud
80% of new applications will include cloud delivery or deployment
CAMS
Data doubling every two years
Storage 2015
Systems of Interaction
Systems of Interaction
The new era of transforms how companies engage, interact and transact
with their customers.
Exploding Data Volumes
(Big Data)
Diverse Data Types (Big Data)
Increasing Value of Information
(Analytics)
Mobile and Social Engagement
80%
of new data
Block Data = Structured Data (Data Bases, VMs, core business applications)
File and Object Data = Unstructured Data (Text, Video, Pictures, Office Docs, Device data, Social and Mobile conversations)
20%
of new data
Traditional
IT
Mobile/Social
Storage 2015
Systems of Interaction in Play
Outcome : The Right Car in the Right Place and the Right Time for the Right person
Sales Campaign launch – new C-Class
Sales Campaign launch – new C-Class
Search information driven from Sales campaign
-Reviews
-Colors
-Options
Locations known for audience!
Big Data (Analytics) Business Intelligence
Tweak the
Campaign
Traditional
IT
Adjust
Inventories,
Logistics
Conversations and Social interactions with friends
and family around event. Comments on research,
word of mouth, etc, all about Mercedes and even
their competition.
Storage 2015 Behind the Scenes is IT supporting this…
If you were to choose .. Which is most important in this list?
Lines of Business
Driven LOB accounts for 61% of all IT purchases
CMO drives a majority of Mobile/Social/Analytics most often without
IT involvement
Storage 2015
Hybrid
Cloud / Public
Cloud
IT Need a new storage model that : • Frees data from constraints of specialized hardware
• Lowers overall Costs
• Provides location independent data services
• Faster deployment
• Ease of management and growth
• Integration with modern APIs and hypervisors
• Enables Faster time to market!
Business
Pressures
New
Applications
Data
Growth
Servers are well understood. Storage is exploding Pressure to adapt to a fast and changing business environment
Storage 2015
What is Software Defined Storage (SDS)?
Key attributes of SDS
Runs on commodity hardware: no special hardware or components needed
Offers a full suite of storage services: equivalent to traditional hardware specific systems
Federates multiple persistent storage resources: internal disk, cloud, other external storage
System Leverages:
– Shared nothing architecture
– Scale-out model
– Virtualization of Storage resources
Broadly grouped into three buckets: File-based, Object-based and Block-based
Software-defined storage is any storage software stack that can be installed on any commodity (x86 hardware, hypervisors, or cloud) and/or off-the-shelf computing
hardware and used to offer a full suite of storage services and federation between the underlying persistent data placement resources to enable data mobility of its tenants
between these resources
Storage 2015
Software Defined Storage - Basics – Control Plane and Data Plane
Data Plane
(Hardware)
Control Plane
(Software)
Traditional Appliance
“Integrated device”
Network of
Servers with
Storage
(Back-End Could be
anywhere running
on almost anything)
Software Defined Storage
Storage 2015
Software Defined Storage – Control and Data Planes
Concepts
SDS Control Plane (SOFTWARE) Policy
Automation Analytics and Optimization
Integration and API Services
Backup and Copy
Management
Storage Virtualization
Storage Efficiency
SDS Data Plane (HARDWARE)
Scalable Storage Performance and Capacity
Virtual Storage
Open Common Control Plane to Manage Storage Services for application Workloads
Storage Systems
Provision Service Classes
Self-Service
Charge back
Life Cycle Monitor
and
Manage
Storage
Interface
(GUI)
Security
Storage 2015
Software Defined Storage – Control and Data Planes
How vendors deploy today - Typically
SDS Control Plane (SOFTWARE) Policy
Automation Analytics and Optimization
Integration and API Services
Backup and Copy
Management
Storage Virtualization
Storage Efficiency
SDS Data Plane (HARDWARE)
Scalable Storage Performance and Capacity
Open Common Control Plane to Manage Storage Services for application Workloads
Provision Service Classes
Self-Service
Charge back
Life Cycle
File, Object Unified Block
How we deploy
today
Tight Coupling
IBM, EMC, NetApp, Hitachi, HP Specialized, fit to task Hardware Devices
“Storage Arrays”
Storage Systems
Security
Storage 2015
Software Define Storage – Control and Data Planes
How the industry is starting to deploy and future direction
SDS Control Plane (SOFTWARE) Policy
Automation Analytics and Optimization
Integration and API Services
Backup and Copy
Services
Storage Virtualization
Storage Efficiency
SDS Data Plane (HARDWARE)
Scalable Storage Performance and Capacity
Open Common Control Plane to Manage Storage Services for the Workloads
Provision Service Classes
Self-Service
Charge back
Life Cycle
File, Block, Object
Customer picks their Deployment Model: Integrated Appliance (SW+HW), SaaS Cloud, Software Only
to deploy on their own hardware platform
Decoupling of HW and SW
Tape Libraries,
SSDs, Flash HW
appliances, Disks
Security
Storage 2015
Software Defined Storage – How Does it Work?
• Most Storage arrays are:
• Built on Linux, Unix or Windows Kernels - potentially
offering a common code base
• Most Run on Intel x86 – offering a common hardware
architecture
• All are based on Server technology at the core – While
delivering advanced data services, most storage
products are essentially based on 2 or more servers
under the covers.
• What are the components of a server?
• CPU and associated architecture
• Memory
• Disk Bays (SSD, Hard Drives)
• PCI BUS- I/O
• HBAs – Fibre Channel, NICs, SAS
• Other PCIe cards as needed
IBM V7000 Gen 2
Controller node
Storage 2015
Software Defined Storage – How Does it work?
• OK, so storage services are essentially delivered
from a server platform. How does one certify all the
possible server platforms out there??
• Virtualization\Hypervisor – if the server platform is VMware
ESX, Linux KVM, Hyper-V certified it can be certified for use
• No hardware compatibility lists or expensive testing labs
• Virtualization vendors have done the interoperability work already
• Insure required components in the server – software deployed
atop a virtual machine or a virtual appliance should perform
basic component checks
• Does it have the required interfaces? NICs, HBAs
• Does it have the min amount of memory, drives, CPU cores, etc
• Is it highly available? i.e. redundancy in components and paths
• Caution – UPS, Flushing of cache to non-volatile devices
• Customer responsible for UPS, consistent power
Server 1
Server 2
Server N+1
Data Services
Storage 2015
Software Defined Storage – Why offer this?
Customer Choice – “Data without Borders”
• Flexibility of deployment options – no
physical or locational lock-in.
• Rapid deployment and scaling
• Standardization on HW - Flat Data Center
• Repurpose standard servers to storage
services permanently or as needed
• Can change server vendors without
downtime
• Reduced Capital Expense- CAPEX
• Operation Expense models - OPEX
• Mobility and Manageability between
deployments whether on premise or off, on
integrated appliances or your own
standardized servers, or choice of cloud
• Excellent for QA, DEV, TEST, remote
office, and even DR. Production?
Flat Data Center Economics • One server type
• One element manager
• Economies of scale
• Reduced Complexity
Storage 2015
Software Defined Storage – Customer Choice
Example: IBM XIV
• Deployment Options
• IBM Integrated Appliance – pre-built and tested storage arrays
and appliances from IBM. Hardware and Software in an
integrated solution.
• XiV Gen3 – Tier 1 Enterprise Storage offering
• Software Only Solution – IBM sells XiV storage services as
software (Spectrum Accelerate) to deploy on Virtual machine
(ESX and KVM) that the customer chooses.
• Storage as a Service (SaaS) offer in IBM’s SoftLayer Cloud or
other Clouds – storage services delivered from the cloud.
Installed on Standard Servers deployed in a public cloud.
OPEX model. SLA driven.
IBM HW
and
Software
Bundled
XiV Gen3
IBM SW deployed on
customer’s choice of server
HW wherever it may be.
IBM XiV data/storage
services served from
SoftLayer, Amazon,
Azure Clouds
as software
All storage is manageable and interoperable
between the different deployments models
Lenovo, HP, Dell,
or other servers
Storage 2015
Software Defined Storage – What might this look like?
IBM Spectrum Accelerate – “Data without Borders”
IT Data Center Core (HQ) Integrated Storage Appliance
(HW + SW)
On Premise
Disaster Recovery CLOUD Storage Services (SaaS)
On Public Cloud
Remote Branch Office Storage Services on Standard Servers
On Premise
• Same Functionality
• 100% Interoperable
• Location independent
storage services
• Allows for Hybrid
Cloud
The new Customer
We need sharable storage that can be
deployed quickly, scale as we grow, be
installed where we need on our choice
of HW with no HW lock-in, and be
location independent. What are our
options?
Storage 2015 Converged Infrastructures – SW at the center
Definition
Converged infrastructure is a computing infrastructure that includes two
or more computing solutions combined and delivered through joint
collaboration as a unified solution.
Converged infrastructure uses a preconfigured computing solution
provided by one or more vendors. It is primarily designed to provide
centralized management of IT resources, where complete pools of
resources are managed through a single control panel.
Converged infrastructure is also known as infrastructure in a box.
https://www.techopedia.com/definition/26580/converged-infrastructure
Storage 2015
Converged (Integrated) Infrastructure
Server, Storage, and Networking in a
defined and validated architecture but still
separate and distinct components.
• Cisco UCS
• Networking
Cisco Nexus Network
Cisco MDS
• Servers
Cisco Rack and Blade models
• Storage
• VCE Block (EMC)
• FlexPod (NetApp)
• VersaStack (IBM)
• HP ConvergeSystem portfolio
Software in the solution manages
all of the components and provide
automation and orchestration.
5
10
15
1
2
3
4
6
7
8
9
11
12
13
14
16
17
22
27
32
37
42
18
19
20
21
23
24
25
26
28
29
30
31
33
34
35
36
38
39
40
41
5
10
15
1
2
3
4
6
7
8
9
11
12
13
14
16
17
22
27
32
37
42
18
19
20
21
23
24
25
26
28
29
30
31
33
34
35
36
38
39
40
41
SR42UBSR42UB
Storwize V7000 Unified
StorwizeV7000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Exp
ansi
on
CISCO UCS 6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
STAT
ID
STS
BCN
ACT
Cisco Nexus 9396PX
1
2
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
STS
BCN
ACT
Cisco Nexus 9396PX
1
2
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
DS-C9148S-K9
P/S
FAN
STATUS
CO
NSO
LEM
GM
T ET
H
LINK ACT
MDS 9148S 16G Multilayer Fabric Switch47 4845 4643 4441 4239 4037 3835 3633 3431 3229 3027 2825 2623 2421 2219 2017 1815 1613 1411 129 107 85 63 41 2
USB
CISCO UCS 6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
STAT
ID
DS-C9148S-K9
P/S
FAN
STATUS
CO
NSO
LEM
GM
T ET
H
LINK ACT
MDS 9148S 16G Multilayer Fabric Switch47 4845 4643 4441 4239 4037 3835 3633 3431 3229 3027 2825 2623 2421 2219 2017 1815 1613 1411 129 107 85 63 41 2
USB
241
System Storage
Storwize V7000 Unified
UCS
C220 M3
3
8
2
7
1
654
CONSOLE!
UCS
C220 M3
3
8
2
7
1
654
CONSOLE!
SLOT
1
SLOT
5
SLOT
3
SLOT
7
SLOT
2
SLOT
6
SLOT
4
SLOT
8
!
UCS 5108
OK FAIL OK FAIL OK FAIL OK FAIL
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
SLOT
1
SLOT
5
SLOT
3
SLOT
7
SLOT
2
SLOT
6
SLOT
4
SLOT
8
!
UCS 5108
OK FAIL OK FAIL OK FAIL OK FAIL
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
! ResetConsole
UCS B200 M3
StorwizeV7000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Co
ntr
ol
StorwizeV7000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Contr
ol
Nexus 9396 Switches
MDS 9148S FC Switches (OPTION)
UCS 6248UP Fabric Interconnects
UCS C Series Rack Servers (C-220)
UCS 5108 Blade Chassis with M3/M4 B-200
Blades
IBM V7000 Unified
Storage 2015
Hyper-Converged Infrastructure
Server, Storage, and Networking in a defined and validated architecture
built on a common x86 server platform. Whole stack integration with
servers as the hardware component.
Holistic view and integration of all required system components with simple
linear scalability. No more specialty areas, disciplines and skills.
X86 Sever Building Blocks
Storage 2015 SDS Advantages
Deployed on standard server hardware from a variety of vendors – Customer Choice.
Complements and transforms existing infrastructure to support next generation applications and deployment models
Built on and exploiting robust proven virtualization technology and supporting multiple Cloud APIs
Customer wins with lower costs with CAPEX and OPEX deployment options, data mobility, and agility to respond to business demands.
Flexible and rapid deployment models: on cloud(s), as an integrated appliance, and as software on client’s choice of server hardware
22
Storage 2015 SDS Cautions
Total certainty of underlying HW is not known. Some lack of control Ie. UPS, Battery backup
Shift in design of the way things can fail. HA achieved by designing for failure rather than assuming control of it.
Newer technology, not performance proven. Being consumed as general purpose storage. Still FUD in play.
Supportability – Is it the HW or the SW – Different vendors potentially providing the solution.
Political and Organizational Change – Server and Storage groups need to unite. Network as well.
23
Storage 2015 Thanks!
24
Storage 2015
What is required to run an Application?
Application Code (Software) runs on:
• CPU
• Memory
• Storage
• I/O ports for communication
• Network to communicate between systems and clients
Storage = Persistence Data
• Disk
• Flash (NAND)
• Tape
• Optical
LAN/SAN
Server
