Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
An Industrial View of Storage,
Cloud Computing, and Big Data Cloud Computing, and Big Data
Development
Version: 1.5
12/11/2013 1
Cloud Computing Looking Back (2011–2013) Looking Back (2011–2013)
12/11/2013 2
Back In Beginning of 2011
� Amazon AWS dominated the public cloud world, with some
second tiers like Rackspace, GoGrid, competing
� Open (Web) Cloud camp, Cloudstack (Citrix), Openstack, etc.,
came on scene and thought they will dominate the world
� Big Data will be every where and storage vendors will
benefit big time from Big Data adoptionbenefit big time from Big Data adoption
� Storage cloud became popular with Dropbox service and
new entries from big and small vendors just showing up
12/11/2013 3
Now End Of 2013
� Amazon AWS dominated the public cloud world
� AWS continues dominating the public cloud space
� Big guns such as Google and VMware are moving in to compete
� Second tiers SP’s such as Rackspace, GoGrid are in danger of loosing ground
due to economics of scale
� Not many public cloud service providers, including new entries from Telco’s,
based on incumbent technologies are making moneybased on incumbent technologies are making money
� Open/Web Cloud camp, Cloudstack (Citrix), Openstack, etc.,
came on scene and thought they will dominate the world
� Open/Web cloud has made significant inroads in public cloud for new wave
applications such as Web and mobile (Baidu, Sina, etc.)
� Some incumbents such as VMware, ATT, and HP, are betting on two horses,
their proprietary and Open/Web clouds (all Openstack based)
� Adoption of Open/Web cloud for enterprise applications has been slow.
Incumbents continue their dominance within enterprise
12/11/2013 4
Now End Of 2013
� Big Data will be every where and storage vendors will
benefit big time from Big Data
� The adoption of Big Data has been relatively slow
� Storage vendors still try to find a way to make storage relevant to Big
Data
� Storage cloud became popular with Dropbox service and
new entries from big and small vendors just showing upnew entries from big and small vendors just showing up
� Dropblox becomes an analogy of storage cloud and continues its
dominance; 50M users in 2011, 100M users in 2012, and 200M users
in 2013
� Google Drive, Microsoft SkyDrive, Apple iCloud are sharing smaller
piece of pie
� Smaller storage cloud service providers are loosing ground and
struggling
� All SP’s are moving to look for opportunity in business space 12/11/2013 5
Recent Technology And Market MovementsMarket Movements
12/11/2013 6
Technology Advancements
�Commodity hardware pooling resources
�Virtualization abstracting the resources
�Automation with policy-driven provisioning and
service-level agreement
SDN/SDS – Software Defined Network and Storage
12/11/2013 7
Technology AdvancementSDN – Software Defined Networks
IDS/IPS
SLB
FW
Switch
IDS/IPS
SLB
FW
Switch
Switch
SLB
Virtual Network 2
Virtual Network 1
12/11/2013 8
Spine Switch
Leaf SwitchLeaf Switch
Storage
ServerNetwork Services
ServerServer Server
Storage Storage
Servers ServersSwitch
ServersFW
Physical Network
Technology AdvancementSDS – Software Defined Storage
MemoryCPU
High Performance
VDC with all SSD drives
SSD
MemoryCPU
SATA
Medium Performance
VDC with all SATA drives
High Performance
VDC with mixed drives
MemoryCPU
Mixed
12/11/2013 9Physical Storage Pool
Technology AdvancementsSDDS – Software Defined Data Center)
Cloud Federation
Various Application Clouds
Software-defined Dada Center•All virtualized data center resources
•Virtual server
Private Cloud• Government cloud
• Enterprise cloudPublic Cloud
• Web application
• Mobile application
• Media application
• Storage cloud
• Compute cloud
12/11/2013 10
•Virtual server
•Virtual network
•Virtual storage
Physical Data Center•All x86 commodity hardware
SDDC Example - Media Cloud
Media
Feed
Media
Ingest
Service
Streaming
ServiceVideo
Service
Storage subsystem
Media
Applications Big Data Analytics cloud
12/11/2013 11
Physical
Data
Center
Storage
Virtualization
SDDC
Abstraction
LayerNetwork
Virtualization Server
Virtualization
SDDC Abstraction
MSO
SDDC2
MSO
SDDC1 SDDC3
App
Store
SDDC5
Development/Testing
SDDC4
Incumbent vs. Open/Web Cloud
12/11/2013 12
Source: Cloudscaling
Incumbent and Open/Web Clouds Can Co-
exist Peacefully
12/11/2013 13Source: Cloudscaling
Matching Apps to Infrastructure
12/11/2013 14
Source: Cloudscaling
Big Data And StorageBig Data And Storage
12/11/2013 15
Driving Forces
Social
Networking
Internet of
Web/Mobile
12/11/2013 16
Internet of
Things
Structured
• Database
• Spreadsheet
• File in record format
Semi-structured
• XML Docs
• Logs
• Click-stream
• Equipment/ Device, RFID tag
Unstructured
• Web Pages
• Multimedia
• Instant Messages
• Documents
Challenges And Obstacles
Huge amount of space, both on-
line and second tier storageStorageStorageStorageStorage
Different processing model and
capability with time constrain
ProcessProcess
inging
ProcessProcess
inging
Breaking existing IT infrastructure
Lack of domain expertise and
knowledge
12/11/2013 17
capability with time constraininginginging
New infrastructure setup and
needs management skill and
expertise
ManageManage
mentment
ManageManage
mentment
New tools/workflow for analysisAnalysisAnalysisAnalysisAnalysisIntroducing new business model
and workflow
High CAPEX with uncertain return
knowledge
To Accelerate The Adoption
Public Cloud Solution Need Public Cloud Solution Need To Happen FirstTo Happen First
• Experiment it without high CAPEX investment
• Better understanding of technologies, practice, and potential returns
• More solutions are showing up, including AWS, VMware vCloud, and others
Give time to enterprise for Give time to enterprise for • Most enterprise IT infrastructure still
12/11/2013 18
Give time to enterprise for Give time to enterprise for transitioning IT transitioning IT infrastructureinfrastructure
• Most enterprise IT infrastructure still based on legacy setup; server virtualization along doesn’t cut it
• Storage infrastructure is a big part of it; it is not just for on-line compute; regulation/compliance practice need to be part of movement
Deeper integration solution Deeper integration solution with lower TCO need to with lower TCO need to
happenhappen
• Deeper hardware and software, including platform, analysis, and application, integration
• Much lower TCO
Architecture Questions To Be Answered
� Big Data To Virtualized Environment
� Dedicated Physical Compute Resource
� Low latency and high performance
� Hard to manage and provisioning when offered in public cloud setup
� Virtualized Compute Resource
� Higher latency and lower performance
� Easier to manage and provisioning when offered in public cloud setup� Easier to manage and provisioning when offered in public cloud setup
� DAS or Shared Storage For Big Data
� Direct Attached Storage
� Lower latency and higher performance
� Hard to share raw data and need to duplicate data
� Governance and compliance issues
� Shared Storage
� Higher latency and lower performance
� Easier to share raw data and no need to duplicate data
� Generally fit into existing IT infrastructure for governance and compliance
12/11/2013 19
ConclusionConclusion
12/11/2013 20
Summary
� Multiple Cloud Architectures Will Co-Exist
� Incumbent (Enterprise) cloud for legacy applications
� Open/Web cloud for Web/Mobile applications
� Software defined data center will play a key role, but not the only
solution
� Big Data Will Shine Eventually
� Enterprise IT infrastructure needs to catch up
� Fully integrated solution, from infrastructure to analysis
tools/applications, need to happen
� Storage will be a key factors to lower the cost and accelerate adoption
� Storage Cloud Needs To Move Beyond Storage Space And
Basic File Service
� Provide multiple services, file access, backup, archiving, etc.
� Need to Targeting at Business Opportunity
12/11/2013 21
Thanks & QuestionsThanks & Questions
PROMISE Technology., 2013 22