Upload
ross-cameron
View
214
Download
0
Tags:
Embed Size (px)
Citation preview
StorSimple: Cloud-integrated StorageTechnical OverviewJai DesaiWorldwide Technology Solution ProfessionalMicrosoftWS-B324
Agenda• Windows Azure• CiS Overview• Primary Storage & Platform• Cloud-integrated Tiering• Backup/Restore & Disaster Recovery• Security• Case Studies
3
What is Windows Azure?
Windows Azure is
Microsoft’s cloud
platform that enables
you to quickly build,
deploy and manage
applications and store
your data across a
global network of
Microsoft managed
datacentres.
You Manage You Manage
Vendor Manages
You Manage
Vendor Manages
Platform(as a Service)
Storage
Servers
Networking
O/S
Middleware
Virtualization
Applications
Runtime
Data
Software(as a Service)
Storage
Servers
Networking
O/S
Middleware
Virtualization
Applications
Runtime
Data
Infrastructure(as a Service)
Storage
Servers
Networking
O/S
Middleware
Virtualization
Data
Applications
Runtime
You Manage
Vendor Manages
Cloud ServicesOn Premises
Storage
Servers
Networking
O/S
Middleware
Virtualization
Data
Applications
Runtime
Cloud Computing Patterns
tCom
pu
te
Inactivity
Period
On and OffOn & off workloads (e.g. batch job)Over provisioned capacity is wasted Time to market can be cumbersome
t
Unpredictable BurstingUnexpected/unplanned peak in demand Sudden spike impacts performance Can’t over provision for extreme cases
Com
pu
te
t
Predictable BurstingServices with micro seasonality trends Peaks due to periodic increased demandIT complexity and wasted capacity
Com
pu
te
t
Growing FastSuccessful services needs to grow/scale Keeping up w/ growth is big IT challenge Cannot provision hardware fast enough
Com
pu
te
North America Region Europe Region Asia Pacific Region
Major datacenter
CDN node
Windows Azure Global Presence
N. Central – U.S. Sub-region
S.E. AsiaSub-region
E. AsiaSub-region
N. Europe Sub-region
W. Europe Sub-region
S. Central – U.S. Sub-region
Microsoft Confidential - Signed NDA Required
East – U.S. Sub-region
West – U.S. Sub-region
Storage Challenges Are Broad
10
Primary Storage
Disk-Based Backup Storage
Tape Infrastructure and Management
Archival Storage
Replicated Storage for
DR
Offsite Facility for
Georesilience
Storage Today = Complex & Expensive
Data Management Complexity
Backup Issues
Untested Disaster Recovery
Data Growth
and Footprint
Equipment Sprawl
…and are Challenges with using Cloud Storage• Integration
• HTTP/REST API• Integration with existing backup apps & processes
• Performance• WAN latency performance impact• WAN bandwidth costs• Traditional WAN optimization does not work with public clouds
• Security• Data security & compliance risk
11
Application Servers
HTTP/REST API
Cloud-integrated Storage (CiS) Can Help
12
Azure + StorSimple = 60–80% Lower TCO
Thin, ReducedSnapshots
Cloud Snapshots Recover in Cloud or Any DC
Automated Cloud-as-a-Tier
Use Cloud asSecondary DC
Cloud-Integrated SAN Storage
Primary Storage
Disk-Based Backup Storage
Tape Infrastructure and Management
Archival Storage
Replicated Storage for
DR
Offsite Facility for
Georesilience
Storage Today = Complex & Expensive
Focused CiS Applications and Workloads
13
Cap
acit
y
Time
Data Grows Exponentially(50–60% Annually)
However, Most I/O Happens to the “Working
Set” Data
CapEx, OpEx
of Traditional
Storage
CapEx, OpEx of
StorSimple
CloudStorage
Local Storage
Target Use Cases
File Share• CIFS• NFS
• File servers• NAS
SharePoint• Business
intelligence• Collaboration• Content and
records management
Archives• EMR/PACS• Legal• Construction
• Media• Engineering• Logs, records
VMs• Regional office
storage• VM sprawl• VM archives
StorSimple Cloud-Integrated Storage
14
Connects Windows and VMware Servers to Azure Storage in Minutes with No Application Modification
Benefits• Consolidates primary, archive,
backup, DR thru seamless integration with Azure
• Cloud snapshots = revolutionary speed, simplicity and reliability for backup and recovery
• Reduces enterprise storage TCO by 60–80%
Application Servers
Inactive Data + Backup Copies on Azure storage
Speed of SSD/SAN + Elasticity of Cloud
SAS Local Tier
Most Active Data on SSD
StorSimple Solution Characteristics
16
Sca
labili
ty /
Perf
orm
ance
Capacity
552010-50TB* usable local300TB max capacity
752020-100TB* usable local500TB max capacity
* Denotes usable local storage capacity with compression and de-duplication, varies by use case.
* Additional details about appliance specifications can be found at: http://storsimple.xyratex.com/storsimple/specifications
50202-10TB* usable local100TB max capacity
70204-20TB* usable local200TB max capacity
• Seamless iSCSI integration• Highly efficient storage
• Thin provisioning• Primary storage de-duplication
• High performance + cloud elasticity• Integrated tiering: SSD, SAS & cloud
StorSimple Cloud-integrated Architecture
• Full security for the cloud• Local keys + encryption of all cloud data• Protecting both data-in-motion and data at
rest• Fast, automated data protection + recovery
• Automated snapshots to cloud• Fast online restores and elimination of tape• Integrated disaster recovery – lowest cost &
complexity17
On an Enterprise-Class Platform• Certified: VMware-ready and Microsoft Windows Server-certified• HA: full redundancy + hot swaps + non-disruptive upgrades
SAN Storage• iSCSI SAN with auto-tiering
(SSD/SAS)• Automated snapshots• Primary dedupe/compress
Seamless Cloud Integration for:• Tiered primary + archives• Cloud snapshots: mountable for
DR
With Cloud Data Management
De-dupe and Compression• Maximizes storage of ‘hot or warm data’ on-
premise for higher IOPS and/or lower response times for application access.
• Minimizes size of data transfer and storage in Azure
• Works at the block-level and replaces duplicate data blocks with a meta data map (pointers to the original block)
• Data is de-duped in the SSD tier and compressed in the SAS tier before being tiered to Azure
• On-premise data capacity can be increased by 2x – 5x based on the type of data stored
• Backup de-dupe: Cloud snapshots are differential and thereby eliminate copies of redundant blocks across backups
Datablocks
Total data capacity required = 10TB
D C
AA
E
C B
BB
F
D C
AD
E
D C
AC
F
5x de-dupe ratio
• De-duped• Compress
ed
Metadata map
Data blocks
+Capacity used = 2TB A
B CD
E F
Enterprise-class Hardware Platform
19
1. Full MPIO Support
2. Dual controllers with auto-failover
3. Dual power
4. Dual cooling
5. RAID drives
6. Hot-spare drives
7. Non-disruptive software upgrades
8. Certified by Microsoft & VMware
Highly available - no single point of failure
* 5020, 7020, 5520 and 7520 appliances are built and distributed by Xyratex
StorSimple Tiered ArchitectureSSD Performance, Deduplication and Auto-Tiering to Cloud
21
SSDDeduplicated
SASDeduplicatedCompressed
CloudDeduplicatedCompressedEncrypted
SSDLinear TierA B C A B D E
C D E
D E
E
Cloud Snapshots: Simplicity in Data Protection & Recovery
23
PrimaryVolume
Snapshots
Backup, Restore & DR with StorSimple: Automated, Optimized, Reliable
Cloud Snapshots
1. Backup copy of data volume created in cloud2. Changes to local volume automatically transferred3. Cloud snapshots mountable for restore
Benefits• Backup now as easy as snapshots• Very fast restores from off-site
backups• Integrated, easy to test disaster
recovery• Truly eliminates tape
Primary Volume
Virtual Tape/Replication
Physical Tape
SnapshotOffsite Tape
Storage
Backup, Restore & DR Today: Inefficient, Complex, Laborious, and Risky
…Enables Seamless Scalability and Rapid Recovery
24
CloudSnapshots
Enterprise Data Center 1
Enterprise Data Center 2
Connect Many Servers to Cloud Storage and Scale
Data Sets with StorSimple Solution
Rapidly Recover to Any Data Center, Location-
Independent, via Mounting the Cloud
Production Data Production Data
Disaster Recovery Behind the Scenes
• Configuration import process populates DR appliance with all information from original appliance
• Registry restore downloads available backup information from the cloud
• Clone operation fetches volume metadata from the cloud and creates the volume on the DR appliance
• As and when data is requested, blocks are downloaded from the cloud
Benefits
• Quick restore
• Download only the required data 25
1
2 3 4
4
META DATA
DATA
Cloud Snapshots: Up to 100x Faster RTO
26
Application Recovery Times from Offsite Backups in a Disaster
Reco
very
Tim
e
Primary Data
1 TB 5 TB 20 TB 50 TB 100 TB
15 Min.
1 Hour
1 Day
7 Days
30 Days
90 Days
Regular Cloud BackupWith 100 Mbps WAN Link
Tape
StorSimple Cloud SnapshotsWith 50 Mbps WAN Link
Industry-leading Security for Cloud Storage• Multiple layers of obfuscation through the system
• Original data is broken to storage blocks• Blocks are fingerprinted + deduplicated with data from
other volumes• Obfuscated blocks are stored in compressed form
• Encrypt everything before sending to Azure• AES-256 CBC encryption is applied before transmission
using customer key• Additional SSL encryption of all data + meta-data operations
with Azure
• Encryption keys stay only with customer• Microsoft/StorSimple doesn’t have access to customer
encryption keys• Keys can be imported from customer’s secure key mgmt
system or generated from pass phrases
• Encrypted / compressed / obfuscated blocks stored in Azure• Data is secure even if account gets compromised
• Obfuscated• Deduplicated• Compressed
Data in cloud• Deduplicated• Compressed• Encrypted with customer
key
Application Servers
• Blocks encrypted with customer key
• SSL communication:• Authentication• Metadata• Data transfer
Local DataBroken into storage blocks, then:
Cloud Storage Access Security
• Risk mitigation and best practices• Compartmentalize information
• Azure subscription can have multiple storage accounts• Recommended to use different storage accounts to compartmentalize info – e.g. per
dept, project, role, etc.• Periodical key rotation
• Each account has two 256-bit access keys allows easy key rotation without service disruption
• Only requests with valid access keys are allowed to access stored blocks• Data fragments accessed are still obfuscated and encrypted
• Frequent key rotation (e.g. every 90 days) is recommended• Ad-hoc/emergency key rotation if a key is compromised
• StorSimple allows use of up to 64 storage accounts per system29
Scenario 1: Access key got compromised
Scenario 2: Storage admin employee leaves company
Cloud Storage Data-at-Rest Security
• Risk mitigation and best practices• Data at-rest is obfuscated
• Data is broken to individual small blocks and fingerprinted to comprise a global de-duplication dictionary – no volume, file system or file context
• ~16 Million obfuscated blocks per 1TB of Azure storage, spread across multiple hard drives
• Data at-rest is encrypted• StorSimple systems encrypt data stored in cloud with a customer-provided
encryption key. Federal standard AES-256 encryption used.• Up to 64 different encryption keys can be used in one appliance for data-at-rest
isolation to complement access compartmentalization practice.• Encryption key is derived from Customer Passphrase or Key generated by Key
Management System. Only entered input is accessible in appliance UI. • Microsoft or 3rd parties cannot read data when physical drives are lost, replaced, or
repaired in Azure DC30
Scenario 3: Cloud Provider decommissions server hardware or loses physical hard drives in maintenance process.
• Live archives
• Automatic Backup
• Disaster Recovery
Customer Case Study: Major Semiconductor Co.Customer
Needs
ProposedSolution
Impact
• Large data storage footprint for storing engineering docs and chip designs for various products
• Rapid data growth (1.8TB/month @ single location)
• 95% of data not used
• Eliminate expensive on-premise storage
• 3x 7520 StorSimple systems with Azure
• Systems in two different locations for providing file share/archive across multiple volumes (~600TB)
• 5-week PoC
• $900K Azure commit over 3 years
• Dramatic cost savings, ease-to-use, secure data storage in Azure
• Adoption of additional use cases
Total data size = 300TB
Vol1 Vol2 VolN…
Vol1 Vol2 VolN…
Total data size = 300TB
DR site
Phoenix, AZ
Austin, TX
7520appliance
7520appliance
Chandler, AZ
7520appliance
Customer Case Study: Fortune 500 Global Contractor
CustomerNeeds
ProposedSolution
Impact
• Massive unstructured, geographically-dispersed data
• Struggled to deploy SharePoint for data consolidation and sharing
• On-premise storage needed for specific performance and scalability requirements
• Multi-tiered BLOB storage and data management with StorSimple
• Optimized database layout with SSDO (SharePoint Database Optimizer)
• Data stored across 5 appliances• $600K Azure commit over 3 years
• Azure Storage footprint to double to >400TB over 2 years
StorSimple at Each Remote Location backing up data to datacenter
34
Servers
Site A
Existing Servers and Storage
Data Center - HQ
Microsoft AzureCloud
Storage Service
Servers
Site B
Servers
Site C
Servers
Site D
Servers
Site E
Servers
Site F
Servers
Site G
Servers
Site H
DFS Replication to the Data Center
Tiering to the Cloud (No Backup)
Tiering to the Cloud with CloudSnap Backup
Cloud Storage Service
Data Center
Hybrid Cloud Storage for Media and Entertainment
Source Media
On-PremisesTransformation and
Experience
SP CDN
Internet CDN
Carrier/Mobile CDN
Demo Topics• Configure the StorSimple Solution• Map a Volume to FileServer• Backup the volume via SnapShot and Cloud SnapShot• Restore the data from Local SnapShot and Azure• Disaster Recovery
37
Evaluation
Complete your session evaluations today and enter to win prizes daily. Provide your feedback at a CommNet kiosk or log on at www.2013mms.com.Upon submission you will receive instant notification if you have won a prize. Prize pickup is at the Information Desk located in Attendee Services in the Mandalay Bay Foyer. Entry details can be found on the MMS website.
We want to hear from you!
Resources
http://channel9.msdn.com/Events
Access MMS Online to view session recordings after the event.
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.