Upload
neal-copeland
View
234
Download
0
Embed Size (px)
Citation preview
StorSimple 8000 Series: Enabling Enterprise Workloads for Microsoft Azure
Jai Desai – Microsoft (WW TSP)Thomas Kaessheimer -iTernity
CDP-B350
• Storage challenges
• Addressing storage challenges with StorSimple
• StorSimple 8000 series
- Overview
- Cloud integration, tiering, deduplication, compression, and encryption
- StorSimple Manager in Microsoft Azure Management Portal
- StorSimple Virtual Appliance
- Data protection and disaster recovery
• Use cases and workloads
• iTernity Solution
Agenda
Storage challenges
Storage Today = Complex & Expensive
Storage cost and
infrastructure sprawl
Complex data protection &
recovery
Resource constraints
Rapid data growth - 40% YoY*
* Source: EMC Digital Universe with Research and Analysis by IDC, 2014
Addressing storage challenges with
StorSimple
Primary Storage
Archival Storage
Disk-based Backup
Remote Replication
Tape backup and DR
Storage Today Microsoft Azure StorSimple
Managedata growth
Lower storage costs
Simplify data protection and
disaster recovery
Increase business agility
Reduce storage costs by 40-60%
StorSimple
Here is how customers benefitA
ccess
StorSimple provides enterprise storage with cloud economics
Unstructured data growing
40% YoY
Working data set stays fairly
constant
Hybrid storage array
performance for working set
Inactive data is tiered to the
cloud
SSD HDD Cloud
Time
Working set data
Inactive data
StorSimple Overview
Fundamental value of StorSimple
Applications in Physical or Virtual Servers
StorSimple
Customer Data Center
Enterprise SAN storage
Inline de-dupe, compression &
automatic tiering
Automated offsite data protection
using cloud snapshots
Highly efficient, location
independent disaster recovery
StorSimple connects Windows, Linux and Hyper-V/VMware servers to Azure Storage in minutes with no application modification
StorSimple 8000 Series
Series 8000 Hybrid Storage
Arrays
Microsoft Azure StorSimple Manager
Microsoft Azure Storsimple
Virtual Appliance
More capacity,
better performanc
e
Consolidated
Management of
multiple appliances
Additional use cases
with StorSimple
in Azure
Microsoft Azure StorSimple Big Picture
ON-PREMISES DATA CENTER
iSCSIInternet
connection
StorSimple Virtual Applianc
e
BLOB Data
BLOB Data
Administrator
CLOUD DATACENTER
Server
StorSimple Snapshot Manager Plug-in
Series 8000 Hybrid Storage
Array
StorSimple Manager
Series 8000 modelsModels
Model Number 8100 8600
Total usable capacity 15TB 40TB
Usable SSD Capacity 800GB 2TB
Effective Local Capacity 15-45TB 40-120TB
Max Volume Capacity 64TB 64TB
Max Capacity (including cloud)
200TB 500TB
Network Interface Cards
4 x 1Gbps and 2 x 10Gbps
Enclosure Form Factor 1 X 2U 2 X 2U
Fault tolerance of enterprise class storage
Software Feature
Protects Against?
How is works?
Controller failover
Protection against the failure of a controller.
The dual controllers are active/passive. In the event the active controller fails the passive controller automatically takes over. NVRAM mirrored across controllers via NTB.
Storage Spaces
Protection in the event of one or more drive failures.
Disk insert into and removal from pools.
Nondisruptive software upgrades (NDU)
Allows updates to be made to the operating system without taking downtime.
The software is downloaded and updated on each controller. One controller is up at all times to continue processing and serving data.
Redundant Power
Supplies
Dual Controllers
Network Interfaces
Networking Physical,
Virtual Servers
VLAN1
VLAN2
Switch 1 Switch 2
Switch 3
Internet/WAN connection
CONTROLLER 1
CONTROLLER 2
NICD3
NICD3
NICMGMT
NICMGMT
NICD1
NICD2
NICD1
NICD2
NIC NIC
WAN (Corporat
e)
8000 Series
iSCSI should be on the storage network and it is not recommended to route the iSCSI traffic
To access azure, the firewall should allow HTTPS port (443)
If external DNS server is used, ports for DNS should be open
If external SMTP server is used for notification, port 25 should be open
Local redundant and geo redundant storagePrimary Location
Secondary Location
Data protection for
data in the cloud
Asynchronous replication between
Azure data centers
Replicated data does not count against data limit for the account
Prevents against a partial or complete
data center failure
Makes 3 copies of data
across separate fault
domains
Failover to alternate location
determined by Azure
operations
Automatic tieringLow
Threshold
High Threshol
dTime
0
1
2
3
4
Oldest
DataData exceeds high watermark
Old data spills to next tier
Tier is empty in the beginning
New data is written at start of free space
Tier returns to low watermark level
DATA
DATA
DATA
DATA
DeduplicationSSD4MB
64KB ChunksDedupe Algorithm
0xaab123
0xccc123
0xabc123
0xaaa123
0xbbb123
0xccc123
0xaac123
0xbbc123
0xbcc123
0xabb123
Record of hash keys already generated0xaab12
3
0xccc123
0xabc123
HDD
Compression
HDD
0xaab123
0xccc123
Compress Data
Performed on data already deduplicated
Heuristics based compression to reduce CPU overhead when data is not compressible
Default algorithm is the standard DEFLATE (loss less compression)
Deduped Data
Encryption
0xabc12..
Data chunk before
encryption
Data chunk after
encryption
0xabc12..
Performed deduped and compressed data
Encryption key is generated based on the seed value provided
Encryption algorithm is AES-256 with CBC
Security keys maintained by the customer, stored securely on the appliance
Compress Data
Secure data throughout the solution
Account authentication with User ID, Password
On-premise Data Center
On-premise Data Center
2 x 512 bit keys
Account Access
Data Access
Data In-flight
Data At-restWindows Azure management
portal
IT administrator (customer)
StorSimple
CiS
AES-256 bit encryption
AES-256 bit encryption
Microsoft Azure StorSimple Manager
Consolidated management of appliances
Microsoft Confidential
StorSimple_PhysicalAppliance1 StorSimple_PhysicalApplia
nce2
StorSimple_VirtualAppliance1
Azure StorSimple ManagerStorSimple
Manager service in Azure
portal and manages one or
more StorSimple appliances
All device will need the Registration Key and Service Data Encryption Key to be added to the Service
(Service Data Encryption Key is generated, on device console, when first device is registered)
Adding an appliance to a StorSimple
Manager service
Microsoft Confidential
1. Login to Azure Management Portal
2. Create a StorSimple Manager Service
3. Generate a registration key for the created StorSimple Manager
4. Register device (from device console)
Will show up in Storage tab of Azure Portal
XXXXXXXXXXXXXXXXXXXXXXXXXXX
Storage accounts and volume containers
Microsoft Confidential
A Storage Account is applied to a Volume Container.
A Volume Container will have one or more volumes.
Creating a Volume Container on device requires:
1. A Volume Container Name
2. Selected Storage Account
3. Customer provided Cloud Storage Encryption Key
Isolating volume data with volume containers
Microsoft Confidential
Storage_Account1
File_Share_VC
SharePoint_VC
Vol1
Vol2
Vol3
Vol3
Vol4
Vol5
Cloud Encryption Key 1
Cloud Encryption Key 2
Volumes and data protection policies
Microsoft Azure StorSimple Virtual Appliance
IT agility in Azure with StorSimple Virtual Appliance
Failover Clone
The StorSimple Virtual Appliance facilitates data mobility of production datasets for the purpose of disaster recovery, on-demand development and test infrastructure, and Cloud applications.
The StorSimple Manager service provides workflows for failover of datasets for disaster recovery and clone workflows for replicating production datasets in Azure for Cloud applications and development and test scenarios
StorSimple Virtual Appliance
VM
Data
The Virtual Appliance is a software version of the physical array that runs on a VM in Azure and can be provisioned and turned-on as needed.
The StorSimple Virtual Appliance is an iSCSI target for the VMs in Azure.
A virtual network joins VMs and the StorSimple Virtual Appliance.
iSCSI Initiator
iSCSI Target
Creating virtual networks in Azure
Virtual networks are created in the Azure Management Portal and available to the StorSimple Virtual
Appliance when it is provisioned.
Data Protection and Disaster Recovery
Local and Cloud snapshots
SSD
SAS
Local Snapshot
Cloud Snapshot
Example Group Of Data Protection Policies
Backup Type
Snapshot Type
Frequency Retention Period
Short-term backup
Local & Cloud
Daily ~1 week
Medium-term
backup
Cloud Weekly ~4 weeks
Long-term Backup
Cloud Monthly ~52 weeks
Local snapshot
Point-in-time reference to volume data
Stored locally on
the appliance
Instantaneous and provide
short term data
recovery
Volume DataA B C D
Volume Metadata
Volume Data
Metadata
a b c d
Snapshot 1
E F
e f
A’
a
a’
Snapshot 2
G
g
C’ E’
e
c’ e’
Snapshot 3
F’C”
f’c"
fc'
cReference to data chunk
Cloud snapshot
Point-in-time copy of
volume data
Stored in the Cloud
Metadata is preserved in its entirety
Only changed
blocks are copied to
Cloud
SSD
SAS
StorSimple Snapshot Manager
MMC UI snap-in that lives on
application host and
communicates with
appliance(s)
Orchestrates application consistent snapshots
Manages backup policies
Restores volumes and mounts them
as NTFS folders/drives
Disaster recovery
Cloud Snapshot
Secondary Datacenter
or Provisioned StorSimple
Virtual Appliance
• Thin restores provides fast recovery of data, downloading a small subset of data necessary data bring applications online. Not dependent on volume size.
• Recover data anyway: a secondary datacenter or a StorSimple Virtual Appliance in Azure
• A volume container is failed over to the destination appliance. Time to recover is the same for physical and virtual appliance
What is
needed?
DR to secondary datacenter or Virtual Appliance
Filer ServerPhysical Appliance
(Appliance1)
Datacenter 1
File Server
Azure Storage
Virtual Appliance
(Appliance3)
Filer ServerPhysical Appliance
(Appliance2)
Datacenter 2
StorSimpleManager1
Appliance1
Appliance2
Appliance3
Recover data to Appliance2 (physical) or Appliance3 (virtual) by rehydrating data from a Cloud snapshot stored in
Azure BLOB storage.
Use Case and Workloads
Application and workload focus
* New with Microsoft Azure StorSimple 8000 Series
Cloud Apps
*
Virtual Machines SharePoi
ntFileshare
s
Archives SQL Server*
AzureWorkloads
On-premisesworkloads
DR* Dev/test*
File shares and archives
Before
Applications (Tier 2, & Tier
3 data)
FC/iSCSI
iSCSI
On-premise footprint
Capacity on-demand
Applications
Primary Storage
Disk-based Backup Storage
Tape Infrastructure
Archival Storage
After
SharePoint
Before
AfterSharePoint
Farm
FC/iSCSI
iSCSI
On-premise footprint
Capacity on-demand
SharePoint Farm
Primary Storage
Disk-based Backup Storage
Tape Infrastructure
Archival Storage
Offsite Facility
SharePoint metadata
BLOB data
SSA
SharePoint
metadata
(SQL)
BLOB data
Virtual machines and eliminating VM sprawl
Before
After
All Hyper-V/ VMware
VMs Primary Storage
Disk-based Backup Storage
Tape Infrastructure & Management
Archival Storage
FC/iSCSI
VMs using Tier 2/Tier 3
data
iSCSI
Active VM data (VHDs, VMDKs)
Inactive VM data
Storage migration/
vMotion
Active VM data (VHDs, VMDKs)
Free space
InactiveSpin up
On-premise footprint
Capacity on-demand
SQL for Tier-2 and Tier-3 applications
Before
Applications (Tier 2, & Tier
3 data)
FC/iSCSI
iSCSI
On-premise footprint
StorSimple Virtual Appliance and Cloud backup and DR
Applications
Primary Storage
Disk-based Backup Storage
Tape Infrastructure
Archival Storage
After
StorSimple with iCAS ascompliant Storage platform
Software vendor specialized in compliant archivingEstablished 2004Headquarter in Freiburg, GermanyInternational representations in Europe and USAOver 600 customers in various markets/verticalsCore product: iCAS (iTernity Compliant Archive Software)iCAS is patented in Europe since 2011 in Europe and since 2012 in the USA
Company Overview – iTernity
Challenge – Compliance for your dataRequirements based on various legal regulationsData must be tamper proofData cannot be deleted (WORM)Data must be kept for a specific period (retention)Data must be able to be migrated to future storage mediaAccess to archived objects must be possible at all times
Industry specific demandsGxP Data (Pharma), SEC17a4 (Banking), HIPAA, patient record (Healthcare),product liability (Automotive)
Internal demands for important dataProtection from data breach (deletion, destruction, theft)
How was archiving solved until today?Dedicated storage appliances for archivingEMC CenteraHitachi HCPNetApp SnapLockDell DX (discontinued)IBM DR550/Information Archive (discontinued)Optical Jukeboxes (Plasmon etc.) (discontinued)etc.
How to replace that solutions by usingStorSimple with iCAS?
Bond to vendor and technology (vendor lock)Migration to other platforms are complicated and cost intensiveRebuy of the whole archiving solution with the end of every hardware lifecycleProprietary and separated systems cause a lot effort for management and maintenanceExtension of additional archiving space can cause high costs
Disadvantages of HW based archives
Business oriented and IT oriented viewBusiness View
Data amount is growing rapidly
Legal and compliance requirements getting more important
Data has to be archived for long time periods
Budgets are limited
IT ViewNew applications generating new archiving content
The object size and count grows
Technologies are changing
High availability gets more important
Data migration gets critical
Management of separated systems gets complex
Cost efficiency gets more important
Protection for application data (ECM, ERP, Mail etc.)Retention Management and WORMSoftware defined Storage - for archivingCertified by KPMG and for special regulations like SEC17a4 (Banking)Certified by more than 80 ISVs (e.g. Agfa, GE, OpenText, Symantec EV etc.)Combined with StorSimple a perfect replacement for all dedicated archiving appliances
What is iCAS?
Microsoft & iCAS Archiving Layers
Business applications ERP, CRM, ECM, File Services, E-Mail, PACS, custom applications e.g. OpenText, AGFA, GE, Symantec EV, CommVault…
Business Process
Com
ple
te a
rch
ivin
g
solu
tion
iCAS & Microsoft
ISV
archive software
Microsoft StorSimple Appliance
Microsoft Azure Cloud
Archive - Protection (iCAS Software)
WORM Function / Retention Management /Self-Healing
WORM functionality with patented Content-Storage-Container Technology (CSC)Save data archiving via 512 bit Hash code (HMAC SHA 512)Based on industry standards (.NET, MS Windows, Web service)DoD- compliant data shredder High availability via cluster supportInterfaces to applications via CIFS/NFS-Share or Webservice API
iCAS Technology
Software defined Archiving – ContainersiCAS combines metadata like retention and hash-value with the archived objects into CSC-Containers.
The archive-objects can be migrated to future infrastructure without the loss of validity.
Minimization of company risksbetter protection for important data with high security industry standards
More flexibility to future IT InfrastructuresiCAS adapts to the future infrastructure
Higher AvailabilityArchive virtualizationBackend data migration without downtimes
Lower TCOMore efficient use of centralized storage infrastructureInvestment protectionCost efficient and calculable migrations
iCAS Benefits for Customers
From an industry perspectiveCustomers >200 employeesHospitalsCustomers in regulated markets (e.g. pharmaceutical industry, finance, energy, telecom…)Highly demands regarding product liability (e.g. automotive customers)Public customers
From an application perspectiveEvery customer with an SAP/ERP system needs an archiving platformEvery customer with an DMS/ECM system needs an archiving platform
Which are the customers for archive?
Integrated migration tool iCopyTotally compliant migration solution designed by KPMG and iTernityMigration per file shareBackground migrationRepositories simultaneously available via CIFS/NFSMigration time depends on speed of the old and new environmentApproach for replacement of optical jukeboxes, NetApp SnapLock etc.
Data Migration – File Share Applications
Applications
NetApp ClusteriCAS Cluster
migration
Migration via applicationsBackground MigrationMigration time depends on speed of old archiving solution and the applicationsSupport from iTernity to find migration partners if neededApproach for replacement of EMC Centera, Hitachi HCP, IBM DR550 etc.
Data Migration – API Applications
Applications
Centera ClusteriCAS Cluster
migratio
n
mig
rati
on
Dedicated Microsoft Server 2008 R2 64Bit or Microsoft Server 2012 (R2)Installed Windows Updates and Service Packs.NET Framework 4.5.1Internet Information ServerHardware minimum requirements:
current Quad Core CPU4GB Memory 40GB free space
Hardware requirements depending on archive size, number and size of objects etc. ask iTernity for individual recommendations
iCAS Preconditions
High regulations for archiving of patient records, radiographs etc.High cost pressure and limited budgetsMostly existing archiving platforms like EMC Centera or NetApp SnapLock to replaceCommon healthcare applications are certified for iCAS:
AgfaGESectraVisus
Practical Example – Healthcare Customer
Initial Situation:
Existing archiving data 50 TBAnnual data growth of 20% up to 30 %Different applications who have to be archived centralized: ECM, PACS, RIS, KISCurrent archiving solution: NetApp SnapLockHardware is end of lifeSnapLock licenses have to be bought new with the new hardwareVirtual Infrastructure based on a common hypervisor (Hyper-V, VMWare, Citrix)High potential for savings with alternative archiving solution based on StorSimple and existing virtualizing (no upfront payment for new infrastructure)
Practical Example – Healthcare Customer
read/write
ApplikationsebeneECM, DMS,PACS, Mail …
Practical Example – Healthcare Customer
Storage Layer
Archiving Layer
Application Layer
Microsoft Azure
StorSimple
Solution with iCAS and StorSimpleMigration from NetApp Snaplock to StorSimple with iTernity Migration-Tool „iCopy“iCAS installed on existing hypervisor (Hyper-V, VMWare, Citrix)iCAS CSC-Containers are written to StorSimple ApplianceStorSimple is responsible for „Tiering“ of data between appliance onsite and MS AzureTransparent access for the applications to the data via iCAS
Advantages for the customerDirect and easy migration without external help (ISVs)No upfront investment in new archive infrastructure monthly billing by Microsoft based on TBsHigh availability and security of data with StorSimple and MS Azure
Practical Example – Healthcare Customer
Breakout SessionsCDP-B351 StorSimple 8000 Series: Customer Case Study
Labs
Microsoft Solutions Experience Location (MSE)TechExpo Happy Hour: Thursday October 30th, 16:00-17:00 in Hall 7
Ask the Experts: Thursday October 30th, 18:30-20:00 in Hall 5
Find Us Later…E-mail: [email protected] E-Mail: [email protected]
Related content
Come visit us in the Microsoft Solutions Experience (MSE)!Look for the Cloud and Datacenter Platform area TechExpo Hall 7
For more informationWindows Server Technical Previewhttp://technet.microsoft.com/library/dn765472.aspx
Windows Server
Microsoft Azure
Microsoft Azurehttp://azure.microsoft.com/en-us/
System Center
System Center Technical Previewhttp://technet.microsoft.com/en-us/library/hh546785.aspx
Azure Pack Azure Packhttp://www.microsoft.com/en-us/server-cloud/products/windows-azure-pack
Resources
Learning
Microsoft Certification & Training Resources
www.microsoft.com/learning
Developer Network
http://developer.microsoft.com
TechNet
Resources for IT Professionals
http://microsoft.com/technet
Sessions on Demand
http://channel9.msdn.com/Events/TechEd
Thomas KaessheimerPartner Manager
iTernity GmbHBötzingerstr.6079111 Freiburg im Breisgau
Tel: +49 761 59034 810Mobile: +49 173 1920 624E-Mail: [email protected]
iTernity Contact
Azure
Implementing Microsoft Azure Infrastructure Solutions
Classroomtraining
Exams
+
(Coming soon)Microsoft Azure Fundamentals
Developing Microsoft Azure Solutions
MOC
10979
Implementing Microsoft Azure Infrastructure Solutions
Onlinetraining
(Coming soon)Architecting Microsoft Azure Solutions
(Coming soon)Architecting Microsoft Azure Solutions
Developing Microsoft Azure Solutions
(Coming soon)Microsoft Azure Fundamentals
http://bit.ly/Azure-Cert
http://bit.ly/Azure-MVA
http://bit.ly/Azure-Train
Get certified for 1/2 the price at TechEd Europe 2014!http://bit.ly/TechEd-CertDeal
2 5 5MOC
20532
MOC
20533
EXAM
532EXAM
533EXAM
534
MVA MVA
Please Complete An Evaluation FormYour input is important!TechEd Schedule Builder CommNet station or PC
TechEd Mobile appPhone or Tablet
QR code
Evaluate this session
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.