Upload
puneet-mehta
View
214
Download
0
Embed Size (px)
Citation preview
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
1/42
Copyright 2012 EMC Corporation. All rights reserved.
EMC Isilon OneF
Proven Professional W
Brian CoxNick Trimbee
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
2/42
Copyright 2012 EMC Corporation. All rights reserved.
OneFS 7.0: Wha
Summar
Why OneFS
Isilon & OneFS
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
3/42
Copyright 2012 EMC Corporation. All rights reserved.
0
10
20
30
40
50
60
70
80
90
2009 2010 2011 2012 2013 2
Exabytes
The Big Data Challenge
In 2013, 80% of all storage capacity sold will be for file-Source: Scale Out Storage in the Content Driven Enterprise: Unleashing the Value of InformationAssets, IDC White Paper (2010 Enterprise Disk Storage Consumption Model), Jun
File based: 61.8% CAGR Block based: 23.7% CAGR
Media &Entertainment
Design &Simulation
FinancialServices
Bioinformatics File Shares &
Archives
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
4/42
Copyright 2012 EMC Corporation. All rights reserved.
Data intensive, HPC workflows
Big Data Apps Need Big Data Stor
Medical Imaging Gene Sequencing Seismic Exp
Media & Entertainment Product DeveSatellite Images
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
5/42
Copyright 2012 EMC Corporation. All rights reserved.
Typical enterprise IT workloads
Enterprise IT Needs Big Storage
LARGE-SCALE HOME DIRECTORIES LARGE-SCALE ARCHIVES
LARGE-SCALE VIRTUALIZATION LARGE-SCALE ANALYTICS
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
6/42 Copyright 2012 EMC Corporation. All rights reserved.
EMC IsilonSetting the standard for scale-out NAS
Broad adoption across many markets
High Performance Computing (HPC): Life Sciences, Oil & Gas, E
Design Automation, Media & Entertainment, Financial Services
Enterprise IT: Archive, Home Directories, File Shares, Virtualizatio
Business Analytics
Over 3,000 global customers
Over 50% Y/Y growth rate
EMC #1 NAS market*
Isilon OneFS: Seventh generation, industry-proven, innov
scale-out operating environment
*Source: Market Share Analysis: Network-Attached Storage/Unified Storage, Worldwide, 2011, Gartner, March 2012
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
7/42 Copyright 2012 EMC Corporation. All rights reserved.
Isilon Scale-Out NAS Architecture
OneFS OperatingEnvironment
IComm
Servers
Client/Application Layer Ethernet Layer
Servers
Servers SingleFS/VolumeSMBNFS
FTPHTTP
HDFS
iSCSI
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
8/42 Copyright 2012 EMC Corporation. All rights reserved.
Isilon Core InnovationOneFS scale-out operating system
Single File SystemSimplicity
Leadership Efficiency
High Performance
Easy Growth
Automat
Linear S
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
9/42 Copyright 2012 EMC Corporation. All rights reserved.
Isilon HardwareScale-out NAS product family
Linear Scaling of Performance and
Purpose-built for IOPS-intensive, random access,
file-based applications
Flexible solution for highconcurrent and sequentialthroughput applications
Ideal for coslarge-capaci
S-Series
X-Series
NL-Se
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
10/42 Copyright 2012 EMC Corporation. All rights reserved.
More scalable than traditional storage systems
Largest and Most Scalable File Sys
OneFS scales from 18 TB to more than 15 PB in a ssystem, single volume
Scales from 3 node cluster
to 144 nodes
Add additional capacity
in under 60 secondswith no downtime
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
11/42 Copyright 2012 EMC Corporation. All rights reserved.
Isilon AutoBalanceGain New Levels of Efficiency
AutoBalance automatically movto new storage nodes while sysonline and in production
Eliminates hot spots
Enables unmatched storage caputilization of more than 80%
AutoBalanceAutomated data balancing across nodescosts, complexity, and risks for scaling
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
FULL
FULL
FULL
FULL
BALANCED
BALANCED
BALANCED
BALANCED
BALANCED
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
12/42 Copyright 2012 EMC Corporation. All rights reserved.
Isilon SmartPools
Optimize Resources with Automated Ti
Single point of management Single file system/single volume
Multiple performance tiers
Automatic data movement
Policy-based tiering management
Transparent reallocation
Optimize storage resources
Automatically match storageresources with data requirements
Eliminate data migration
S-SeriPerform
NL-SeActive
X-SerCollabo
Reduced
cost
/TB
Files
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
13/42 Copyright 2012 EMC Corporation. All rights reserved.
SPECsfs2008 CIFS: aggregate vendor performance
Worlds Fastest NAS
ISILORECORD-BREAP E R F O R M A
Huawei
Symantec
EMC
EMC
EMC
NetApp
NetApp
NetApp
NetApp
Apple
Silicon
Graphics
Apple
Fujitsu
Apple
Fujitsu
Siemens
Fujitsu
Fujitsu
Siemens
Fujitsu
Siemens
Fujitsu
Siemens
NSPLab
Fujitsu
1,600,000
1,500,000
1,400,000
1,300,000
1,200,000
1,100,000
1,000,000
900,000
800,000
700,000
600,000
500,000
400,000
200,000300,000
100,000
EMCIsilon
CIFSIO
PS World Record
1.6 million CIFS OPS
126% increaseover competition
Source: All SPEC SPECsfs2008_cifs Results Published by SPEC, October 3, 2012 (http://www.spec.org/sfs2008/results/sfs2008cifs.h
http://www.spec.org/sfs2008/results/sfs2008cifs.htmlhttp://www.spec.org/sfs2008/results/sfs2008cifs.html8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
14/42 Copyright 2012 EMC Corporation. All rights reserved.
SPECsfs2008 performance test results
Linear, Predictable Scalability
Predictable SLAs
7 14 28 56
1,800,000
1,600,000
1,400,000
1,200,000
1,000,000
800,000
600,000
400,000
200,000
FileOps/second
CIFS NFS
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
15/42 Copyright 2012 EMC Corporation. All rights reserved.
With N+2, N+3, andN+4 protection,data is 100% availableif multiple drives ornodes fail
With N+1 protection,data is 100% availableeven if a single driveor node fails
Highly resilient, clustered architecture
Unmatched Data Protection and Ava
100%
100%
100%
100%
100%
100%
100%
100%
FAILED
FAILED
And with Isilon, themore nodes in thecluster, the fasterdrive rebuild time
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
16/42
Copyright 2012 EMC Corporation. All rights reserved.
Single storage pool for application consolidation
Isilon Scale-Out Innovation
Simple to scale Manage 10s of PBs like a 1 TB drive
Predictable performance Grows linearly
Efficient to operate Maximize utilization to 80%+
Automate tiering
Highly resilient Survives multiple failures
Enterprise proven Management and protection
tools that customers expect
No data migrations
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
17/42
Copyright 2012 EMC Corporation. All rights reserved.
OneFS 7.0: Wha
Summar
Why OneFS
Isilon & OneFS
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
18/42
Copyright 2012 EMC Corporation. All rights reserved.
OPERATIONALSIMPLICITY
RAPIDGROWTH
MASCAPA
EXTRPERFOR
Big Data Storage World
BIGDATA
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
19/42
Copyright 2012 EMC Corporation. All rights reserved.
PREDICTABLEPERFORMANCE
INTEROPERABILITY DATA PR
SECU
Enterprise IT Storage World
EnterpriseIT
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
20/42
Copyright 2012 EMC Corporation. All rights reserved.
Two Storage Worlds Converge
Enterpr
IT
BIG
DATA
EnterpriseSCALE-OUT
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
21/42
Copyright 2012 EMC Corporation. All rights reserved.
Delivering the Best of Big Data & Enterprise IT Storage
Introducing OneFS 7.0 OS
Massive Capacity
Extreme Performance
Dat
Predictable P
InteOperational Simplicity
Rapid GrowthEnterprise
SCALE-OUT
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
22/42
Copyright 2012 EMC Corporation. All rights reserved.
OneFS 7.0: Wha
Summar
Why OneFS
Isilon & OneFS
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
23/42
Copyright 2012 EMC Corporation. All rights reserved.
Robust Enterprise Security Option
Secure Role Separatio
Roles-based administrat Administration and data
separated
Secure Isolation
Authentication Zones
Secure WORM Data P Isilon SmartLock
SEC 17a-4 Compliance o
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
24/42
Copyright 2012 EMC Corporation. All rights reserved.
Also called Access Zones
Authentication Zones
Associate the cluster withmultiple authenticationprovider groups
Access Zones enable you to:
Separate authenticationproviders into groups
Limit data access based onaccess zone
Perform storage consolidationwith overlapping directorystructures
LDAP-1
Active Directory-2LDAP-3 NIS
NIS
Group Database
Finance
Legal
LDAP-2
Active Directory-1
Group Database
SmartConnZone-1
SmartConnecZone-2
IT
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
25/42
Copyright 2012 EMC Corporation. All rights reserved.
Multiple Authentication Sources
Authentication Zones
Internal Company FilerConsolidation
Multiple departments or divisions
Multiple authentication sources
Overlapping home directorystructures
Departmental Isolation Secure departmental data isolation
Multiple authentication sources
MultipleZones
Financ
Executive
SalesEn
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
26/42
Copyright 2012 EMC Corporation. All rights reserved.
Roles Based Administration
Define individual roles with right privileges
Each Role is associated with A list of users/groups
A list of actions/privileges that the role
is allowed
User can be part of many different roles:
A union of all privileges defined forthose roles is allowed for that user
Ability to define custom roles
RB
(Sn
(S
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
27/42
Copyright 2012 EMC Corporation. All rights reserved.
WORM Archive Protection
OneFS SmartLock
SmartLock provides cost-effective, efficientprotection against accidental, premature ormalicious data deletion or modification
SmartLock now has two operational modes
Enterprise Mode
Compliance Mode (meets SEC 17a-4)
Mix WORM and Non-WORM data
Integrate with OneFS:
Located on any storage tier
Integrated with Isilon SyncIQ
S-SeriesPerformance
X-SeriesThroughput
NL-Series
Archive
SmaD
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
28/42
Copyright 2012 EMC Corporation. All rights reserved.
New SnapshotRestore
Fast
Efficient
Simple
Lower Risk & Increased Availability for Critical Data
Scale-Out NAS Data Protection
ACC
D
VI
EMC Confidential
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
29/42
Copyright 2012 EMC Corporation. All rights reserved.
Lowers Risk For Business Critical Data
Scale-Out NAS Data Protection
NewFast and Simple
Failover/FailbackSIMPLE
f
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
30/42
Copyright 2012 EMC Corporation. All rights reserved.
Interoperability for Operational Flexib
Platform REST API
Simplify management and inte Third-party application integra
VMware integration
VAAI: vStorage APIs for array
VASA: vSphere APIs for storag
Virtual Server writeable clones
Multi-protocol support
Integrated support for industryprotocols
Native HDFS support
CIFSNFS
FTPHTTP
HDFSfor
Hadoop
VAAI VASA
OneFS API
l f
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
31/42
Copyright 2012 EMC Corporation. All rights reserved.
API Architecture
Platform API
RBAC
LIBISI_PAPI
APACHE
PAPI_D
GConfig
JSON
Snapshot scheduling via REST URI:
http://cluster:9443/1/snapshot/schedules/id_1
Platform API
Full RESTfu
AutomatedManagem
Includes estatistics aaccess
Programmfor WebUI
RBAC Integ
VM I i Fil Cl
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
32/42
Copyright 2012 EMC Corporation. All rights reserved.
VMware Integration - File Clones
Clones are logical copies which share blocks with original file
Clones are fast to create and consume less space
Either original file or clone can be further cloned at any point
B
102
A
101
C
103
D
104
VMDK_1FILE_1FILE_1CLONE
C1
115
B2
110
A1
121
VM API I t ti
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
33/42
Copyright 2012 EMC Corporation. All rights reserved.
VMwareAPI Integration
VMware vSphere provides APIsand SDK to allow customers to
enhance and extend thefunctionality of vSphere
For storage, the following APIsare provided: VAAIVMware vSphere APIs for Array
Integration which enables offloading ofcommon specific tasks to storage
systems
VASAVMware APIs for StorageAwareness enables storage systems tocommunicate the storage systemsavailable features and functionality tovSphere
vSphere 5.0
VAAI Block Block Zeroing Block Copying Atomic Test and Swap Thin provision stuns
VAAI NAS
Full Copy Extended Stats Space reservation
NodeType
SATA
SATA
SAS
SAS
Mixed
Mixed
VASA
Integrat Insight
capabilit
S l O t NAS P f
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
34/42
Copyright 2012 EMC Corporation. All rights reserved.
Increase Productivity & Unlock New Opportunities
Scale-Out NAS Performance
50% Le
724MB/sSingle Stream
1.6Worlds
106GB/s Concurrent
Big DataPerformanceThroughput
EnterPerfoRandom/
O FS 7 0 M lti th d d IO
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
35/42
Copyright 2012 EMC Corporation. All rights reserved.
OneFS 7.0: Multi-threaded IO
Dramatic increase in concurrent random write
performance to large files. Byte-range write locking
Improves latency.
Boosts performance for:
VMDK files
HPC Checkpoint Files
Multiple threads concurrently writing to a single
S tP l A t ti P i i i
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
36/42
Copyright 2012 EMC Corporation. All rights reserved.
SmartPools Automatic Provisioning
Automated cluster protection
+2:1 FEC across Storage Pools
Improved disk utilization by upto 30%
Consistent MTTDL across all
clusters: Capacity
Node type
Utilization
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
37/42
Copyright 2012 EMC Corporation. All rights reserved.
OneFS 7.0: Wha
Summar
Why OneFS
Isilon & OneFS
Isilon Scale Out NAS Value
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
38/42
Copyright 2012 EMC Corporation. All rights reserved.
Isilon Scale-Out NAS Value
Scales to over 15 PB in a single file system
Single file system, single volume, global namespace
Efficient backup and recovery, reliable disaster recovery, and N+1 thru N
More than 80% storage utilization, and automated storage tiering
Over 100 GB/s throughput, 1.6M SPECsfs ops
Integrated support for industry-standard protocols including NFS, SMB, HHDFS; platform REST API; VMware integration
Roles-based administration; Authentication Zones; SEC 17a-4 compliant
Questions and Answers
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
39/42
Copyright 2012 EMC Corporation. All rights reserved.
Q
To typ e a quest ion via WebEx, cl ick on th e Q&A t
Please select Ask: All Panelists
to ensure your quest ions reach us. Thank you !
R / N t St
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
40/42
Co ri ht 2011 EMC Cor oration. All ri hts reserved.
Resources / Next Steps Visit our website:
http://www.emc.com/storage/isilon/isilon.htm
Analyst Video ESG: How EMC Isilon OneFS 7.0 Addresses Big Data in the Enterprise
Data Sheets EMC Isilon OneFS Operating System
EMC Isilon Scale-Out Platform Overview
EMC Isilon SmartLock
EMC Isilon SyncIQ
White Papers EMC Isilon OneFS A Technical Overview
High Availability & Data Protection with EMC Isilon Scale-Out NA
http://www.emc.com/storage/isilon/isilon.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdfhttp://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdfhttp://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon.htmhttp://www.emc.com/storage/isilon/isilon.htm8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
41/42
Co ri ht 2011 EMC Cor oration. All ri hts reserved.
THANK YOU!
8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0
42/42