Upload
lamhanh
View
219
Download
0
Embed Size (px)
Citation preview
Netapp @
10th TF-Storage Meeting
Wojciech Janusz, Netapp Poland Bogusz Błaszkiewicz, Netapp Poland
Ljubljana, 2012.02.20
Agenda
Data Ontap Cluster-Mode
pNFS
E-Series
2 NetApp Confidential - Internal Use Only
FAS Market Share Trend – Revenue
NetApp Confidential – Limited Use
NetApp 13.8%
EMC 29.4%
Dell 8.8%
IBM 12.1% HP 10.7%
FAS equals the combined NAS and SAN markets
Source: IDC, Dec 2010
432TB 144 Drives
408TB 136 Drives
4,320TB 1,440 Drives
6TB Flash Cache
4,320TB 1,440 Drives
8TB Flash Cache
1,800TB 600 Drives
1TB Flash Cache
3,600TB 1,200 Drives
3TB Flash Cache 2,880TB 960 Drives
2TB Flash Cache 720TB
240 Drives 512GB
Flash Cache
New Entry Systems Added to Line
Truly unified Most efficient Extremely flexible
4
FAS/V3210
FAS2040
FAS/V6240
FAS/V6280
FAS/V3240
FAS/V6210
FAS/V3270
FAS2240
Unified Storage Architecture
5
Ontap 8.1
Cluster-mode
NAS and SAN Familiar Ethernet and
FC infrastructures No special client or host code
FAS/V62x0, FAS60x0, FAS/V32x0, FAS31x0 FAS3070, FAS3040,
FAS2040*
SATA, SAS, FC, and SSD storage
Third-party arrays with V-Series
Flash Cache
Data ONTAP 8.1 Cluster-Mode System
NetApp Confidential – Limited Use
Multiprotocol Access (NFS/CIFS/FC/iSCSI/FCoE)
Virtualized Storage and Network
Data ONTAP® 8.1 Cluster-Mode System
FC SAS SATA SSD
Third-Party Arrays with V-Series NetApp® Storage
FC or SATA SAS
Namespace is unchanged as volumes move
No client code
Easy to manage
Easy to change
Seamlessly scales to many petabytes
Access using a single NFS mount or CIFS share
B A2
A3 A1
B1 B2
A
R C A4
Single NFS mount/CIFS share
Data ONTAP 8 Cluster-Mode Global Namespace
NetApp Confidential – Limited Use
A B
A1 A2 A3
B1 B2
R
C
A4
VS1
Data ONTAP 8.1 Cluster-Mode Virtual Server
NetApp Confidential – Limited Use
Logical, flexible, secure resource pool for a NAS namespace and LUNs
All data access is through a Vserver, which supports one or more protocols
Includes FlexVol® volumes, LUNs, and logical network interfaces (LIFs)
Minimum of one Vserver required: can support 100s
SAN hosts/NAS clients
Integrated Shared Architecture
Logical Interfaces
FlexVol volumes Vserver
LIF2 LIF1 HA
VS2
Data ONTAP 8.1 Cluster-Mode Multi-Tenancy
NetApp Confidential – Limited Use
SAN hosts/NAS clients
HA
LIF2 LIF3 LIF4 LIF2 LIF1 LIF1
Workload Isolation
VS1
Vservers enable multiple storage domains sharing a common resource pool
Maintain logical separation – A Vserver defines a domain for
volumes, LIFs, and access protocols
Secure, delegated administration
100s of Vservers supported
HA
HA
Data ONTAP 8.1 Cluster-Mode Cluster Expansion
NetApp Confidential – Limited Use
SAN hosts/NAS clients
Transparent Operational Flexibility
LIF2 LIF1 LIF3 LIF4
VS1
Nondisruptively grow and redistribute resources
Vserver adjusts as the cluster is seamlessly expanded
Mix and match controllers
Mix and match drive types − SATA, SAS, FC, SSD
Third-party arrays with V-Series
Hosts 1000s of volumes
PB-sized namespace
HA
Cluster-Mode Transparent Volume Move
NetApp Confidential – Limited Use
B
C A2
A3 C1 A1
B1 B2
A
R
C2
LUN
LUN LUN
A B C
A1 A2
A3 B1 B2
C1
R
LUN LUN
Uninterrupted Access Continuous data access by
clients and hosts
Uses Snapshot™ technology to copy data to a new aggregate
in the background
Nondisruptively move volumes between ANY aggregates anywhere in the cluster
Storage space savings, mirror relationships, and
Snapshot copies are unchanged
NFS / CIFS / iSCSI /FC / FCoE
HA HA
Cluster-Mode: On-Demand Flexibility
NetApp Confidential – Limited Use
The Results Seamlessly add capacity Rebalance resources Rapidly deploy new system
The Challenges “Disk full” errors Over-provisioning in anticipation of future
capacity needs Managing access to new storage
The Benefits Nondisruptive volume movement is
transparent to clients and hosts Namespace and LUN mapping unchanged Shared storage infrastructure
A1
C1 LUN
LUN
B2
A B
A1
A3
R C LUN
B1 C1 LUN
LUN
A A2
Cluster-Mode: Operational Efficiency
NetApp Confidential – Limited Use
The Results Virtualized tiered services
Integrated unified system
Match business priorities
The Challenges Changing workload demands Critical projects need appropriate resources
The Benefits Nondisruptive volume movement is
transparent to clients and hosts Mix controllers and disk types in the same
cluster On-demand mobility for critical projects Adapt resources to meet business demand
Higher Performance Storage
Lower Cost Storage
C1 LUN
LUN
B2
A B A1
A3
R C LUN
A2 B1
Cluster-Mode: Operational Lifecycle
NetApp Confidential – Limited Use
The Results ZERO downtime ZERO processing interruptions ZERO client changes
The Challenges Upgrade an entire storage system 24x7 operation during move
The Execution Identify affected volumes and LUNs Nondisruptively move volumes Perform technology refresh Power up node and rejoin cluster Move volumes back to new node Repeat
B2
A B
A1 A3
R C LUN
A2
B1 C1 LUN
LUN
“Always-On” Infrastructure
Cluster-Mode Networking Overview
NetApp Confidential – Limited Use
SAN / NAS
Mgmt
Cluster Interconnect 10GbE
HA HA
Data ONTAP® Cluster-Mode
16
pNFS
Massively Scalable NAS Platform One Namespace or Many, Classes of Service
Heterogeneous cluster – Mix of controller types in single
cluster per workload needs
– Entry, midrange, and high-end platforms
– Native and third-party storage (FAS, V-Series)
– Multiprotocol
Tiered storage – Match data to disk price/
performance
– Manage multiple tiers in the same namespace or many
– Examples
Reference data
DR mirror destination
Scalable archives
17
B C A2
A3 C1
C2
Projects
A B C
A1 A2 A3 B1 B2 C1 C2 C3
A1 B1
High-Speed Storage (Highest Performance Across All Workloads)
High-Capacity Storage (Lower $/GB)
B2 C3
Personality Semantics
Authentication Identification Permissions
Transport Caching
Data Locality
Stateful
Supports UNIX & WINDOWS
Strong (Kerberos)
Stringbased ([email protected])
WINDOWS like access
TCP Only
File Delegations
Referrals
NFSv4
Stateless
UNIX Only
Weak(AUTH_SYS)
32 bit UID/GID
UNIX based
UDP & TCP
Ad-hoc
No Remote Access
NFSv3
Stateful
Supports UNIX & WINDOWS
Strong (Kerberos)
Stringbased ([email protected])
More WINDOWS friendly
TCP Only
Files & Directory Delegations*
Referrals
NFSv4.1
Comparison of NFSv3, NFSv4 and NFSv4.1
18 NetApp Confidential - Limited Use
NFSv4.1 • Is a minor release
of NFSv4 • Does not modify any NFSv4
features • Is only in DOT8.1 c-mode • Bug fixes • Supports pNFS • Supports sessions
and trunking
8
pNFS
pNFS Protocol − Minor version of NFSv4.1 − Transparent to applications Storage Access Protocol − files (NFSv4.1) − blocks (FC, iSCSI, FCoE) − objects (OSD2) Control Protocol − Outside of the
pNFS standard
User Applications
NFSv4.1
Generic pNFS layout
File layout
OSD layout
Block layout
SUN RPC iSCS
I
SCSI
TCP FCP RDMA
pNFS Protocol
Control Protocol
Metadata Server Data Servers
Client
Storage Access Protocol
NetApp Confidential - Limited Use
Regular NFS Vs. pNFS
pNFS with Data Ontap 8.1
9
Meta-data, Control, Data use the same path
NFS
Single Stack NFS, Meta-Data, Data , Locks
NFS Client Meta-Data Path Data Path
N-Blade NFS pNFS
Control Path
N-Blade NFS pNFS
D-Blade Meta-Data, Data Locks
D-Blade Meta-Data, Data Locks
pNFS Client
pNFS Client
pNFS Client
NetApp Confidential - Limited Use
NFSv4.1 Sessions RHEL 6.0/ RHEL 6.1 SLES 11 SP1 (Untested)
Important fixes missing pNFS Files
RHEL 6.2 (File support Only) – kernel 2.6.40 SLES 11 SP 2* (Files & objects)
pNFS Files and Objects Fedora 16 (Linux-3.0)
* Internal testing of RHEL Early Access bits under way
Client NFSv4.1 and pNFS in Linux Distributions
21
NetApp Sets Record NFS Performance
NetApp® delivers better performance and efficiency than Isilon 35% more IOPS 40% faster response time 50% less disks 80% fewer controller nodes
22
Leading Performance
FAS6240 24-node cluster with Data ONTAP® 8.1 SPECsfs2008 NFS benchmark
For more information, visit http://www.spec.org/sfs2008/results/. SPEC® and SPECsfs2008® are trademarks of the Standard Performance Evaluation Corp.
23
E-Series
Big Data Market Requirements
24 NetApp Confidential - Internal Use Only
Distributed compute farms with standard software
Simpler systems, faster to deploy
Optimized balance between compute & storage
Reliable data (metadata)
Very high streaming bandwidth
Dense configurations - GB/s/Rack Unit
Large data sets (containers)
Simpler system configurations
Boundaryless containers (10’s PBs) Simple access to dynamic
datasets New access
technology(CDMI) with legacy application interfaces
Highly efficient, self-managing systems
E-Series Controllers
25 NetApp Confidential – Limited Use
5400 2600 Host/SAN connectivity • (4) 40Gb IB • (8) 8Gb FC • (16) 8Gb FC
Host/SAN connectivity • (8) 6Gb SAS • (8) 8Gb FC and (4) SAS • (8) 1Gb iSCSI and (4) SAS • (4) 10Gb iSCSI and (4) SAS
Drive channels / types / max • (2) 6Gb SAS ports • SSD/SAS/SED/NL-SAS • Up to 384 drives
Drive channels / types / max • (2) 6Gb SAS ports • SSD/SAS/SED/NL-SAS • Up to 192 drives
Enclosures • (60) drive DE6600 • (24) drive DE5600 • (12) drive DE1600
Enclosures • (60) drive DE6600 • (24) drive DE5600 • (12) drive DE1600
Cache • 12 / 24 / 48 GB
Cache • 2 / 4 GB
Performance • 6,000 MB/s – disk reads • 3,100 MB/s – CME disk writes • 900,000 IOPS – cache reads • 350,000 IOPS – SSD reads • 150,000 IOPS – disk reads
Performance • 4,000 MB/s – disk reads • 1,200 MB/s – CME disk writes • 200,000 IOPS – cache reads • 84,000 IOPS – SSD reads • 65,000 IOPS – disk reads
Dual-controller systems
E-series disk shelves
DE5600 2U / 24 / 2.5”
– SAS, SAS SSD drives
DE1600 – 2U / 12 / 3.5”
– SAS, SAS SSD
DE6600 – 4U / 60 / 3.5”
– FC, SAS, SATA, SAS SSD
NetApp Confidential - Internal Use Only
5400 + DE6600 5400 + DE5600 2600 + DE1600 5460 2612 5424
Any controller to ANY enclosure
Insert 2 E-Series Controller(s) into enclosure to create 1 storage system (RBOD)
Creating Storage Systems
27 NetApp Confidential – Limited Use
E Series Power
• 1.8PB in 1 rack
• High density 4U /60 • up to 60GB/s reads • 400,000 IOPs from disks
NetApp Confidential - Internal Use Only
HaDoop
29 NetApp Confidential - Internal Use Only
StorageGRID® E-Series Building Blocks
30 NetApp Confidential - Internal Use Only
E2600/5400 + DE6600 120/180TB Array
E2600 + DE1660 24TB Arrays
2 x Control Nodes 2 x Storage Nodes
2 x Gateway Nodes 2 x Storage Nodes
StorageGRID Software on Generic x86 Servers
FC attached, 1 adapter per SN
NetApp and StorNext
Designed for NetApp E-Series storage
– High performance
– High capacity
– Highly reliable foundation
StorNext File System – Heterogeneous data sharing across Fibre Channel
SAN clients Mac, Win, Linux, UNIX
– Simultaneously serve LAN clients with StorNext LAN Gateway & LAN clients
StorNext Storage Manager (Optional)
– Intelligent archiving
– Data always stored on most cost-effective storage tier
31
NetApp Full Motion Video Solution
StorNext Metadata Controller
StorNext SAN Clients
StorNext LAN Clients
LAN
NetApp E5460 Stack
SAN
FC
FC
Long-term Archive
NetApp Auto Support
32 NetApp Confidential - Limited Use
Correlate disk latency (hot) with disk type – 24 billion records – 4 weeks to run query – After Hadoop implementation -> 10.5 hours
Bug detection through pattern matching – 240 billion records – Too large to run – After Hadoop implementation = 18 hours
Phone home data representing information about the status NetApp storage controllers
33 NetApp Confidential - Internal Use Only