Upload
sammy
View
176
Download
0
Embed Size (px)
DESCRIPTION
Dell 高性能存储解决方案. 詹健 高级存储产品经理 戴尔(中国)有限公司. Bigger, Better, Faster 更大,更强,更快!. HPC: Bigger, Better, Faster HPC is all about High Performance Solving Bigger problems Better answers to problems Solving problems Faster - PowerPoint PPT Presentation
Citation preview
Dell 高性能存储解决方案詹健
高级存储产品经理戴尔(中国)有限公司
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Bigger, Better, Faster更大,更强,更快!
• HPC: Bigger, Better, Faster– HPC is all about High Performance
› Solving Bigger problems› Better answers to problems› Solving problems Faster
– The TeraFLOPS barrier was broken in June 1997 (1 trillion operations per second)
– The PetaFLOPS barrier is now being routinely broken (1000x)
• HPC Data Explosion– This means more data (capacity)– This means more IO performance (throughput)– New technology is going to accelerate data growth by an average of 2-4
times
• Result – more storage capacity is needed and more storage performance is needed
2
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
灵活性 , 适应性 , 选择性
• The performance importance of data changes over the life of the data– At first, performance is very important
– After a period of time, the performance is less important
• Why keep data on high-performance storage that isn’t being used?
• Based on applications and performance importance there are three basic categories of data requirements:1.Fast Scratch
• Performance, performance, performance
2.Primary (/home)• Reliability
3.Long-term• Capacity (very little performance)
3
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
快速
归档用户
4
High performance and scalability
Reliability and good
performance
High capacity and cost effective
HPCStorage
Dell NSS
Dell HSS
Dell TSS
Cluster working space
User DataHome directories
Applications
HSM, Data retentionretention Archive, backup
Dell 对高性能计算存储解决方案的观点
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell 集成高性能计算存储解决方案根据规模和工作负载来定位
5
Workstation
Workgroup
Department
SuperComputer
用户 :Dell NSS
Conceptual, not to scale ~1-2 GB/s
Division
用户 :Dell NSS
Throughput
Data Archiving, HSM: TSS
Primary Storage: Dell HPC NFS Storage solution (NSS)
for local data, home directories
Scratch Space: (DT-HSS)High speed cluster working space
for application data
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
• Dell is delivering solutions using two approaches:1. Complete solutions - Fully vetted, tested, supported
› Come with end-to-end support from Dell and partners
› Detailed documentation including best practices, performance and sizing guidance
› Deployment services
2. Roll-Your-Own› Dell creates technical whitepapers containing:
– Recommended configurations
– Configuration best practices and sizing guidance
› Customer buys hardware and uses whitepapers as a reference
› Full Dell warranty and support on Dell components
– Limited or no deployment services; no solution type services
• Overtime, deliver building blocks that will integrate into the larger HPC storage ecosystem
6
Dell 所提供的高性能计算存储解决方案
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell-Terascala HPC Storage Solution (DT-HSS) Fast Scratch
/scratch
7
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
8
Metadata Storage Server (MDS) Pair•Active/Stand-by Servers•Shared storage between two servers•Serves metadata for user data on Object Storage Servers
Clients
Storage Interconnect
Object Storage Server (OSS) Pair•Active/Active Servers•Shared storage between two servers•Stores user data
Management Interconnect
Management Server
Single name space across object servers
One or moreObject Pairs
Object Storage Server (OSS) Pair•Active/Active Servers•Shared storage between two servers•Stores user data
IB/10Gb
DT-HSS 架构概览 (Scratch Space)
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
DT-HSS架构 : Metadata Server Pair
9
Metadata Server (Active) Metadata Server (Stand-by)
PowerEdge R710 PowerEdge R710
PowerVault MD3220
6Gbps SAS redundant interconnect
Failover
Object Server (Active) Object Server (Active)
PowerEdge R710 PowerEdge R710
6Gbps SAS redundant interconnect
Failover
PowerVault MD3200
PowerVault MD1200
PowerVault MD3200
PowerVault MD1200
PowerVault MD1200PowerVault MD1200
DT-HSS Architecture: Object Server Pair
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
DT-HSS 简化的管理
10
Comprehensive Failover System
Reduced Complexity in
common FS Tasks
Single Snapshot of Entire System
Alerts and Notifications on Status
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
DT-HSS 性能
• QDR InfiniBand connectivity from clients to storage• Single OSS Pair with total of 96 3.5” 2TB NL SAS disks
– Up to 64 clients, 1-2 threads per client– Tests using IOZone, 1024KB block size, 60GB file size, 16 LUNs
• Max Reads: 6.5GB/s | Max Writes: 4.3GB/s
11
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
12
Scale in Performance and Capacity
• Add two more OSS pairs
– Additional 288TB raw (~218TB formatted)
– 9.6 GB/s (read)
– 7.8 GB/s (write)
2x IB
2x IB
2x IB
• Add another OSS pair
– Two OSS servers
– 144TB raw (~109 TB formatted)
– Up to 4.8 GB/s (read)
– Up to 3.9 GB/s (write)
QDR InfiniBand switchGigE for Management
2x IB
2x IBGig
E
• HSS3 144TB configuration– 144TB raw (~109 TB
formatted)– Up to 4.8 GB/s (read)– Up to 3.9 GB/s (write)– MDS: 1.5 billion files
DT-HSS – 扩展性
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
总结
13
424140393837363534333231302928272625242322212019181716151413121110 9 8 7 6 5 4 3 2 1
Metadata Pair
User Data
OSS Pair
DT-HSS
• Scale out storage appliance for throughput intensive applications
• Leverages Lustre, industry’s leading open-source parallel file system
• Rich management interfaces simplifies end to end storage management
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell NFS Storage Solution (NSS)
Primary/home
14
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
NSS 解决方案组成
• Single NFS Gateway– Perc H800 RAID card(s) in NFS gateway
› Dell MD1200 JBOD’s connected to RAID card(s)
– RAID-60 or RAID-60+LVM
15
• Two Active-Passive NFS Gateways– Dell MD3200 RBOD contains RAID card
– Dell MD1200 JBOD’s are connected to RBOD
– RAID-6 + LVM
NFS Gateway– Dell Server (R710)– IB, 10GigE options (GigE management
standard)
Hardware(NFS gateway)
Software andSupport
– RHEL 6.1 OS w/ NFS v4 (v3 optional)– Red Hat Scalable File system (XFS)– Red Hat Cluster Suite (for HA)
Scale up to 288TB under a single name space!
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
• Two PowerEdge R710s configured in active/stand-by serving a single file system• HA requires the ability to shut-down a misbehaving server
– Private network for heartbeat and control (including power control)– Plug power into controllable PDU’s– Enterprise iDRAC is the primary fencing device used to control misbehaving server– APC PDU is the secondary fencing device
• HA software shuts down server and cuts power to it
16
PowerVault MD1200
PowerVault MD3200
Dell R710 Active Server
Dell 710 Standby Server
Private GigE Switch(PowerConnect 5524)
APC PDUAPC PDU
2
2
GigE
Power Cords
IB or 10GigE
SAS (6Gbps)
1
1
IB/10GigE IB/10GigE
NSS-High Availability (NSS-HA) 架构
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
NSS-HA 性能最大达 288TB
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell NSS解决方案的优势
• Performance tuned NFS storage– Best possible performance
– No need to experiment with tuning options – already tuned
18
30%
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
HPC Tiered Storage Solution(HTSS)
HSM and Archive/archive
19
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
HPC解决方案中数据的快速增长
• Explosive growth in research data is leading to data management challenges
• Huge amount of data needs to be stored for future analysis– Example: One institute can generate approximately 400TB of
data per week
• Increasing compliance requirements direct preserving data for long periods of time– Example: NSF can ask for data preservation for up to 20 years
• Majority of data produced is rarely touched 2-3 weeks after creation
• Cold data occupies space on primary and scratch space– All the data does not need to be on high performance storage!
20
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
21
IB/10GbE Ethernet
Primary Storage:Dell NSS
Dell DX Object Storage
Dell ML6000 Tape Libraries
Dell DL2200 powered by CommVault
Dell Compute Cluster
Dell HPC 分级存储解决方案 (HTSS)
Fibre Channel
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
策略集合
22
Time Based Policy
“If the atime of a file is greater than 60 days, migrate the data blocks to HSM”
Size Based Policy
“If the file is larger than 100 GB, migrate the data blocks to HSM”
Directory Based Policy“If the data is in a certain directory, migrate data blocks to HSM”
User/Group
“If the data is owned by user laytonj, then migrate the data blocks to HSM”
Combination of Policies“If a file is older than 60 days, larger than 10GB, and is in a certain directory, then migrate the data blocks to HSM”
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell 存储产品家族
26
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
大规模扩展的归档存储
简单、易于承受、固定的内
容
DX 目标存储平台
基于磁盘的备份系统
稳定可靠,满足创新的需求
DR4000 存储平台
多协议的企业级存储
功能强大,自我优化
Compellent Storage
Center
统一的、虚拟化的存储
简单易用且功能多样
EqualLogic
PS & FS
模块化的存储系统
兼顾价值和性能
PowerVault
MD & NX
D2D 和D2T 备份应
用简单易用的数据保护和恢复
PowerVault
DL, TL & MTL
戴尔拥有全面的存储产品线Compellent:智能分层,应用优化的虚拟存储,业界最佳TCOEqualLogic:横向扩展,云就绪,最佳虚拟环境存储PowerVault:高性价比、功能充实的入门级存储DR:提升数据存储保护效率DX:面向大数据的目标对象数据、实现长期低 TCO
“要记得,戴尔是一个具有全面存储产品的‘选手’” – John Webster, Evaluator Group, CNET 新闻 , 2011 年 3 月 22日
27
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
Dell NAS – 根据客户需求选择最适合产品
• Multiprotocol scale-out NAS for EqualLogic Storage• Based on Dell Hardware and Dell Fluid File System• High Performance Scalable Architecture, unified management• Alignment with EqualLogic Family Values, inclusive software feature delivery
EqualLogic FS7x00 EqualLogic FS7x00
• Multiprotocol scale-up NAS for PowerVault MD Storage• Based on Dell Hardware and Dell Fluid File System• High availability NFS and CIFS capability that scales beyond traditional file servers• Robust replication, snapshot, dedupe and compression features *
PowerVault NX3x00 PowerVault NX3x00
• Primarily for Windows Environments with emphasis on CIFS performance• Based on two R710 servers and Windows Storage Server 2008 R2 Enterprise• Flexible Deployments with a variety of iSCSI and SAS storage backend options • Advanced Windows File Management features, High Availability and native Active
Directory
PowerVault NX3000HAPowerVault NX3000HA
Mid
ran
ge &
ad
van
ced
B
asic
dep
loym
en
ts
• Clustered scalability and high availability NAS for Compellent SANs• Based on Compellent hardware and Windows Storage Server 2008 Enterprise• Simplified Management, easily-accessible snapshots, file level dedupe (Single Instance
Storage)• Versatile SAN connectivity with support for both Fibre Channel and iSCSI
Compellent Storage Center NASCompellent Storage Center NAS
* Dedupe later in CY2012
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
30
在存储领域,戴尔正在成为一个更有活力的引人注目的参与者
1 IT Knowledge Hub , 2011年 3 月 21日2 Gartner Group,面向中端和高端模块化磁盘阵列的魔力象限( Magic Quadrant for Midrange and High-End Modular Disk Arrays), 2011年 11月 5 日4 IDC Multiclient Report,服务器虚拟化 2010年( Server Virtualization 2010), 2010年 9 月
Gartner魔力象限2011年中端和高端的模块化磁盘阵列 2
挑战者 领导者
前瞻性
探索者补缺者
执行力
2011年 11月
Dell Confidential
Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts
谢谢!
31