Hpc Press Slides

1

Accelerate your business. Preserve your data.

4

PLEASE EMBARGO INFORMATION UNTIL JANUARY 20, 2010

2

• Successful track record since 2001 (significant traction in last 3 years)

• Over 4,000 customer installations

• Over 50,000 File System Clients deployed

• Over 400 Archive systems deployed

• Over 100PB under management

• Broad support of OS platforms and storage technologies

• Windows, Linux, UNIX, Mac (OS platforms)

• Quantum, Sun/STK, IBM, HP, Dell, Sony, Spectra Logic, Qualstar (Tape technologies)

• Server and disk vendor agnostic

• Utilized throughout rich data content industries

• Broadcast, Cable & CCTV

• Movie and Television Production, Post-Production & Graphics

• Science and Engineering (Oil & Gas research, Satellite imaging)

• High Performance Computing (Life Sciences- genome sequencing)

• Audio and Video Surveillance and Mining

• Government Data Mining projects

• Internet Streaming

• Pre-Press, Digital Printing

• CAD/CAM

StorNext

3

• Simplifies data sharing via high-speed Fibre Channel (SAN) and NAS

• Reduces storage costs and complexity by unifying storage tiers

• Preserves choices across operating systems, disk vendors and tape vendors

• Independently scales to thousands of nodes and PBs of data

CIFS/NFS

GigE TCP/IP

Infiniband IP

FC/iSCSI

StorNextSAN Clients

PRIMARY TIER

SECONDARY TIER

TAPE LIBRARY ARCHIVE VAULT

OptionalStorNextPolicyEngine

ST

OR

NE

XT

LA

N C

LIE

NT

S

MetadataController

StorNext Data Management SoftwareOverview

FC/iSCSI

4

StorNext Data Management Software

StorNext File System

• Heterogeneous shared file system presents pools of storage as local-attached

• Purpose-built for high-performance ingest, distribution and computing environments

• Optional policy engine for file-based replication and near-line deduplication

FC/iSCSI

StorNextSAN Clients

PRIMARY TIER

SECONDARY TIER


MetadataController

FC/iSCSI

HA MDC

5


StorNext Storage Manager• Delivers transparent tiered storage and archive for preservation

• Directory-level policy engine data movement

• Supports disk, NAS, VTL, MAID and tape target devices

FC/iSCSI

StorNextSAN Clients

PRIMARY TIER

SECONDARY TIER

TAPE LIBRARY ARCHIVE VAULT


MetadataController

FC/iSCSI

6


StorNext Distributed LAN Client (DLC) access across the LAN

• Extends collaboration beyond the SAN by supporting thousands nodes

• Highly resilient „clustering‟ via gateway servers

• Load balancing for optimum performance

GigE TCP/IP

Infiniband IP

FC/iSCSI

StorNext DLCGateway Servers

PRIMARY TIER

SECONDARY TIER

TAPE LIBRARY ARCHIVE


SC

AL

ES

TO

TH

OU

SA

ND

S O

F S

TO

RN

EX

T D

IST

RIB

UT

ED

LA

N C

LIE

NT

S

MetadataController

Vendor Agnostic

Vendor Agnostic

FC/iSCSI

7

StorNext 4.0 – Key New Features

Features Benefits

Data Replication Protection and Distribution

File System Deduplication Nearline Storage

Distributed Data Mover Increased SM Performance

Web services-based GUI Improved Usability

8


File-based replication for File System and Storage Manager environments

• File system policy-based for protection, distribution and consolidation

• Supports one-to-one, many-to-one and one-to-many StorNext environments

• Asynchronous host-based IP and FC connectivity

Remote Office

Remote Office

Remote Office

Remote Office

Remote Office

WAN

Central Datacenter

Remote Office

Remote Office

Remote Office

WAN

Central Datacenter

SOURCE TARGET SOURCE TARGET

9


File system deduplication

• Policy-based file system deduplication for protection and nearline storage

• Integrated with replication policy engine for flexibility

• Directory-level deduplication based upon time, size and file type

StorNextSAN Clients

PRIMARY TIER

SECONDARY TIER

DEDUPLICATEDREPOSITORY

StorNextPolicyEngine

Vendor Agnostic

Vendor Agnostic

Vendor Agnostic

FC/iSCSI

MetadataController

10


StorNext Storage Manager Distributed Data Mover (DDM)

• Turns Linux SAN clients into Storage Manager data movers

• Improves throughput performance to tiers of storage, especially tape

• Reduces the need for large, high performance Metadata Controller (MDC) servers

FC/iSCSI

StorNextSAN Clientswith DDMs

PRIMARY TIER

SECONDARY TIER

TAPE LIBRARY ARCHIVE

MDC &DDM

DDMServer

DDMServer

SANClient

FC/iSCSI

FC

FC

FC

DDMServer

11


Web Services based Graphical User Interface (GUI)

• Improved Usability• 50% Page Reduction vs. v3.x

• More user friendly for reduced complexity

• Advanced configuration wizard simplifies setup and configuration

• Improved Monitoring• File system operations

• At-a-glance system health status

• At-a-glance capacity utilization

• Improved reporting and graphing capabilities

• Web Services architecture (XML)• Improved interoperability with 3rd party applications based on web services

architecture

• Platform independent control of Storage Manager environments (Linux, Windows)

• SNAPI support will eventually be replaced by a full Web Services API

12

Management Console View

13


Preserve Choice

Platform and storage vendor independent

Prevent Complexity Transparent, automated data movement

Reduce Storage Costs Multi-tier storage and archiving

Finish Projects Faster High speed, heterogeneous file sharing

Safeguard Critical Data Data protection, monitoring, alerting

Customer Case Examples

15

StorNext User: Lime Pictures

Media & Entertainment

Key Challenges

Many of the company‟s productions operating with tight deadlines and high frequency of

output. HD brings its own challenges with a four-fold increase in content and bandwidth

requirements.

Project Objectives

• Real time tapeless workflow by filming studio-based material directly onto the StorageArea Network (SAN)

• Simultaneous workflow: making content available at the same time to all aspects ofproduction

Quantum Solution/Benefits

• Quantum StorNext File System and Storage Manager, Quantum Scalar i2000 tape library

• Get content to air faster and share content more efficiently and cost effectively

• Effectively store and share content, and deploy the solution into existing workflow

• Transform tapeless workflow reliability and usability

• Establish multi-tier archives, automatically moving data between the disk and Scalar i2000 tape resources

Why Quantum/StorNext

• Proven in the market

• Open architecture provides the flexibility to choose whichevertechnologies desired

• Offers rich acquisition, ingest, and production editing functionality

• Provides resilience and reliability needed

“Reliability and usability

have been transformed

since we deployed the

digital workflow solution.

We haven‟t experienced

any downtime and our

productivity has increased

significantly. Our confidence

in the system has certainly

risen by 100 percent.”

-Mike Horan,

SAN Support Engineer,

Lime Pictures

16

StorNext User: Baylor College of Medicine HPC – Life Sciences

Key Challenges

Sequencing the 3 billion chemical building blocks that make up the DNA of the 24 different human chromosomes, this research center needed to access, share and manage hundreds of terabytes of data for analysis at any time.

Project Objectives

• Centrally manage complex heterogeneous environment of servers, networks and storage technology

• Expand Baylor College‟s Human Genome Sequencing Center‟s data storage capabilities


• Quantum StorNext File System and Storage Manager, Quantum Scalar i2000 tape library

• Enabled simultaneous access to huge volumes of data without impacting system users

• Provided cost-effective content creation through automated data management

• Allowed centralized management of heterogeneous environment

• Protected prior investments by integrating legacy resources

• Provided scalable foundation to meet anticipated storage growth of up to 20 PB over next 2-3 years


• Reputation in high-performance, multi-petabyte environments

• Support for existing storage hardware with no significant investment needed for additional hardware

• Easy to manage system

“By combining high-speed

data sharing and cost-

effective content retention in

a single solution, StorNext

has enabled our researchers

to access the data they need

quickly and easily and

eliminated the significant

management overhead we

incurred with our legacy

system.”

Geraint Morgan

Director of Information

Systems,

Baylor College

17

StorNext User: CERNHPC – Science & Engineering

Key Challenges

Collecting and processing large amounts of scientific data from the collision between

billions of particles demands a fast, reliable and scalable IT infrastructure.

Project Objectives

• Manage high-volume scientific data

• High-speed, shared workflow operations

• Large-scale, multi-tier archiving


• Quantum StorNext File System

• 20 InfoTrend Fibre Channel, 4 GB/s disk arrays; 80 servers running Linux

• High-speed, shared workflow operations with quicker file processing

• Processing massive amounts of data (1 PB of data/month)

• Access data quickly and easily on all hosts

• Aggregated bandwidth, scalability of the number of client nodes

• Direct access to the Fibre channel correction increasing performance

• Affinity allowing direct data traffic to pre-determined disks (all machines operating

at max performance)


Offered significantly higher performance than competitor because it makes direct use of Fibre Channel connection

“Data is the most

precious commodity

CERN has. Quantum

StorNext is instrumental

in collecting that data

quickly and reliably,

thereby enabling the

scientific community to

understand and exploit

new ideas and

discoveries.”

-Pierre Vande Vyvre,

Project Leader, CERN

Documents

Hpc Press Slides