19
COMPUTE | STORE | ANALYZE Cray Scalable Solutions for HPC and Data Storage Philip Brown 28 th November 2013

Cray Scalable Solutions for HPC and Data Storage · COMPUTE | STORE | ANALYZE Cray Scalable Solutions for HPC and Data Storage Philip Brown 28th November 2013

  • Upload
    lekhue

  • View
    216

  • Download
    0

Embed Size (px)

Citation preview

COMPUTE | STORE | ANALYZE

Cray Scalable Solutions for HPC and Data Storage

Philip Brown28th November 2013

COMPUTE | STORE | ANALYZE

Safe Harbor Statement

This presentation may contain forward-looking statements that arebased on our current expectations. Forward looking statementsmay include statements about our financial guidance and expectedoperating results, our opportunities and future potential, our productdevelopment and new product introduction plans, our ability toexpand and penetrate our addressable markets and otherstatements that are not historical facts. These statements are onlypredictions and actual results may materially vary from thoseprojected. Please refer to Cray's documents filed with the SEC fromtime to time concerning factors that could affect the Company andthese forward-looking statements.

2Copyright 2013 Cray Inc.

COMPUTE | STORE | ANALYZE

Supercomputing Leadership

Since Its Founding, Cray Has Maintained a Single Focus on Supercomputing

19701970 19801980 19901990 20102010

3

20002000

Copyright 2013 Cray Inc.

COMPUTE | STORE | ANALYZE

We Build Computational Tools That Help Change The World

SupercomputersFlexible Clusters

Hybrid Architectures

Supercomputing Big Data

4

Compute

Integrated Storage& Data Management

Tiered Storage ArchiveStore

Analyze Graph AnalyticsHadoop Solutions

Merging Big Data and Supercomputing

Copyright 2013 Cray Inc.

COMPUTE | STORE | ANALYZE

Cray Computing Solutions Scaling across the Performance Spectrum

Copyright 2013 Cray Inc.5

Cray CS300 SeriesCluster Supercomputers

Capacity Computing Focus• Price/Performance/Watt• Flexible system configurations• Industry Standard Technologies• Manageability and Reliability• Modular Scalability

Cray XC30 SeriesSupercomputers

Capability Computing Focus• Application Performance & Scalability• HPC-Optimized Systems• Advanced Programming Tools• Roadmap Upgradability• Reliability/Availability/Serviceability

Based on the Intel® Xeon® processor

COMPUTE | STORE | ANALYZE

Load & Go Tune & Go Code & Go

No Code Development

New CodeDevelopment

Full Support for Diverse Users

Build & Go

Cray provides great support across the full spectrum of HPC user types

COMPUTE | STORE | ANALYZE

Cray XC30 User Environment

CrayPATCray Apprentice2

Cray Iterative Refinement ToolkitCray PETSc, CASK

DVS

GNU

Reveal

Cray LinuxEnvironment

Load & Go Code & GoTune & GoBuild & Go

COMPUTE | STORE | ANALYZE

Scalability of select “Load & Go” ISV applications

ISV Application

Primary segment

Demonstratedscalability *

ANSYS Fluent Commercial CFD >12000 cores

LS-DYNA Impact/crash analysis >4000 cores

CFD++ Aero CFD >10,000 cores

STAR-CCM+ Commercial CFD >3000 cores

PowerFLOW External CFD >4000 cores

AcuSolve Commercial CFD >3000 cores

Abaqus Structural analysis >64 cores

8

* Demonstrated scalability typically limited by the simulation model available

Copyright 2013 Cray Inc.8

COMPUTE | STORE | ANALYZE

Cray XC30 User Environment

CrayPATCray Apprentice2

Cray Iterative Refinement ToolkitCray PETSc, CASK

DVS

GNU

Reveal

Cray LinuxEnvironment

Load & Go Code & GoTune & GoBuild & Go

COMPUTE | STORE | ANALYZE

Build & Go Example – ROMS Ocean Model

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

16.00

18.00

0 512 1024 1536 2048

FDR IB Cluster

Item FDR IB Cluster

Processor Intel E5-2670

Compiler Intel 13.1

Compiler Options

-heap-arrays -ip -O3 -xW –free

Topology Full Fat Tree

MPI Libraries

Intel 4.0

Math Libraries

Intel MKL 10.3

OS RHEL 6.2

Sim

ulat

ed Y

ears

/ D

ay

Cores

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

16.00

18.00

0 512 1024 1536 2048

Cray XC30

FDR IB Cluster

Build & Go

Item FDR IB Cluster Cray XC30

Processor Intel E5-2670 Same

Compiler Intel 13.1 Same

Compiler Options

-heap-arrays -ip-O3 -xW –free

Same

Topology Full Fat Tree Dragonfly

MPI Libraries

Intel 4.0 Cray MPICH2 6.0

Math Libraries

Intel MKL 10.3 Cray Libsci12.1

OS RHEL 6.2 CLE 5.1

Copyright 2013 Cray Inc.10

COMPUTE | STORE | ANALYZE

Cray XC30 User Environment

CrayPATCray Apprentice2

Cray Iterative Refinement ToolkitCray PETSc, CASK

DVS

GNU

Reveal

Cray LinuxEnvironment

Load & Go Tune & Go Code & GoBuild & Go

COMPUTE | STORE | ANALYZE

Tune & Go Toolbox● Compilers

● Cray Compiling Environment● Popular 3rd party compilers

● Scientific Libraries● Profiling Tools

● Craypat, Craypat Lite & Apprentice● Popular 3rd party tools

● Debuggers● Rogue Wave TotalView● Allinea DDT

● Communication Optimizations● Aries Collective Engine● MPI Rank Reordering Tools● Cray SHMEM

● Restructuring Tools● Cray Reveal

● Language Extensions● OpenACC● Coarray FORTRAN 2008

Tune & Go

Copyright 2013 Cray Inc.12

COMPUTE | STORE | ANALYZE

Tune & Go Example – ROMS Ocean Model

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

16.00

18.00

0 512 1024 1536 2048

FDR IB Cluster

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

16.00

18.00

0 512 1024 1536 2048

Cray XC30

FDR IB Cluster

Build & Go

Item FDR IB Cluster

Processor Intel E5-2670

Compiler Intel 13.1

Compiler Options

-heap-arrays -ip -O3 -xW –free

Topology Full Fat Tree

MPI Libraries

Intel 4.0

Math Libraries

Intel MKL 10.3

OS RHEL 6.2

Item FDR IB Cluster Cray XC30

Processor Intel E5-2670 Same

Compiler Intel 13.1 Same

Compiler Options

-heap-arrays -ip -O3 -xW –free

Same

Topology Full Fat Tree Dragonfly

MPI Libraries

Intel 4.0 Cray MPICH2 6.0

Math Libraries

Intel MKL 10.3 Cray Libsci 12.1

OS RHEL 6.2 CLE 5.1

Sim

ulat

ed Y

ears

/ D

ay

Cores

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

16.00

18.00

0 512 1024 1536 2048

Cray XC30

FDR IB Cluster

Cray XC30 + RankOptimization

Item FDR IB Cluster Cray XC30

Processor Intel E5-2670 Same

Compiler Intel 13.1 CCE 8.1

Compiler Options

-heap-arrays -ip -O3 -xW –free

Default flags

Topology Full Fat Tree Dragonfly

MPI Libraries

Intel 4.0 Cray MPICH2 6.0

Math Libraries

Intel MKL 10.3 Cray Libsci12.1

OS RHEL 6.2 CLE 5.1

Tuning MPI Rank Reordering

Tune & Go

Copyright 2013 Cray Inc.13

COMPUTE | STORE | ANALYZE

Cray XC30 User Environment

CrayPATCray Apprentice2

Cray Iterative Refinement ToolkitCray PETSc, CASK

DVS

GNU

Reveal

Cray LinuxEnvironment

Load & Go Tune & Go Code & GoBuild & Go

Copyright 2013 Cray Inc.14

COMPUTE | STORE | ANALYZE

Cray End-To-End Storage Solutions

Copyright 2013 Cray Inc.15

Centralized FabricCentralized Fabric

Lustre File System by Cray

COMPUTE | STORE | ANALYZE

Cray Tiered Adaptive Storage

Copyright 2013 Cray Inc.16

● Integrated solution● Architected, configured and fully supported by Cray● Including Versity Storage Manager software

● Features● Storage tier virtualization

● Support for up to four tiers for data protection● Transparent user access to tiers

● Data managed round-the-clock automatically by policy● Flexible policy engine to provide maximum protection

● Open data format for archived files● No vendor lock-in

● Wide device support● Supports latest tape and library technologies● Network and storage agnostic

● Optimized for performance

Management and File System Servers

File System Storage

File ServersLustre HSM Movers

Storage and NetworkSwitches

COMPUTE | STORE | ANALYZE

Users and Applications

Cray Tiered Adaptive Storage For Big Data

Copyright 2013 Cray Inc.17

● Virtualizing storage● Single interface to multiple tiers● File systems appear infinitely large

● Data protection● Multiple copies of files● Disaster recovery capabilities

● Flexible storage tiers● Scale the correct tiers to your needs● Support for both disk and tape

● Transparent for users● Maintain ease of use for your

customers● Extensible to Lustre file system

● Lustre file system integration● Maintain transparency throughout

Tier 1

Tier 2

Tier 3

Tier 4

File System

Policy‐based Data Movement

Policy Engine

Lustre File System

Users and Applications

Transparent D

ata Access

Transparent D

ata Access

COMPUTE | STORE | ANALYZE18

Copyright 2013 Cray Inc.

COMPUTE | STORE | ANALYZE

Legal DisclaimerInformation in this document is provided in connection with Cray Inc. products. No license, express or implied, to any intellectual property rights is granted by this document.

Cray Inc. may make changes to specifications and product descriptions at any time, without notice.

All products, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.

Cray hardware and software products may contain design defects or errors known as errata, which may cause the product to deviate from published specifications. Current characterized errata are available on request.

Cray uses codenames internally to identify products that are in development and not yet publically announced for release. Customers and other third parties are not authorized by Cray Inc. to use codenames in advertising, promotion or marketing and any use of Cray Inc. internal codenames is at the sole risk of the user.

Performance tests and ratings are measured using specific systems and/or components and reflect the approximate performance of Cray Inc. products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance.

The following are trademarks of Cray Inc. and are registered in the United States and other countries: CRAY and design, SONEXION, URIKA, and YARCDATA. The following are trademarks of Cray Inc.: ACE, APPRENTICE2, CHAPEL, CLUSTER CONNECT, CRAYPAT, CRAYPORT, ECOPHLEX, LIBSCI, NODEKARE, THREADSTORM. The following system family marks, and associated model number marks, are trademarks of Cray Inc.: CS, CX, XC, XE, XK, XMT, and XT. The registered trademark LINUX is used pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the mark on a worldwide basis. Other trademarks used in this document are the property of their respective owners.

19Copyright 2013 Cray Inc.