10

Click here to load reader

Demand for High Performance Computing (HPC) in Climate Research

  • Upload
    cit-nus

  • View
    855

  • Download
    3

Embed Size (px)

DESCRIPTION

By Srivatsan V Raghavan. Tropical Marine Science Institute, NUS. http://www.youtube.com/watch?v=GIzxrzkD1T8&p=83FA1CD871F4A4E5 With climate change becoming an important topic in everyday life, the use of climate models for simulations is common. But these climate models are tools that demand heavy HPC resources. The advent of latest technologies in HPC systems have changed the way the climate research field has developed and there is always a never-ending need for sound infrastructure to meet with the herculean tasks of modelling and project deadlines. The talk will highlight certain issues on the use of such HPC systems looking at their merits and limitations and cite some case studies of benchmarked exercises using different HPC platforms.

Citation preview

Page 1: Demand for High Performance Computing (HPC) in Climate Research

Demand for High Performance Computingin Climate Research

Page 2: Demand for High Performance Computing (HPC) in Climate Research

Background

Climate Research

Long years - climate modelling

Continuous Simulations

High resolution computations - Parallel Computing

Page 3: Demand for High Performance Computing (HPC) in Climate Research

Situation

High resolution climate modelling

Experiment: about 150 years [ 1961-2010; 2010-2100] of climate simulations – In what time span can we get it done ?

Continuous Running and simultaneous post processing of large data

Need of a dedicated computing cluster

High speed performance and large disk space

Page 4: Demand for High Performance Computing (HPC) in Climate Research

Sample output from model

Temperature Monsoon Winds

Page 5: Demand for High Performance Computing (HPC) in Climate Research

Servers tested

TMSI

Alatum

Civil Engg

Amazon

SVU

0

2

4

6

8

10

12

14

TMSI Alatum Civil Engg Amazon SVU

Day

s

Run time for 1 calendar year

Page 6: Demand for High Performance Computing (HPC) in Climate Research

Sources of Bottlenecks

Storage mount

Network cables [ethernet vs high speed eg. Myrinet or Infiniband (IB)]

Memory

Core Type ( Virtual / Physical )

Page 7: Demand for High Performance Computing (HPC) in Climate Research

Network cables

TMSI ( Std GE)

Alatum (Std GE)

Civil Engg (Myrinet)

Amazon (Std 10GE)

SVU (IB)

Page 8: Demand for High Performance Computing (HPC) in Climate Research

Performance in SVU

16 node cluster, IB cabled, 48 GB mem.

10

60

110

160

210

260

310

360

410

460

510

560

610

660

710

760

810

1 6 12 36 72 84 96 144 168 180

Processors

Min

ute

s

Page 9: Demand for High Performance Computing (HPC) in Climate Research

Results

1 calendar year = 1 day ( desired 2 or 3 calendar years in 1 day)

IB cables certainly increase performance speed

More processors necessarily do not increase speed

The best system tested so far

Page 10: Demand for High Performance Computing (HPC) in Climate Research

Acknowledgements

Mr. Tan Chee Chiang

Ms. Grace Foo

Mr. Wang Junhong