ACCELERATED COMPUTING FOR THE 21ST CENTURY

2

Artificial IntelligenceComputer GraphicsGPU Computing

NVIDIA“THE AI COMPUTING COMPANY”

3

A NEW ERA OF COMPUTING

PC INTERNETWinTel, Yahoo!1 billion PC users

1995 2005 2015

MOBILE-CLOUDiPhone, Amazon AWS2.5 billion mobile users

AI & IOTDeep Learning, GPU100s of billions of devices

4

1980 1990 2000 2010 2020

GPU-Computing perf

1.5X per year

1000X

by

2025

RISE OF GPU COMPUTING

Original data up to the year 2010 collected and plotted by M. Horowitz, F. Labonte, O. Shacham,

K. Olukotun, L. Hammond, and C. Batten New plot and data collected for 2010-2015 by K. Rupp

102

103

104

105

106

107

Single-threaded perf

1.5X per year

1.1X per year

APPLICATIONS

SYSTEMS

ALGORITHMS

CUDA

ARCHITECTURE

5

2013

BEYOND MOORE’S LAW

Base OS: CentOS 6.2

Resource Mgr: r304

CUDA: 5.0

Thrust: 1.5.3

2018

Accelerated Server

With Fermi

Accelerated Server

with Volta

NPP: 5.0

cuSPARSE: 5.0

cuRAND: 5.0

cuFFT: 5.0

cuBLAS: 5.0

Base OS: Ubuntu 16.04

Resource Mgr: r384

CUDA: 9.0

NPP: 9.0

cuSPARSE: 9.0

cuSOLVER: 9.0

cuRAND: 9.0

cuFFT: 9.0

cuBLAS: 9.0

Thrust: 1.9.0

Progress of Stack in 5 Years

6

ALL TOP 15 APPLICATIONS ACCELERATED

550+ Applications Accelerated

8X CUDA DOWNLOADS

2018

8M

1M

2012

DEFINING THE NEXT GIANT WAVE IN HPC

OAK RIDGE SUMMIT

World’s fastest supercomputer

120+ Petaflop HPC; 3+ Exaflop of AI

ABCI Supercomputer (AIST)

Japan’s fastest AI supercomputer

Piz Daint

Europe’s fastest supercomputer

MOST ADOPTED PLATFORM FOR ACCELERATING HPC

259

319

400

470

554

2014 2015 2016 2017 2018

# of GPU-Accelerated Apps

9

NVIDIA SDK & LIBRARIES

INDUSTRY FRAMEWORKS & APPLICATIONS

CUSTOMER USECASES

SUPERCOMPUTING

+550 Applications

CUDA

NCCL cuDNN TensorRTcuBLAS DeepStreamcuSPARSEcuFFT

Amber

NAMDLAMMPS

CHROMA

ENTERPRISE APPLICATIONSCONSUMER INTERNET

ManufacturingHealthcare EngineeringSpeech Translate RecommenderMolecular Simulations

WeatherForecasting

SeismicMapping

cuRAND

NVIDIA TESLA PLATFORMWorld’s Leading Data Center Platform for Accelerating HPC and AI

TESLA GPUs & SYSTEMS

SYSTEM OEM CLOUDTESLA GPU NVIDIA HGX-1 CLOUDNVIDIA DGX FAMILY

https://aws.amazon.com/canada/

10

NVSWITCHENABLES THE WORLD’S LARGEST GPU

16 Tesla V100 32GB Connected by New NVSwitch

2 petaFLOPS of DL Compute

Unified 512GB HBM2 GPU Memory Space

300GB/sec Every GPU-to-GPU

2.4TB/sec of Total Cross-section Bandwidth

11

THE WORLD’S MOST POWERFUL AI SERVER FOR THE MOST COMPLEX AI CHALLENGES

• DGX-2 is the newest addition to the DGX family, powered by DGX software

• Deliver accelerated AI-at-scale deployment and simplified operations

• Step up to DGX-2 for unrestricted model parallelism and faster time-to-solution

INTRODUCING NVIDIA DGX-2

THE WORLD’S FIRST 2 PETAFLOPS SERVER