13
GPU-Accelerated Innovation USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD Greg Crider Senior Product Manager NVIDIA

USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

  • Upload
    others

  • View
    28

  • Download
    0

Embed Size (px)

Citation preview

Page 1: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

GPU-Accelerated Innovation

USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD

Greg Crider

Senior Product Manager

NVIDIA

Page 2: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

2

NVIDIA + NIMBIX PARTNERSHIP

Nimbix was the first cloud provider to partner with NVIDIA

Has offered every NVIDIA compute GPU, including latest Volta V100 GPU

Only public cloud provider in the Americas to offer NVIDIA DGX-1 systems

Working Together to Deliver Accelerated Computing

Page 3: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

3

CHALLENGES WITH COMPLEX SOFTWARE

Current DIY GPU-accelerated AI and HPC deployments are complex and time consuming to build, test and maintain

Development of software frameworks by the community is moving very fast

Requires high level ofexpertise to manage driver, library, framework dependencies

NVIDIA Deep

Learning Libraries

NVIDIA Container

Runtime for Docker

NVIDIA Driver

NVIDIA GPU

Applications or

Frameworks

Page 4: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

4

NGC DELIVERS A GPU OPTIMIZED ENVIRONMENT

Integrates the deep learning SDK, libraries, drivers and OS into a single environment

Removes all the DIY complexity of managing dependencies, updates

Stack runs in a VM locally or in the cloud

Page 5: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

5

WHY CONTAINERS?

Benefits of Containers:

Simplify deployment of GPU-accelerated software, eliminating time-consuming software integration work

Isolate individual deep learning frameworks and applications

Share, collaborate, and test applications across different environments

5

Page 6: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

6

NVIDIA GPU CLOUD

Discover 30 GPU-Accelerated ContainersDeep learning, HPC, and partner applications

Innovate in Minutes, Not WeeksGet up and running quickly

Access from AnywhereSupports NVIDIA Volta or Pascal™ architecture GPUs on NVIDIA DGX Systems and supported cloud providers

Simple access to GPU-accelerated software

Page 7: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

7

NGC CONTAINER REGISTRY

Deep Learning Frameworks, drivers, OS, all pre-configured, tested, and optimized, updated monthly

Curated HPC and third-party applications

Updated monthly to deliver the highest performance frameworks in the industry

One stop shop for GPU optimized containers

Page 8: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

8

CURRENT NGC CONTAINERS

PARAVIEW-HOLODECK

PARAVIEW-INDEX

PARAVIEW-OPTIX

INDEX

VMD

H2O

MAPD

CHAINER

PADDLEPADDLE

KINETICA

GAMESS

GROMACS

LAMMPS

NAMD

CHROMA

MILC

RELION

CANDLE

LATTICE MICROBES

CAFFE CAFFE2 CNTK CUDA DIGITS MXNET PYTORCH TENSORFLOW TENSORRTTHEANO TORCH

DEEP

LEARNINGHPC VIZ HPC PARTNER

Page 9: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

9

MAXIMIZING PERFORMANCE ON VOLTAGreater than 10x Performance on Volta vs K80

0

2

4

6

8

10

12

K80 V100 TC

GPU Generational Training Scaling

Frameworks on NGC have the latest NVIDIA optimizations for Volta

Cloud images from NVIDIA are tuned for maximum performance

Volta is >10x faster than K80

ResNet-152 Training, 8x K80 (16 GPUs total) compared with 8x V100 NVLink GPUs using NVIDIA 17.10 containers

Page 10: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

10

NGC CONTAINERS RUNNING ON A CSP CLOUD

NGC Container Registry

CSP Cloud

User registers independently

with NGC and CSP Cloud

NGC

image

Cloud Marketplace

Page 11: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

11

DOWNLOAD NGC CONTAINERS

CREATE A CSP CLOUD ACCOUNT AND RUN A

GPU INSTANCE

CREATE A NGC ACCOUNT

3 STEPS TO USING NGC ON A CSP CLOUD

User creates a free NGC account on NVIDIA’s web site running in the US

www.nvidia.com/ngcsignup

User running a GPU instance in the CSP Cloud downloads no-cost containers from the NGC Container Registry

User creates a CSP Cloud account and starts a GPU instance using the NGC image

Page 12: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in

12

NVIDIA GPU CLOUDGPU-accelerated containers for deep learning, HPC, and HPC visualization

Innovate In Minutes, Not Weeks

Access from Anywhere

GPU-Accelerated Containers

Page 13: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in