32
Chainerのテスト環境と DockerでのCUDA(株)Preferred Infrastructure 海野 裕也 (@unnonouno)

Chainerのテスト環境とDockerでのCUDAの利用

Embed Size (px)

Citation preview

  • Chainer DockerCUDA

    Preferred Infrastructure (@unnonouno)

  • l -2008

    l l 2008-2011

    l l 2011-

    l

    l l JubatusChainer l

    NLP2014- 2015,

    2

  • Chainer

    3

  • 4

  • Chainer

    l OS l Ubuntu14.04, CentOS 7

    l Python l 2.7, 3.4

    l CUDA l 6.5, 7.0

    l cuDNN l v2

    5

    2x2x2=8

  • l protobufPy3 l l CUDA 6.5

    l cuDNNABI l NumPy l pipsetuptools10

    l Python 3.5.0GC

    6

  • 7

  • 8

  • CIGPU

    9

  • Jenkins

    10

  • Jenkins

    l

    l

    l

    11

  • l 81

    12

  • Docker

    l l

    l l Dockerfile

    l Dockerfile

    13

  • 14

  • Chainer

    15

    Github

    Docker

  • CUDA Docker

    16

  • Dockerfile

    l .run l CUDA

    RUN ./installers/NVIDIA-Linux-x86_64-352.39.run -s -N --no-kernel-module && ./installers/cuda-linux64-rel-7.5.18-19867135.run --noprompt

    17

  • 1: GPU

    l GPU

    l --device

    $ docker run --device /dev/nvidia0 --device /dev/nvidiactl --device /dev/nvidia-uvm chainer nvidia-smi

    18

  • 2: CUDA

    l

    l l CUDA7.5

    RUN ./installers/NVIDIA-Linux-x86_64-352.39.run -s -N --no-kernel-moduleRUN ./installers/cuda-linux64-rel-7.0.28-19326674.run -noprompt

    19

  • 3: nvidia-uvm

    l /dev/nvidia-uvm l sampledeviceQuery

    l /dev/nvidia-uvmdeviceQuery

    20

  • 4:

    l nvidia-352.63

    l (^o^)

    l

    21

  • nvidia-docker

    l NVIDIACUDADocker

    l https://github.com/NVIDIA/nvidia-docker

    22

  • nvidia-docker

    ldocker

    l

    23

  • nvidia-docker

    l Volume

    l

    24

  • nvidia-dockernvidia-uvm

    l /dev/nvidia-uvmnvidia-modprobedeviceQuery

    25

    nvidia-docker/tools/src/nvidia/nvidia.go

  • nvidia-dockerCUDA, cuDNN

    l CUDA 6.5, 7.0, 7.5 l cuDNN v2, v3, v4 l

    26

  • nvidia-docker

    27

  • l https://github.com/pfnet/chainer-test l run_xxx.pyDockerfile

    docker buildnvidia-docker run l -ibash

    28

  • l OS l Ubuntu 14.04, CentOS 7

    l Python l 2.7, 3.4, 3.5

    l CUDA l 6.5, 7.0, 7.5

    l cuDNN l v2, v3, v4

    l numpy l 1.9, 1.10

    29

    2x3x3x3x2=108

  • 30

  • l OS l Ubuntu 14.04, CentOS 7, Ubuntu 16.04

    l Python l 2.7, 3.4, 3.5

    l CUDA l 6.5, 7.0, 7.5, 8.0

    l cuDNN l v2, v3, v4

    l numpy l 1.9, 1.10, 1.11

    l protobuf l 2.7, 3.0

    31