Skip to content

Instantly share code, notes, and snippets.

@jeremysells

jeremysells/nvidia_docker_gpu_notes.md

Created July 15, 2021 22:24
Show Gist options
  • Save jeremysells/9eac6ac3602d6af7a95b47bd4fb07c3a to your computer and use it in GitHub Desktop.
Save jeremysells/9eac6ac3602d6af7a95b47bd4fb07c3a to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. jeremysells created this gist Jul 15, 2021.
    53 changes: 53 additions & 0 deletions nvidia_docker_gpu_notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,53 @@
    License: MIT (https://opensource.org/licenses/MIT)

    SEE: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html

    ```sh
    $ lsb_release -a
    No LSB modules are available.
    Distributor ID: Ubuntu
    Description: Ubuntu 21.04
    Release: 21.04
    Codename: hirsute
    ```

    ```sh
    $ docker run --runtime=nvidia --rm nvidia/cuda:9.0-base nvidia-smi
    docker: Error response from daemon: Unknown runtime specified nvidia.
    See 'docker run --help'.

    # https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#setting-up-nvidia-container-toolkit
    $ distribution=$(. /etc/os-release;echo $ID$VERSION_ID)
    $ echo $distribution
    ubuntu21.04
    $ curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | sudo apt-key add -
    Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
    OK
    $ curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list
    # Unsupported distribution!
    # Check https://nvidia.github.io/nvidia-docker

    $ distribution=ubuntu20.04

    $ curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list
    deb https://nvidia.github.io/libnvidia-container/stable/ubuntu18.04/$(ARCH) /
    #deb https://nvidia.github.io/libnvidia-container/experimental/ubuntu18.04/$(ARCH) /
    deb https://nvidia.github.io/nvidia-container-runtime/stable/ubuntu18.04/$(ARCH) /
    #deb https://nvidia.github.io/nvidia-container-runtime/experimental/ubuntu18.04/$(ARCH) /
    deb https://nvidia.github.io/nvidia-docker/ubuntu18.04/$(ARCH) /

    $ sudo apt update
    ...

    $ sudo apt-get install -y nvidia-docker2

    $ sudo systemctl restart docker

    $ sudo docker run --rm --gpus all nvidia/cuda:11.0-base nvidia-smi


    ... Success!!! (should see details)
    ```