Skip to content

Instantly share code, notes, and snippets.

@karthik4579

karthik4579/install.sh

Last active September 27, 2024 22:20
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save karthik4579/9acfec77a14e3ee637c90af537a90c2c to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save karthik4579/9acfec77a14e3ee637c90af537a90c2c to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. karthik4579 revised this gist Sep 27, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion install.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -5,7 +5,7 @@ pip uninstall torch torch-xla torchaudio torchvision -y
    export DATE="20240828"
    export TORCH_VERSION="2.5.0"
    git clone https://github.com/vllm-project/vllm.git
    %cd vllm
    cd vllm
    pip install setuptools_scm
    pip install https://storage.googleapis.com/pytorch-xla-releases/wheels/tpuvm/torch-${TORCH_VERSION}.dev${DATE}-cp310-cp310-linux_x86_64.whl
    pip install https://storage.googleapis.com/pytorch-xla-releases/wheels/tpuvm/torch_xla-${TORCH_VERSION}.dev${DATE}-cp310-cp310-linux_x86_64.whl
  2. karthik4579 created this gist Sep 27, 2024.
    18 changes: 18 additions & 0 deletions install.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,18 @@
    #!/bin/bash

    sudo apt update && sudo apt upgrade -y
    pip uninstall torch torch-xla torchaudio torchvision -y
    export DATE="20240828"
    export TORCH_VERSION="2.5.0"
    git clone https://github.com/vllm-project/vllm.git
    %cd vllm
    pip install setuptools_scm
    pip install https://storage.googleapis.com/pytorch-xla-releases/wheels/tpuvm/torch-${TORCH_VERSION}.dev${DATE}-cp310-cp310-linux_x86_64.whl
    pip install https://storage.googleapis.com/pytorch-xla-releases/wheels/tpuvm/torch_xla-${TORCH_VERSION}.dev${DATE}-cp310-cp310-linux_x86_64.whl
    pip install torch_xla[tpu] -f https://storage.googleapis.com/libtpu-releases/index.html
    pip install torch_xla[pallas] -f https://storage.googleapis.com/jax-releases/jax_nightly_releases.html -f https://storage.googleapis.com/jax-releases/jaxlib_nightly_releases.html
    pip install torch==2.5.0+cu121 torchvision==0.15.2+cu121 torchaudio==2.5.0 --extra-index-url https://download.pytorch.org/whl/cu121
    pip install -r requirements-tpu.txt
    export VLLM_TARGET_DEVICE="tpu"
    python setup.py develop
    pip install -e . --no-build-isolation