Skip to content

Commit da80873

Browse files
committed
Use CUDA 12.8
Signed-off-by: Huy Do <huydhn@gmail.com>
1 parent 3c259e4 commit da80873

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

vllm-benchmarks/run.sh

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -41,9 +41,8 @@ build_vllm() {
4141
SCCACHE_CACHE_SIZE=100G sccache --start-server || true
4242
# Build and install vLLM
4343
if command -v nvidia-smi; then
44-
pip install -r requirements/build.txt
45-
# TODO (huydhn): https://github.com/vllm-project/vllm/issues/15435
46-
TORCH_CUDA_ARCH_LIST=8.0 pip install --editable .
44+
pip install -r requirements/build.txt --extra-index-url https://download.pytorch.org/whl/cu128
45+
pip install --editable .
4746
elif command -v amd-smi; then
4847
pip install -r requirements/rocm.txt
4948
pip install -r requirements/rocm-build.txt

0 commit comments

Comments
 (0)