Skip to content

Commit ca21216

Browse files
committed
Attempt to fix xformers build
Signed-off-by: Huy Do <huydhn@gmail.com>
1 parent 4838d53 commit ca21216

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

docker/Dockerfile

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -364,8 +364,13 @@ RUN --mount=type=bind,from=build,src=/workspace/dist,target=/vllm-workspace/dist
364364
--extra-index-url ${PYTORCH_CUDA_INDEX_BASE_URL}/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.')
365365

366366
# TODO (huydhn): Remove this once xformers is released for 2.8.0
367-
RUN --mount=type=cache,target=/root/.cache/uv \
367+
RUN --mount=type=cache,target=/root/.cache/uv bash - <<'BASH'
368+
. /etc/environment
369+
export TORCH_CUDA_ARCH_LIST='7.0 7.5 8.0 8.9 9.0 10.0 12.0'
368370
uv pip install --system --no-build-isolation "git+https://github.com/facebookresearch/xformers@v0.0.30"
371+
# DEBUG
372+
python -m xformers.info
373+
BASH
369374

370375
# If we need to build FlashInfer wheel before its release:
371376
# $ # Note we remove 7.0 from the arch list compared to the list below, since FlashInfer only supports sm75+

0 commit comments

Comments
 (0)