Skip to content

Commit b6e7e3d

Browse files
authored
[Intel GPU] support ray as distributed executor backend for XPU. (#20659)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
1 parent e760fce commit b6e7e3d

File tree

2 files changed

+3
-1
lines changed

2 files changed

+3
-1
lines changed

.buildkite/scripts/hardware_ci/run-xpu-test.sh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,8 @@ docker run \
2727
"${image_name}" \
2828
sh -c '
2929
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager
30+
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager -tp 2 --distributed-executor-backend ray
31+
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager -tp 2 --distributed-executor-backend mp
3032
cd tests
3133
pytest -v -s v1/core
3234
'

vllm/executor/ray_distributed_executor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -62,7 +62,7 @@ class RayDistributedExecutor(DistributedExecutorBase):
6262

6363
def _init_executor(self) -> None:
6464
self.forward_dag: Optional[ray.dag.CompiledDAG] = None
65-
if envs.VLLM_USE_V1 and not current_platform.is_xpu():
65+
if envs.VLLM_USE_V1:
6666
# V1 uses SPMD worker and compiled DAG
6767
os.environ["VLLM_USE_RAY_SPMD_WORKER"] = "1"
6868
os.environ["VLLM_USE_RAY_COMPILED_DAG"] = "1"

0 commit comments

Comments
 (0)