Skip to content

Commit eec6068

Browse files
[Bugfix] Set ACL_OP_INIT_MODE env var default to 0 (#1123)
### What this PR does / why we need it? Set `ACL_OP_INIT_MODE` env var default to `0`, since vllm-ascend may have problems in some scenarios when setting it to `1`. Plus, the guide #734 has also been updated. Signed-off-by: shen-shanshan <467638484@qq.com>
1 parent 4976b48 commit eec6068

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/envs.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,7 +127,7 @@
127127
# We set this var default to `1` in vllm-ascend to avoid segment fault when
128128
# enable `pin_memory` while creating a tensor using `torch.tensor`.
129129
"VLLM_ASCEND_ACL_OP_INIT_MODE":
130-
lambda: os.getenv("VLLM_ASCEND_ACL_OP_INIT_MODE", '1'),
130+
lambda: os.getenv("VLLM_ASCEND_ACL_OP_INIT_MODE", '0'),
131131
# Some models are optimized by vllm ascend. While in some case, e.g. rlhf
132132
# training, the optimized model may not be suitable. In this case, set this
133133
# value to False to disable the optimized model.

0 commit comments

Comments
 (0)