We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 29a38f0 commit 871d6b7Copy full SHA for 871d6b7
vllm/env_override.py
@@ -13,7 +13,7 @@
13
# that interact with vllm workers.
14
# they are executed whenever `import vllm` is called.
15
16
-if 'NCCL_CUMEM_ENABLE' in os.environ:
+if os.environ.get('NCCL_CUMEM_ENABLE', '0') != '0':
17
logger.warning(
18
"NCCL_CUMEM_ENABLE is set to %s, skipping override. "
19
"This may increase memory overhead with cudagraph+allreduce: "
0 commit comments