Skip to content

Does DeepEP support sm86?(4A6000 without NVL) #481

@ziyuhuang123

Description

@ziyuhuang123

Hello DeepEP Team,

System Environment
GPU: 4x NVIDIA A6000 (Ampere Architecture, Compute Capability sm_86)

Interconnect: GPUs are connected via PCIe (no NVLink).

Problem Description
export TORCH_CUDA_ARCH_LIST="8.6"
export DISABLE_SM90_FEATURES="1"
export NVSHMEM_DIR=$(...)
export CPLUS_INCLUDE_PATH=$CONDA_PREFIX/include
export LDFLAGS="-L/usr/local/cuda/lib64/stubs"

python setup.py install

** Error **

adding license file 'LICENSE'
writing manifest file 'deep_ep.egg-info/SOURCES.txt'
Copying deep_ep.egg-info to /home/zyhuang/miniconda3/envs/deepep_env/lib/python3.10/site-packages/deep_ep-1.2.1+9249c25-py3.10.egg-info
running install_scripts
(deepep_env) ada6000-02% python
Python 3.10.19 | packaged by conda-forge | (main, Oct 22 2025, 22:29:10) [GCC 14.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import deep_ep
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/zyhuang/temp_can/distributed/DeepEP/deep_ep/__init__.py", line 3, in <module>
    from .utils import EventOverlap
  File "/home/zyhuang/temp_can/distributed/DeepEP/deep_ep/utils.py", line 7, in <module>
    from deep_ep_cpp import EventHandle
ImportError: /home/zyhuang/miniconda3/envs/deepep_env/lib/python3.10/site-packages/deep_ep_cpp.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN7deep_ep12internode_ll17query_mask_bufferEPiiS1_P11CUstream_st

====> I can install, but can not import

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions