Commit 8a4e5c5

authored

[V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906)

Signed-off-by: Abatom <abzhonghua@gmail.com>

1 parent 76b4944 commit 8a4e5c5Copy full SHA for 8a4e5c5

4 files changed

+266

-256

lines changed

docs/design/v1
- p2p_nccl_connector.md
examples/online_serving/disaggregated_serving_p2p_nccl_xpyd
- disagg_proxy_p2p_nccl_xpyd.py
vllm/distributed/kv_transfer/kv_connector/v1/p2p
- p2p_nccl_connector.py
- p2p_nccl_engine.py

+266

-256

lines changed

Comments

(0)