cu128

[Homas]

Any plans to support cu128 soon?

[YanWenKun]

Yes, cu128 images are scheduled to be released with PyTorch 2.7.

If you need it right now, use the nightly image, or I can publish a pre-release version using test-version of PyTorch 2.7.

[Homas]

Nightly works, thanks for pointing this out. For QA purposes pre-release could be better.

[YanWenKun]

Try the new cu128-test image:
https://github.com/YanWenKun/ComfyUI-Docker/tree/main/cu128-test

I named it -test (instead of -slim) because it lacks xFormers and may not perform better than current versions in some cases.

xFormers can be compiled and installed on pre-release PyTorch versions, but the process is time-consuming and often fails on GitHub Actions.

[Homas]

Thanks.
It's failing to start in my setup. Any ideas?

comfyui  | ## ComfyUI-Manager: installing dependencies done.
comfyui  | ** ComfyUI startup time: 2025-04-20 06:51:45.724
comfyui  | ** Platform: Linux
comfyui  | ** Python version: 3.12.9 (main, Feb 05 2025, 11:02:28) [GCC]
comfyui  | ** Python executable: /usr/bin/python3
comfyui  | ** ComfyUI Path: /root/ComfyUI
comfyui  | ** ComfyUI Base Folder Path: /root/ComfyUI
comfyui  | ** User directory: /root/ComfyUI/user
comfyui  | ** ComfyUI-Manager config path: /root/ComfyUI/user/default/ComfyUI-Manager/config.ini
comfyui  | ** Log path: /root/ComfyUI/user/comfyui.log
comfyui  | [ComfyUI-Manager] PyTorch is not installed
comfyui  | [ComfyUI-Manager] 'comfyui-frontend-package' dependency were fixed
comfyui  | 
comfyui  | Prestartup times for custom nodes:
comfyui  |    0.0 seconds: /root/ComfyUI/custom_nodes/comfyui-easy-use
comfyui  |    0.0 seconds: /root/ComfyUI/custom_nodes/rgthree-comfy
comfyui  |    5.2 seconds: /root/ComfyUI/custom_nodes/ComfyUI-Manager
comfyui  | 
comfyui  | Traceback (most recent call last):
comfyui  |   File "/root/./ComfyUI/main.py", line 134, in <module>
comfyui  |     import comfy.utils
comfyui  |   File "/root/ComfyUI/comfy/utils.py", line 20, in <module>
comfyui  |     import torch
comfyui  |   File "/usr/local/lib64/python3.12/site-packages/torch/__init__.py", line 409, in <module>
comfyui  |     from torch._C import *  # noqa: F403
comfyui  |     ^^^^^^^^^^^^^^^^^^^^^^
comfyui  | ImportError: libcufile.so.0: cannot open shared object file: No such file or directory

[YanWenKun]

Thanks! I just fixed it, it should work now :-)

[Homas]

Yes, it works. Thanks!

[MicahZoltu]

Is this still in testing and missing xFormers? I'm new to ComfyUI so I'm not sure what impact missing xFormers has on usage. Can this be used mostly normally?

CUDA 12.8 is necessary for using ComfyUI with the new 50xx nVidia cards, so just using an older version is not an option.

[YanWenKun]

Checkout the cu128-slim:
https://github.com/YanWenKun/ComfyUI-Docker/tree/main/cu128-slim
https://hub.docker.com/r/yanwk/comfyui-boot/tags?name=cu128-slim