"Plus, easily install Triton & SageAttention for ComfyUI."

[baesik]

Added new Package Command (in the 3-dots menu) for installing Triton & SageAttention in ComfyUI

Where can I find this option? 😅

[mohnjiles]

If it's not in that 3-dots -> Package Commands menu (on the Package card for ComfyUI), that unfortunately means your GPU is not supported.

[SturmB]

@mohnjiles What if there isn't even a "Package Commands" option in the menu at all (let alone an "Install Triton & SageAttention" command within it)?

I'm running Stability Matrix 2.15.0 on CachyOS (based on Arch Linux) with an RTX 4090 card. Everything I've read says that my card supports Sage Attention fine. Are they incorrect?

[mohnjiles]

Double check in the Settings that your Default GPU is set to the 4090, then restart SM and it should be there.

[SturmB]

Ah, that was (almost) it. I can now install Nunchaku, at least, even though I have already done so from the ComfyUI interface weeks ago. ¯\_(ツ)_/¯

However, even though the 4090 supports Triton and SageAttention, I suppose there must be some configuration issue in CachyOS that isn't quite right, because SM doesn't recognize it as possible.

Thanks for getting me at least halfway there, @mohnjiles!

[mohnjiles]

Ahh I missed the Linux part, sorry! We only have the prebuilt wheels for Windows at the moment. You should be able to pip install triton from the Python Packages menu for that part, though you'll probably need to build SageAttention from the source, as outlined on their readme here: https://github.com/thu-ml/SageAttention?tab=readme-ov-file#install-package

[SturmB]

Thanks for clearing that up! I encountered some difficulty installing it manually because I have CUDA 13.0 installed, and PyTorch has a strict requirement of 12.9. I let Warp work it out for me, and it documented how it was patched to get SageAttention 2 to install in a CUDA 13 environment. Perhaps that info could be useful when/if you create a prebuilt wheel for Linux.

Side note: It appears that the prebuilt wheel for Nunchaku is stuck on an older version (for Linux, anyway). I saw this conflict in the SM logs and removed SM's installation of Nunchaku since the one installed by ComfyUI's Nunchaku Installer custom node uses the latest version, 1.0.1. (I don't know if both nunchaku and ComfyUI-nunchaku are needed for it to work, honestly.)

However, this conversation is now veering off topic, so I'll stop here. Thanks again so much for your help, @mohnjiles!