Please make it work with ROCm, or even better - Vulkan :-)

[DanielMazurkiewicz]

As millions of others I don't have nvidia GPU and I really would like to try out that model. Vulkan based backend will make it run on almost every hardware.

[DXXS]

... and I think I would hope for Apple Silicon support availability (such as that available via torch's mcp / metal devices, or perhaps alternate model formats such as apple neural or mlx)!

[kodecreer]

If they open source. I think the community will get em all working. I think it would be asking a lot for a research lab for commercial grade support.