How do I run the new DeepSeek R1 0528?

[mtcl]

I've got the Q4_k_m downloaded and it's not working with the standard instructions. Any tips on which optimize roles to use?

I have 512 GB of RAM and 2x4090. Intel AMX processor but I can work with avx512

[shinchou]

Same issue.

[mtcl]

I got it working.

Here is the implementation:

https://youtu.be/Xui3_bA26LE