测试了DeepSeek-V3-0324-GGUF的UD-Q2_K_XL,效果很棒,需要改几行代码才能运行 #987
iseebrowser
started this conversation in
General
Replies: 1 comment 1 reply
-
我用上周编译的KTransformers跑V3 0324 UD-Q2_K_XL没有问题,这个改动修复什么问题? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
速度很快,效果也很好。需要改动的地方:
需要在ktransformers/models目录中修改:
modeling_deepseek_v3.py: self.seq_aux = config.seq_aux改为:self.seq_aux = None。
希望官方尽快修复。
Beta Was this translation helpful? Give feedback.
All reactions