I try to use ggml matmul together with pytorch. But I fail to use pytorch cudagraph to capture the matmul #986
Unanswered
Eutenacity
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I try to use ggml matmul together with pytorch. I put my code in the https://github.com/Eutenacity/python-ggml-matmul
I hope this can help.
But I can not use PyTorch cudagraph to capture the matmul.
If anyone can give me a favor
Beta Was this translation helpful? Give feedback.
All reactions