Replies: 1 comment
-
seems like I should ask this to the ggml repo not this one. Going to close this. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I'm not sure if this is the correct place to ask: I was looking through the code and hoping there was a way to stream from a file buffer so I can load from cloud store directly into ram without having to use the filesystem, when I found this:
https://github.com/ggerganov/llama.cpp/blame/8a7b2fa528f130631a5f43648481596ab320ed5a/ggml.h#L2069C1-L2069C59
Is there any current effort to implement this? I may take a stab at it, if not.
Beta Was this translation helpful? Give feedback.
All reactions