Replies: 3 comments 1 reply
-
After reading the function The splitting process is also a storing process. The function splits the graph and stores the subgraph into |
Beta Was this translation helpful? Give feedback.
-
Brothers, is my understanding correct? |
Beta Was this translation helpful? Give feedback.
-
Like the tensors, the graph is allocated from the memory in the |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Recently I have been reading and debugging the code of
llama.cpp
.When I read
static int llama_decode_internal
, I found that the calculation graph pointer (ordinary pointer, non-smart pointer):ggml_cgraph * gf = llama_build_graph(lctx, ubatch, false);
, built in the function was not released.Wouldn't this cause a memory leak?
Since I just started studying these codes, I may not know enough about them.
Beta Was this translation helpful? Give feedback.
All reactions