-
Hi everybody. I'm sorry if I asked an incorrect question, I'm not good at this. Also, I saw a topic in which ggerganov advised to disable map and compile llama.cpp after such changes. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
Same performance.
Add If you build including GPU, then also add |
Beta Was this translation helpful? Give feedback.
-
thank you! |
Beta Was this translation helpful? Give feedback.
Same performance.
--no-mmap
in the command line may help performance, depending on your system RAM --no-mmapAdd
--threads N
, -t N, --threads NIf you build including GPU, then also add
-ngl N
-ngl N, --n-gpu-layers N