Discussions

• 2 You must be logged in to vote

  💡

  [User] ChatML Support

  shouse-lab started Oct 12, 2023 in Ideas

  

  

  

  

  6
• 1 You must be logged in to vote

  💬

  Making source files small to be GPT-4 friendly

  aniljava started Nov 23, 2023 in General

  

  

  1
• 0 You must be logged in to vote

  🙏

  help when I enter a prompt models invent conversations.

  jovanlopez32 asked Nov 23, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  My output is too low

  paulocoutinhox started Nov 22, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Undefined symbols: gguf_get_val_data

  paulocoutinhox started Nov 22, 2023 in General · Closed

  

  

  2
• 2 You must be logged in to vote

  🙏

  What's the use of llama_eval function in example/main.cpp?

  DavdGao asked Sep 27, 2023 in Q&A · Unanswered

  

  

  

  

  9
• 1 You must be logged in to vote

  🙏

  Question on recommended resources

  kaieberl asked Nov 8, 2023 in Q&A · Unanswered

  

  

  3
• 4 You must be logged in to vote

  🙌

  k-quants are scary!

  KerfuffleV2 started Nov 20, 2023 in Show and tell

  

  

  4
• 1 You must be logged in to vote

  🙏

  Can HuggingFace's utilities for generation be used with llama.cpp?

  chashimo asked Nov 19, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is the LLAMA_NATIVE flag enabled by default? And now how to determine which instructions are used?

  Folko-Ven asked Nov 9, 2023 in Q&A · Answered

  

  

  

  

  9
• 1 You must be logged in to vote

  🙏

  Porting LeoLM instruct models to llama.cpp

  sorgfresser asked Nov 3, 2023 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Are there any chances of adding chat templates in the near future?

  Folko-Ven asked Nov 19, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  How do I use the GPU?

  deversbpv started Oct 7, 2023 in General

  

  

  

  

  4
• 5 You must be logged in to vote

  💬

  Perplexity / PPL, as a quantization loss benchmark, is inaccurate - KL divergence seem to be a better data point

  kalomaze started Nov 17, 2023 in General

  

  

  

  

  8
• 1 You must be logged in to vote

  💬

  xTTS2 - quite great speech

  cmp-nct started Nov 18, 2023 in General · Closed

  

  

  1
• 3 You must be logged in to vote

  💡

  ExLlama2 kind of quants (Qx.xx_K)

  Nexesenex started Sep 14, 2023 in Ideas

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  De-quantize model

  fakerybakery asked Nov 17, 2023 in Q&A · Unanswered

  

  

  1
• 4 You must be logged in to vote

  💬

  We've a new king of the hill on visual llms since today (Sphinx-MLLM)

  enhancement New feature or request

  cmp-nct started Nov 16, 2023 in General

  

  

  2
• 1 You must be logged in to vote

  💬

  is the grammer based approach best approach to get structured data out of llama 7b ?

  vishugupta96 started Nov 16, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  CMake: fix issue with version info not getting baked into LlamaConfig.cmake

  bandoti started Nov 15, 2023 in General · Closed

  

  

  0
• 2 You must be logged in to vote

  💡

  What about CPU dispatching?

  monatis started Nov 15, 2023 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  Rounding in '/blck_size' calculations

  AndrewGodfrey started Nov 15, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Why memory usage not change when add different input with GGML format

  SiraHaruethaipree asked Nov 13, 2023 in Q&A · Answered

  

  

  

  

  3
• 3 You must be logged in to vote

  🙌

  Now that we can readily read GGUF files from Python, I made some experimental GGUF tools

  KerfuffleV2 started Nov 12, 2023 in Show and tell

  

  

  1
• 1 You must be logged in to vote

  🙏

  Help with model output inconsistencies?

  AoifeHughes asked Nov 13, 2023 in Q&A · Answered

  

  

  4