Search results

loading error in llama cpp /llama2

modelModel specific issueModel specific issue

Status: Open.

#653 In abetlen/llama-cpp-python;

· Bhavya-TR opened on Aug 30, 2023

AssertionError when using LLama

llama.cppProblem with llama.cpp shared libProblem with llama.cpp shared lib

modelModel specific issueModel specific issue

Status: Open.

#643 In abetlen/llama-cpp-python;

· edzakharyan97 opened on Aug 26, 2023

Newlines in generation when using grammar

modelModel specific issueModel specific issue

qualityQuality of model outputQuality of model output

Status: Open.

#637 In abetlen/llama-cpp-python;

· rlancemartin opened on Aug 24, 2023

Different generation in llama.cpp and llama-cpp-python

modelModel specific issueModel specific issue

qualityQuality of model outputQuality of model output

Status: Open.

#619 In abetlen/llama-cpp-python;

· ssemeniuta opened on Aug 17, 2023

Gibberish responses with Llama-2-13B

modelModel specific issueModel specific issue

qualityQuality of model outputQuality of model output

Status: Open.

#596 In abetlen/llama-cpp-python;

· rlleshi opened on Aug 10, 2023

Prompt for instruction models to be used in server

modelModel specific issueModel specific issue

qualityQuality of model outputQuality of model output

Status: Open.

#383 In abetlen/llama-cpp-python;

· lucasjinreal opened on Jun 16, 2023

Llama crashes instead of raising an Exception when loading a model too heavy for my GPU (cuBLAS)

llama.cppProblem with llama.cpp shared libProblem with llama.cpp shared lib

modelModel specific issueModel specific issue

Status: Open.

#374 In abetlen/llama-cpp-python;

· Julescorbara opened on Jun 14, 2023