llama-server

Here are 2 public repositories matching this topic...

A lightweight chat terminal-interface for llama.cpp server written in C++ with many features and windows/linux support.

chat roleplay llama teminal-application llamacpp mistral-7b llama-server

This is a Bash script to automatically launch llama-server, detects available .gguf models, and selects GPU layers based on your free VRAM.

bash cli utility ai launcher nvidia llama nvidia-smi nvidia-gpu llm llamacpp gguf llama-server gguf-models

Add a description, image, and links to the llama-server topic page so that developers can more easily learn about it.

To associate your repository with the llama-server topic, visit your repo's landing page and select "manage topics."