Bring Your Own LLM to Savvy

[joshi4]

Use any OpenAI API-compatible LLM with Savvy.

Get started with Two Easy Steps.

1. Run savvy upgrade to get the latest version of the CLI
2. Update your savvy config.

{
  "token": "svy_F1H.....",
  + "llm_base_url": "http://localhost:11434/v1",
  + "llm_model_name": "codellama:13b",
  + "llm_api_token": "only_if_required"
}

For more info, see: https://getsavvy.so/blog/byo-llm