LLM Extension for Command Palette

This is an extension for PowerToys Command Palette that allows you to chat with a large language model (LLM) directly.

Note

The Microsoft store page has been down due to crashes caused by a bug still in investigation, but you may still install the extension directly from Command Palette or from the Release page.

Demo Video

llm_extension_for_cmd_pal_demo.mp4

It currently supports the following APIs:

• Ollama
• OpenAI (and any other compatible API, such as Docker Model Runner)
• Azure OpenAI
• Google
• Mistral

Setup

There is a YouTube playlist with setup tutorials for different services.