How to set model options?

[gdkrmr]

How can I set model options for ollama? especially things like context length.

  (gptel-make-ollama "Ollama"                              ;Any name of your choosing
                     :host "localhost:11434"               ;Where it's running
                     :stream t                             ;Stream responses
                     :models '(
                               (qwen3:30b
                                :request-params '(:temperature  0.6
                                                  :top_p        0.95
                                                  :top_k       20
                                                  :min_p        0
                                                  :num_ctx 131072))
                               ))             ;List of models

This makes the request look as follows:

{
  "model": "qwen3:30b",
  "messages": [
 ....
  ],
  "stream": true,
  "quote": {
    "temperature": 0.6,
    "top_p": 0.95,
    "top_k": 20,
    "min_p": 0,
    "num_ctx": 131072
  },
  "options": {
    "temperature": 1.0
  }
}

[gdkrmr]

I think I figured it out, maybe someone who knows could confirm that this is actually a correct solution:

  (gptel-make-ollama "Ollama"                              ;Any name of your choosing
                     :host "localhost:11434"               ;Where it's running
                     :stream t                             ;Stream responses
                     :models '((qwen3:30b
                                :request-params (:options (:temperature  0.6
                                                           :top_p        0.95
                                                           :top_k       20
                                                           :min_p        0
                                                           :num_ctx 131072)))))

makes the json request look correct:

{
  "model": "qwen3:30b",
  "messages": [
...
  ],
  "stream": true,
  "options": {
    "temperature": 0.6,
    "top_p": 0.95,
    "top_k": 20,
    "min_p": 0,
    "num_ctx": 131072
  }
}

[karthink]

Yes, this is correct. You can also add the :request-params to the backend instead of to the model if you want to apply it to all models associated with the backend.