Review what is in ChatOptions

[markpollack]

There is the issue #1271 to review but also that the new o1 model has temperature, top_p,and n fixed at 1 while presence_penalty and frequency_panalty are fixed at 0. Also, logprobs is no supported.

This link has a nice write-up on limitations in the model that distinguish it from other models, notably that system messages, tools, function calling are not supported.

Also top_k is in common options but not supported in openai - i think i made the wrong analysis way back by putting it in common options.

[markpollack]

Generated fro ChatGpt - to be verified

Option	OpenAI	Bedrock (e.g. Claude, Titan)	Google Gemini	Ollama	Anthropic Claude
model	✅	✅	✅	✅	✅
maxTokens	✅	✅	✅	✅	✅
stopSequences	✅	Partial	✅	✅	✅
temperature	✅	✅	✅	✅	✅
topP	✅	✅	✅	✅	✅
stream	✅	✅	✅	✅	✅
responseFormat	✅	✅	✅	✅	✅
userId	✅	✅	✅	✅	✅
seed	✅	✅	✅	✅	✅
frequencyPenalty	✅	❌	✅	✅	❌
presencePenalty	✅	❌	✅	✅	❌
topK	❌	❌	✅	✅	✅

package org.springframework.ai.chat;

import org.springframework.ai.model.ModelOptions;
import org.springframework.lang.Nullable;

import java.util.ArrayList;
import java.util.Collections;
import java.util.List;
import java.util.Objects;

public class DefaultChatOptions implements ChatOptions {

    private String model;
    private Integer maxTokens;
    private List<String> stopSequences;
    private Double temperature;
    private Double topP;
    private String systemInstruction;
    private Boolean stream;
    private String responseFormat;
    private String userId;
    private Integer seed;
    private Integer contextWindow;

    public DefaultChatOptions() {
    }

    @Override
    public String getModel() {
        return model;
    }

    @Override
    public Integer getMaxTokens() {
        return maxTokens;
    }

    @Override
    public List<String> getStopSequences() {
        return stopSequences == null ? null : Collections.unmodifiableList(stopSequences);
    }

    @Override
    public Double getTemperature() {
        return temperature;
    }

    @Override
    public Double getTopP() {
        return topP;
    }

    @Override
    public String getSystemInstruction() {
        return systemInstruction;
    }

    @Override
    public Boolean getStream() {
        return stream;
    }

    @Override
    public String getResponseFormat() {
        return responseFormat;
    }

    @Override
    public String getUserId() {
        return userId;
    }

    @Override
    public Integer getSeed() {
        return seed;
    }

    @Override
    public Integer getContextWindow() {
        return contextWindow;
    }

    @Override
    public DefaultChatOptions copy() {
        DefaultChatOptions copy = new DefaultChatOptions();
        copy.model = this.model;
        copy.maxTokens = this.maxTokens;
        copy.stopSequences = this.stopSequences == null ? null : new ArrayList<>(this.stopSequences);
        copy.temperature = this.temperature;
        copy.topP = this.topP;
        copy.systemInstruction = this.systemInstruction;
        copy.stream = this.stream;
        copy.responseFormat = this.responseFormat;
        copy.userId = this.userId;
        copy.seed = this.seed;
        copy.contextWindow = this.contextWindow;
        return copy;
    }

    public static class DefaultChatOptionsBuilder implements ChatOptions.Builder {

        private final DefaultChatOptions options = new DefaultChatOptions();

        @Override
        public Builder model(String model) {
            options.model = model;
            return this;
        }

        @Override
        public Builder maxTokens(Integer maxTokens) {
            options.maxTokens = maxTokens;
            return this;
        }

        @Override
        public Builder stopSequences(List<String> stopSequences) {
            options.stopSequences = stopSequences;
            return this;
        }

        @Override
        public Builder temperature(Double temperature) {
            options.temperature = temperature;
            return this;
        }

        @Override
        public Builder topP(Double topP) {
            options.topP = topP;
            return this;
        }

        @Override
        public Builder systemInstruction(String systemInstruction) {
            options.systemInstruction = systemInstruction;
            return this;
        }

        @Override
        public Builder stream(Boolean stream) {
            options.stream = stream;

[ddobrin]

@markpollack @sobychacko
In regards to Gemini models: they support "stop sequences", "frequence penalty" and "presence penalty" - link