You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Respect GUIDELLM__PREFERRED_ROUTE during backend validation (#223)
`Backend.validate()` always issued a smoke-test call to the legacy
/v1/completions endpoint, even when the caller specified
`GUIDELLM__PREFERRED_ROUTE=chat_completions`. This breaks validation
against deployments that expose only the chat-completions route.
The PR makes backend validation honor the `GUIDELLM__PREFERRED_ROUTE`
setting. Instead of always using the /v1/completions endpoint, it now
chooses between text_completions and chat_completions based on the
configured preference.
0 commit comments