You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Outlines currently rely on outlines-core for creating the logits processor that does the actual logits biasing for local models. The idea would be to allow users to select alternative structured generation libraries to do that such as xgrammar or llguidance.
For this we will use a plugin system with a registry of backends.