LLM Controller Interface for vLLM (LLM output format controller) #4578
Ksuriuri
announced in
Show and tell
Replies: 1 comment 1 reply
-
Neat project and clever use of stop tokens to add fixed content! That said, this isn't quite the same as AICI, so I wonder if it should share the same name? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I made a simple implementation of controllable generation of large language models based on vLLM, enabling precise control over the model's output format through additional control information: Ksuriuri/LLMCI
The performance looks good to me, feel free to try it if you need😊
Beta Was this translation helpful? Give feedback.
All reactions