Feature Request: Support prefill for Claude #543
nissa-seru
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Prefill enables pre-population of the first part of the model's input, such that the model will continue responding as if it wrote the prefilled content. This enables chain-of-thought and other techniques to be used with very high compliance. For example, providing a psuedo-XML schema such as:
and prefilling with:
works extremely well and is considerably more compact than most chain-of-thought prompting techniques.
Beta Was this translation helpful? Give feedback.
All reactions