Can classifier free guidance just use a sequence #3994
Answered
by
slaren
KerfuffleV2
asked this question in
Q&A
-
|
instead of having to run a completely separate decode with its own context every step (basically halving inference speed)? |
Beta Was this translation helpful? Give feedback.
Answered by
slaren
Nov 8, 2023
Replies: 1 comment 1 reply
-
|
Yes, it should be possible to do this. The only reason to decode the guidance sequence on a different context would be to use a different model. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thanks! Right now, you can't even specify a different model as far as I know so that shouldn't be much of a limitation. |
Beta Was this translation helpful? Give feedback.
Answer selected by
KerfuffleV2
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes, it should be possible to do this. The only reason to decode the guidance sequence on a different context would be to use a different model.