How to access the 'default' sampling_params of the LLM? #5429
namespace-Pt
announced in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
From my understanding, each model has a default sampling_params specifying the
bos_token_id
andeos_token_id
just likeGenerationConfig
in huggingface. I cannot find an entry to a defaultsampling_params
from theLLM
class. Can anyone help me? Thanks in advance.Beta Was this translation helpful? Give feedback.
All reactions