--logit-bias token id - Where can I find the list of tokens and their ids?

[trollkotze]

If I want to bias towards or against certain tokens, how do I find the token id to use for this parameter?

[klosax]

Use the --verbose-prompt parameter to list the token ids of the prompt:

./main -m llama-7b-ggml-q5_1.bin -p "Hello get me some token ids" --verbose-prompt -n 0

main: prompt: ' Hello get me some token ids'
main: number of tokens in prompt = 7
     1 -> ''
 15043 -> ' Hello'
   679 -> ' get'
   592 -> ' me'
   777 -> ' some'
  5993 -> ' token'
 18999 -> ' ids'

[trollkotze]

Thanks!