Evaluate on Jamba-1.5-Mini #69
Description
The scripts stuck at:
[nltk_data] Downloading package punkt to /root/nltk_data...
But it works fine when I evaluate llama3-8b-instruct. I am wondering whether there is any setting I need to config for Jamba? I have already added the model in MODEL_SELCT
jamba_mini)
MODEL_PATH="${MODEL_DIR}/AI21-Jamba-1.5-mini"
MODEL_TEMPLATE_TYPE="Jamba"
MODEL_FRAMEWORK="hf"
TOKENIZER_PATH=$MODEL_PATH
;;
template.py
'Jamba': "<|startoftext|><|bom|><|system|> You are a helpful assistant.<|eom|><|bom|><|user|> {task_template}<|eom|><|bom|><|assistant|> "