-
Notifications
You must be signed in to change notification settings - Fork 35
Open
Description
It takes more time to find the "[original args]" on the orginal readme, I suggest to provide a full command to run the example propmt and note that the supplementary explanations on the orginal readme.
The default batch size and cache size is too large for 6g VRAM, I suggest to use batch size=1 and cache size=12288 for 6g VRAM.
Based on the suggestions, I suggest using the following command by default :
python src/yue/infer.py --stage1_use_exl2 --stage2_use_exl2 --stage2_cache_size 12288 --cuda_idx 0 --stage1_model YuE-s1-7B-anneal-en-cot-exl2 --stage2_model YuE-s2-1B-general-exl2 --genre_txt ./prompt_egs/genre.txt --lyrics_txt ./prompt_egs/lyrics.txt --run_n_segments 2 --stage2_batch_size 1 --output_dir ./output --max_new_tokens 3000 --repetition_penalty 1.1
FengJin1117 and 152-zzFengJin1117 and Dbuggerx
Metadata
Metadata
Assignees
Labels
No labels