Skip to content

Provide more detailed instructions on readme #20

@Willian7004

Description

@Willian7004

It takes more time to find the "[original args]" on the orginal readme, I suggest to provide a full command to run the example propmt and note that the supplementary explanations on the orginal readme.

The default batch size and cache size is too large for 6g VRAM, I suggest to use batch size=1 and cache size=12288 for 6g VRAM.

Based on the suggestions, I suggest using the following command by default :

python src/yue/infer.py --stage1_use_exl2 --stage2_use_exl2 --stage2_cache_size 12288 --cuda_idx 0  --stage1_model YuE-s1-7B-anneal-en-cot-exl2 --stage2_model YuE-s2-1B-general-exl2  --genre_txt ./prompt_egs/genre.txt --lyrics_txt ./prompt_egs/lyrics.txt --run_n_segments 2 --stage2_batch_size 1 --output_dir ./output  --max_new_tokens 3000 --repetition_penalty 1.1

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions