-
Notifications
You must be signed in to change notification settings - Fork 35
Open
Description
YuE-exllamav2 is amazing! I can generate full songs in 10 minutes on my RTX3090
but when I set the segment max tokens to 2000 or more I'm getting an error during inference but it does still complete
output length exceeding context length 6436 exceeds context length 5191, dropping early segments from prompt
my setting: max tokens per segment 3000, number of segments 6, everything else default
O think this is damagiign the song composition
Can you explain what is happening?
Metadata
Metadata
Assignees
Labels
No labels