Skip to content

output length exceeding context length #13

@sujitvasanth

Description

@sujitvasanth

YuE-exllamav2 is amazing! I can generate full songs in 10 minutes on my RTX3090
but when I set the segment max tokens to 2000 or more I'm getting an error during inference but it does still complete
output length exceeding context length 6436 exceeds context length 5191, dropping early segments from prompt
my setting: max tokens per segment 3000, number of segments 6, everything else default
O think this is damagiign the song composition
Can you explain what is happening?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions