Output truncated

[JustVugg]

how someone solve the problem of output truncated following the finetune of mistral?

[ishandhanani]

Hi @Zrufy - can you provide some more insight into this? Potentially a code snippet? Have you set a low max_tokens generated in your inference code?