bug ? repeated text output after 2-3 questions.

[colindaven]

Hi,

I've used llamafiles including llava, wizardcoder and llama3/3.1. Generally I use an 8B model or similar.

After two or three normal questions, llamafile answers with repetitive rubbish. See below.

This is running on a 768GB RAM CPU only linux x86-64 bit server and appears to be using less than 1-2 % of RAM. Has anyone got any idea what I can set to avoid this problem ?

Thanks.

User: go into more depth on connection pooling

Llama: Connection Pooling in Virtuoso

Connection pooling is a technique that allows multiple clients to share a fixed number of database connections, reducing overhead and improving performance. In Virt Virt Virt Virt V User V V V VVVVVVJJMJJMJMJAJJJJJJJJJJJKKJKFKKFORFORFFORFFORFFORFFARFFAREFFFRAFFARAFFARRAFFARRAYRRAFRRAFAFFARRAYRAFRRAFAFFÁMAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFAFA