Using Chat

[yodaphone]

Hi

I'm relatively new to this whole chat thing. I have paperless-ngx & was able to setup paperless-ai and link them up

i had to manually "process" the documents as i dont know how to do this automatically. i have paperless-ai cron set yo 10 minutes but it didnt process it automatically

now coming to the chat feature. i selected the document from the list but cant figure out how to interact with the document. any help for a newbie like me would be really appreciated

i tried to ask some questions based on the document but it doesnt seem to recognize the document i selected.

[chilipepperpizza]

I have the same issue, at least with larger documents it'll appear to not be aware of the document. Single page documents seem to chat as expected. Maybe the token limit is being exceeded? I'm not sure how to find out what's going on.

[clusterzx]

Could be the case if the document exceeds the token limit.
There is not much I can do on paperless-ai side but making a complete RAG Chat application out of it.
This planned/worked on but right now I dont have the time to build that feature fully.

[chilipepperpizza]

For sure, this is more on the LLM service side of things. Would it be possible to know somehow if or when a document exceeds the token window? I have no clue how easy or hard that would be. Regardless it's a sweet feature and I love using it. Appreciate the work you've put in to this

[clusterzx]

Hmmmm, it is surely possible. But the downside is there also that it depends on the LLM. There are so many LLMs with each having its own token limit and context length. The only thing possible is that the user defines these values for the LLM by himself. But that would also create many issues here when someone make a mistake, even this is a selfmade problem.

[clusterzx]

RAG is now implemented.