Saturday

A multi modal chatbot powered by Gemini to consume notes with ease

A play on Tony Stark's Friday, Saturday allows users query their PDF notes and get custom responses with the help of embeddings. Users can also query their notes using images of question banks

Architecture

• To start a new chat, PDFs must be uploaded. Each PDF is then procressed and a new embeddings index is created on Pinecone.

• All queries are answered with the power of Gemini 1.5

• When users send a query, the information relevent to the query is fetched from the PDF with Pinecone through cosine similarity search.

• Similarliy users can upload images of question banks from which questions are extracted using Tesseract. These questions are then answered using relevent info from embeddings.

• Chat history is stateful and stored in MongoDB to provide a chatGPT like experience with contextual questions and chat bot memory

Note

Since free tier of Pinecone is used, only four documents can be uploaded at maximum. If a new chat creation has failed, this can be the reason.

Built With

Saturday is built using the MERN stack

• React
• Node
• Express
• MongoDB
• LangChain
• Pinecone

Authors

See also the list of contributors who participated in this project.

• Chaitanya Sai Vengali - Frontend and LangChain - chai-v
• Abhiram G - Text Extraction - AbhiramGarg
• Hiranmayi M - Backend Hiranmayi1212