Monitoring and evaluating RAG Pipeline Performance on AWS using Ragas

This is the reference code repository for the blog post titled "Monitoring and evaluating RAG Pipeline Performance on AWS using Ragas".

Features of the Repository:

1. Provision to deploy both open source, bedrock and aws foundational models.
2. Ability to deploy and extend vector databases.
3. A demonstration of the RAG evaluation pipeline through introduction of a new callback handler within a QA Bot and continuous monitoring of the results through an app.

Details

For Application Details Refer: app_documentation
For Stack Deployment Details Refer: deployment_documentation

Executed On

Python: 3.11.9
Requirements Strict: requirements