Skip to content

This project focuses on developing a real-time, intelligent healthcare assistant powered by Agentic RAG (Retrieval-Augmented Generation) and the LangChain framework. Designed to provide multimodal support—text, image, and document-based inputs—it aims to assist medical personnel and individuals in remote areas.

Notifications You must be signed in to change notification settings

rahulkr43/A-Multimodel-Healthcare-Chatbot-Healthgenie

Repository files navigation

HealthGenie - AI-Powered Medical Chatbot with RAG

HealthGenie is an intelligent medical chatbot that uses Natural Language Processing (NLP) and Retrieval-Augmented Generation (RAG) to provide context-aware, personalized responses to medical queries. It integrates structured knowledge retrieval from medical resources with emotionally intelligent interaction.

Table of Contents

Screenshots

HealthGenie Interface

Suggested Diagnosis

Medicine Query Example

Medicine Query Example

Blood Bank Query Example

Blood Bank Query Example

Project Overview

HealthGenie is an intelligent medical chatbot that overcomes traditional LLM limitations through an innovative integration of Retrieval-Augmented Generation (RAG) and Natural Language Processing (NLP) techniques. This multimodal healthcare assistant provides:

  • Symptom analysis and health advice
  • Medicine-related information (dosage, side effects, alternatives)
  • Blood bank location services
  • Secure, offline processing with local LLM (Qwen2.5-7B)
  • Real-time medical information retrieval from curated sources

Key Features

Medical Capabilities

  • Symptom Analysis: Provides suggested diagnoses based on symptoms
  • Medicine Information: Details about dosage, side effects, and alternatives
  • Blood Bank Locator: Finds nearby blood banks with contact information
  • Personalized Advice: Tailored health recommendations

Features

  • 🧠 NLP + RAG for contextual understanding and grounded responses
  • 🩺 Medical guidance based on symptoms or medicine queries
  • 💉 Blood bank and emergency resource integration
  • 🗣️ Emotionally intelligent, conversational interface

Technical Innovations

  • Privacy-First Architecture: All processing done locally
  • Reduced Hallucinations: 42% improvement over standard LLMs
  • Fast Response Time: Answers in 2-3 seconds
  • Accurate Recognition: 89% symptom identification accuracy

Technical Implementation

Core Technologies

python Backend Stack

  • Python 3.10+
  • Flask (Web Framework) spaCy (NLP Processing)
  • Chroma (Vector Database)
  • LangChain (RAG Framework)

Frontend Stack HTML5, CSS3, JavaScript

System Architecture

User Input: Text queries through web interface

  • Intent Detection: spaCy-based classification
  • RAG Pipeline: Context retrieval from medical knowledge base
  • LLM Processing: Local Qwen2.5-7B model for response generation

Structured Output: Formatted response to user

  • User Interface The HealthGenie interface features:
  • Chat Display Area:
  • Shows conversation history

Highlights suggested diagnoses

Displays structured health advice

Response Format:
🧠 Suggested Diagnosis: [condition]

💡 Health Advice:
- [Recommendation 1]
- [Recommendation 2]

🔗 Best Buy: [medicine link]

🩸 Blood Bank Info:
| Center | Address | Contact |

Installation Guide

Prerequisites

  • Python 3.10+
  • Ollama or LMstudio (for local LLM)
  • 8GB+ RAM or GUP recommended

Setup Instructions

# Clone the repository
git clone https://github.com/yourusername/healthgenie.git
cd healthgenie

# Install dependencies
pip install -r requirements.txt

# Download NLP models
python -m spacy download en_core_web_sm

# Launch application
python app.py

Usage Examples

Symptom Query:

User: I have headache and fever

HealthGenie:
🧠 Suggested Diagnosis: Migraine or Viral Fever

💡 Health Advice:
- Stay hydrated
- Rest in a quiet room
- Use acetaminophen for pain relief

Medicine Query:

User: What is the price of Dolo 650?

HealthGenie:
🧠 Suggested Diagnosis: Acetaminophen dosage inquiry

💡 Health Advice:
- Follow recommended dosage
- Do not exceed 4000mg daily

🔗 Best Buy: [Dolo 650 purchase link]

Blood Bank Query:

User: Where can I find O+ blood in Patna?

HealthGenie:
🩸 Blood Bank Info:
| Center         | Address               | Contact     |
|----------------|-----------------------|-------------|
| Patna Blood Bank | Main Road, Patna     | 0612-XXXXXX |

Acknowledgment

At the outset, special appreciation goes to my supervisor, Mr. Ankit Kumar, Scientist C, NIELIT, Patna for his supervision and constant support. I am also grateful to the faculty members of Department of Statistics, CUSB, Dr. Sunit Kumar (HOD), Dr. Indrajeet Kumar, Dr. Sandeep Kumar Maury, Dr. Kamlesh Kumar, for their help and support. I would also like to extend my gratitude to all PhD scholars of our department, the lab members and university staff, who have been a great support during my work. Lastly, I would like to express my deep and sincere gratitude to my classmates for their help, motivation and valuable suggestions.

Developed by Rahul Kumar Mahato

M.Sc. Data Science and Applied Statistics GitHub | LinkedIn | Email

About

This project focuses on developing a real-time, intelligent healthcare assistant powered by Agentic RAG (Retrieval-Augmented Generation) and the LangChain framework. Designed to provide multimodal support—text, image, and document-based inputs—it aims to assist medical personnel and individuals in remote areas.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published