Skip to content

SnapMed is a web app that identifies medicine strips using OCR and fetches key drug information like usage, dosage, and composition through a medical API. Built for accessibility, it supports multilingual output and text-to-speech, making medicine info easy to understand for all users.

License

Notifications You must be signed in to change notification settings

AwwHellNahh/Snap-Med

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

70 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

github markdown vercel

SnapMed – Identify Medicine Strips with One Click

Team Syndicate
Hack4Bengal 4.0

SnapMed is a lightweight web application that helps users identify medicines by scanning or uploading a photo of a medicine strip. The app extracts the brand name using OCR and provides key information such as usage, dosage, and side effects in a simple, user-friendly format.

Note

Features

  • Strip detection via image upload
  • OCR-based medicine name extraction
  • Drug information lookup from a trusted medical API
  • Text-To-Speech (TTS) for accessibility
  • Support for multiple languages (English, Hindi, Bengali)
  • Clean, responsive UI

Role Tech used
ML JavaScript gemini Express.js Vercel
Backend typescript NodeJS Express.js
Appwrite Vercel MariaDB
Frontend React Vite HTML5
TailwindCSS Vercel

How It Works

  1. User uploads or captures an image of a medicine strip.
  2. OCR extracts the printed brand name from the strip.
  3. The app matches the brand name with a drug information dataset.
  4. A drug info card is displayed showing:
    • Brand name and generic name
    • Usage
    • Composition
  5. Info is read aloud using TTS and shown as text.

Access the prod in

https://snap-med.vercel.app/snap

Project Structure

Snap-Med/
├── Backend/
│   ├── public/
│   ├── src/
│   ├── test/
│   ├── .gitignore
│   ├── package.json
│   ├── package-lock.json
│   ├── tsconfig.json
│   ├── todo.txt
│   └── vercel.json
│
├── Frontend/
│   ├── public/
│   ├── src/
│   ├── .gitignore
│   ├── eslint.config.js
│   ├── index.html
│   ├── package.json
│   ├── package-lock.json
│   ├── postcss.config.js
│   ├── tailwind.config.js
│   ├── todo.txt
│   ├── vercel.json
│   └── vite.config.js
│
├── ML/
│   ├── .env.exammple
│   ├── .gitignore
│   ├── package.json
│   ├── package-lock.json
│   ├── server.js
│   └── todo.txt
│
├── LICENSE
└── README.md


Use Cases

  • Elderly or rural users who cannot read complex medical text
  • Community health workers who need quick medicine info
  • Cases of medicine misuse due to confusion or lack of literacy

Important

Judging Criteria Alignment

  • Innovation: Practical AI usage in health context
  • Technical Implementation: OCR + drug data + TTS
  • Impact: Solves a real and local problem
  • UI/UX: Simple, accessible, mobile-friendly interface
  • Bonus: Uses OCR, designed for underrepresented users

Team

Team Syndicate – Hack4Bengal 4.0
Built Snap-Med to make medicine information accessible to everyone.

Member Role Branch
Debjeet Banerjee ML ML
Imon Chakraborty Backend Backend
Nilanjan Mondal Frontend Frontend




About

SnapMed is a web app that identifies medicine strips using OCR and fetches key drug information like usage, dosage, and composition through a medical API. Built for accessibility, it supports multilingual output and text-to-speech, making medicine info easy to understand for all users.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •