This project is an innovative solution that allows users to control their computer system using both hand gestures and voice commands.
- Gesture-Controlled Virtual Mouse: Move the mouse, click, scroll, and drag and more.
- Voice Assistant: Perform system tasks like google search, sending whatsapp messages, file handling, system settings and more.
Click here to watch the demo video
Or preview it below:
| Gesture | Action |
|---|---|
| V Sign | Move cursor |
| V Sign → Close Index Finger | Left click |
| V Sign → Close Middle Finger | Right click |
| V Sign → Two Fingers Closed | Double click |
| Fist | Drag and drop |
| Pinch (Dominant Hand) - Horizontal | Adjust brightness |
| Pinch (Dominant Hand) - Vertical | Adjust volume |
| Pinch (Non-Dominant Hand) - Horizontal | Scroll horizontally |
| Pinch (Non-Dominant Hand) - Vertical | Scroll vertically |
| Command | Action |
|---|---|
| "Echo, what time is it?" | Tells the current time |
| "Echo, what's today's date?" | Tells the current date |
| "Echo, (search/find/look) [query]" | Searches Google for your query |
| "Echo, (open/start/launch) [application, folder]" | Opens the specified application/folder |
| "Echo, copy" | Performs copy function (Ctrl+C) |
| "Echo, paste" | Performs paste function (Ctrl+V) |
| "Echo, (open/start/launch) gesture recognition" | Activates hand gesture control |
| "Echo, (exit/terminate/stop/close) gesture recognition" | Deactivates hand gesture control |
| "Echo, (exit/terminate/stop/close)" | Closes the assistant |
| "Echo, (turn/switch)" | Turns on/off contextual search, browsing mode |
| "Echo, (send)" | send messages(whatsapp) |
Install the dependencies using:
pip install -r requirements.txt