Skip to content

It is a combination of all the gesture controlled features like mouse control using hand gestures, keyboard control, pomodoro timer, PPT control, Slides Control, Zoom in and out, Text extraction, photo clicking based on gestures, screenshot and screen-recording too!!

Notifications You must be signed in to change notification settings

THE-DEEPDAS/Gesture-Control-Suite

Repository files navigation

Gesture-Controlled Suite: An Intuitive Hands-Free Interaction System

View on GitHub

Overview

The Gesture-Controlled Suite provides a hands-free, gesture-driven experience to control various computer functions, enhancing productivity and accessibility. With intuitive hand gestures, users can seamlessly perform tasks like screen recording, taking screenshots, text extraction, and more, including controlling presentations and typing on a virtual keyboard—without the need for traditional input devices.

This suite is designed for anyone looking to redefine their interaction with technology, including professionals, students, and users with accessibility needs. The Gesture-Controlled Suite brings advanced gesture recognition to make human-computer interaction more natural, efficient, and engaging.


Key Applications

1. Gesture-Based Computer Control System

  • Features: Screen recording, screenshot capture, webcam photo capture with brightening, and real-time text extraction (OCR).
  • Description: Allows for easy, gesture-based control over computer functions, eliminating the need for keyboard shortcuts or mouse actions.

2. Presentation Control (PPT Control) 🖥️

  • Features: Control PowerPoint presentations with gestures to move slides forward, backward, or stop the presentation.
  • Description: Enables users to seamlessly control their presentations without touching the keyboard or mouse, ideal for a professional, hands-free presentation experience.

3. Virtual Keyboard Using Gestures ⌨️

  • Features: A gesture-driven virtual keyboard allowing typing on the screen with specific hand movements.
  • Description: Provides an alternative input method for typing, using hand gestures to select characters, improving accessibility and enabling users to type without a physical keyboard.

4. Google Meet Panic Button 🚨

  • Features: Emotion detection to identify signs of panic, anger, or fear, automatically disabling the camera during stressful situations.
  • Description: The Panic Button tool detects facial expressions and automatically turns off the camera in Google Meet if negative emotions like panic or fear are detected. It ensures privacy and control during intense virtual meetings, giving users a discreet escape from overwhelming situations.

Project Motivation ✨

Traditional interaction methods are increasingly insufficient for the flexible needs of modern digital users. The Gesture-Controlled Suite aims to introduce intuitive, natural interaction methods through advanced gesture recognition, fostering a more engaging experience that reduces the dependence on physical input devices. This suite is particularly valuable in scenarios requiring hands-free operation or enhanced accessibility.


Demo Video 🎬

Explore the Gesture-Controlled Suite in action! Watch a demo showcasing the suite's key features, including gesture-controlled screen recording, virtual keyboard, and presentation control:

Watch the Demo Video on Google Drive


Installation Guide 🚀

Follow these steps to set up the Gesture-Controlled Suite:

  1. Clone the Repository

    git clone https://github.com/THE-DEEPDAS/Gesture-Control-Suite
    cd Gesture-Control-Suite
  2. Install Required Dependencies Ensure Python and necessary libraries (such as OpenCV and mediapipe) are installed.

  3. Run the Application

    python main.py

Future Scope

This project provides a foundation for further advancements in gesture-based human-computer interaction, with potential applications in accessibility, augmented reality, and remote operation. Future work could explore additional gestures, improve gesture recognition accuracy, and expand functionalities.


Contributing

Contributions are welcome! Please fork the repository, create a new branch for your changes, and submit a pull request.


License

This project is licensed under the MIT License.


About

It is a combination of all the gesture controlled features like mouse control using hand gestures, keyboard control, pomodoro timer, PPT control, Slides Control, Zoom in and out, Text extraction, photo clicking based on gestures, screenshot and screen-recording too!!

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages