Skip to content

Repository files navigation

HackTCNJ2024


SignWaver is a background application that leverages hand gestures and voice commands to control the Windows OS. Users can control various aspects of their system through intuitive gestures. The application recognizes dynamic hand gestures to select actions such as opening specific applications using voice commands. Additionally, users can adjust system settings like volume and brightness through hand gestures. For example moving the gesture of the hand shape V upward increases the systems volume! It also enables keyboard and mouse free web browsing by supporting gestures for opening opening, closing and navigating between tabs. The application also supports scrolling, audio muting, and text entry all through voice commands and hand gestures. Furthermore, it includes a sophisticated deep learning image processing feature, allowing users to take "snapshots" of their current screen and generate descriptive text from the images, allowing for further interaction based on the content scanned.


Authors:

Created by: Christopher Lam, Benjamin Guerrieri

Chris Ben
LinkedIn Badge LinkedIn Badge

Usage:

To use, run the driver.py script

GESTURE MAPPING:

About

Code for 2024 Hack

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages