Skip to content

christopherlam1016/HackTCNJ2024

Repository files navigation

HackTCNJ2024


SignWaver is a background application that leverages hand gestures and voice commands to control the Windows OS. Users can control various aspects of their system through intuitive gestures. The application recognizes dynamic hand gestures to select actions such as opening specific applications using voice commands. Additionally, users can adjust system settings like volume and brightness through hand gestures. For example moving the gesture of the hand shape V upward increases the systems volume! It also enables keyboard and mouse free web browsing by supporting gestures for opening opening, closing and navigating between tabs. The application also supports scrolling, audio muting, and text entry all through voice commands and hand gestures. Furthermore, it includes a sophisticated deep learning image processing feature, allowing users to take "snapshots" of their current screen and generate descriptive text from the images, allowing for further interaction based on the content scanned.


Authors:

Created by: Christopher Lam, Benjamin Guerrieri

Chris Ben
LinkedIn Badge LinkedIn Badge

Usage:

To use, run the driver.py script

GESTURE MAPPING:

About

Code for 2024 Hack

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •  

Languages