Signify
Signify aims to create an interactive computer app that teaches users the basics of sign language through an intuitive interface, real-time gesture recognition, enjoyable form of game, and personalized progress tracking. The app is designed to bridge communication gaps by enabling users to learn and practice sign language quickly and effectively. The primary user cases include browsing sign language information, engaging in practice and interactive games, and monitoring learning progress.
Features
- Real-time gesture detection with YOLO model
- Cross-language support with TCP-based communication
- Interactive GUI with Qt
- Creative Gamification Features
Installation
Downloading the Already-Built Executable Files
Download the source code and already-built executable files directly from here.
Open ...\build\Desktop_Qt_6_5_3_MinGW_64_bit-Profile\release\Signify.exe directly to see the interface.
Recommended Prerequisites (Our Environment)
- Python 3.12.5
- pip
- OpenCV, Ultralytics YOLO, and other dependencies
- Qt 6.5.3 MinGW_64 QMake
- Linus or Windows System (MacOS has a different protocol in opening the camera?)
Model tree for Koalephant/Signify
Base model
Ultralytics/YOLOv8