The first step in our project will be to explore multiple solutions to the problem of tracking, identifying, and utilizing hand signals/gestures. These options will be tiered in nature such that they allow us to progress towards a final prototype before designing and making the final product for the project.
The 4 solutions or Options are laid out below:
- Option 1 – “Proof of Concept”
- use a desktop PC & webcam along with pre-trained neural networks or detection software to prove the concept and idea of this project
- this will help us identify how best to turn the signal detection into actually control signals to a monitor
- Option 2 – PAJ7620U2 3D gesture recognition Sensor
- this is a pre-programmed sensor which can detect basic hand gestures
- the challenge here is to integrate the component into a breadboard setup with something like an Arduino as a controller to take and convert outputs to a monitor for control
- Option 3 – Ultrasonic Sensors
- we plan to use 4 ultrasonic sensors as a means of testing how little info is needed to detect hand signals in an effort to increase detection time and processing lag
- this also presents a cheaper option to using cameras
- Option 4 – Raspberry Pi w/ camera
- this option is aimed at moving us towards out ultimate end goal for the project. It would allow us to use all of our new knowledge to enable fast, accurate, and customizable hand signal input to a greater extent than the option options and provides a great starting point for a final prototype