4. DESCRIPTION
The hand gesture recognition technology described herein offers a groundbreaking
solution to the communication challenges faced by individuals wiih disabilities.
The Smart Glove stands out with its sleek design and sophisticated technology.
Joystick potentiometer attached to the fingers captures the wearer's hand gestures with
precision. A smartphone or tablet rests on the table, displaying the mobile app interface
developed using MIT App Inventor. The app‘s intuitive design features pre-recorded voice
translations and text displays, synchronized \vilh'the wearer‘s gestures in real-time.
Through graceful hand gestures facilitated by the Smart Glove and the intuitive
translations provided by the mobilenapp, communication flows effortlessly between them.
The Smart Glove helps in promoting universal communication and social inclusion
ll embodies a vision of a world where technology empowers individuals to connect
authentically and bridge the gaps that separate us.
BACKGROUND ART
The individual making hand gestures that are being recognized by the device,
possibly with ajoy stick potentiometer in hand.
The Focal point is on the interaction between the deafand dumb individual wearing
the Sman Glove and a person who is not familiar with sign language. They are engaged in
conversation, with the deafand dumb individual gesturing with the Smart Glove, and the
other person responding naturally.
The Smart Glove is showcased prominently on the hand oflhe user, highlighting its
sleek design and innovative components. It utilizes an Ariuino Nano microcomroller and
an HC-OS Bluetooth module for wireless communication with the mobile app. These
components ensure reliable data transmission between the glove and the smartphone or
tablet, enabling real—lime interpretation ofhand gestures and swift response generation.
A smanphone or tablet is shown nearby; displaying the mobile app developed using
MIT App Inventor. The app interface shows pre-recorded voice translations and text
display corresponding to the hand gestures of the deal" and dumb individual wearing the
Smart Glove. The ease of use and intuitive design of the app are emphasized. A joystick
potentiometer is depicted, illustrating its integration into the Smart Glove design. This
component helps reduce costs without compromising functionality, accessible to a wider.
NOVEL SYSTEM AND METHOD
Hardware Setup:
Mount the joystick potentiometer on the glove in a position that allows easy
manipulation by the user. Connect the X and Y outputs ofthe joystick to analog pins ofthe
Arduino Nano. Use the Arduino Nano as the main microcontroller for processing sensor
data and controlling the glove‘s functions. Connect the Bluetooth HC—OS module to the
Arduino Nano:
Connect VCC (0 5V and connect GND 10 GND and connect TX to RX(receive)
and RX to TX(transmit).
Connect the analog mnputs of the joystick potentiometer to analog input pins of
the Arduino Nano. The HC—OS module enables wireless Bluetoolh communication between
the Arduino Nano and the MIT App. Ensure the HC-OS is configured in a suimble mode
(e.g.= Serial Port Profile - SPP) for communication with the MIT App.
Software Implementation:
Write Arduino code to read the analog values from the joystick potentiometer.
Convert the analog readings into meaningful data representing hand gestures or movements.
Implement Bluetooth communication protocols to send this data 10 the MIT App. Develop
an MIT App Inventor application 10 receive data from (he Arduino Nano via Bluetooth.
Design the app interface to display visual feedback based on the received data (cg,
displaying hand gestures). Implement logic to interpret the received data and trigger appropriate actions or responses within theapp.
5.CLA1MS:
I/We Claim,
1. A gesture recognition device comprising a glove equipped
with a joystick potentiometer claims to offer a device
accurately detecting hand gestures made by individuals who
are deaf and mute.
2. WiIh reference to point l,we claim that the device is powered
using 9V battery.
L4) With reference to point 2,we claim that the device Further
comprises of an Arduino Nann microcontroller For processing
‘ the detected hand gestures and transmilling corresponding
digital signals.
4. With reference to point 3;we claim that an integrated
Bluetooth HC-OS module within the glove for establishing
wireless communication with a smanphone application.
5. With reference to point 4,we claim that a smartphone
application developed using MlT App Inventor: configured to receive signals from ‘he glove via Bluetooth and display realtime
text representations ofthe recognized hand gestures.
6. With reference to point 5,we claim that the smartphone application is (:onfigured to play pre-recorded voice messages
corresponding to the recognized hand gestures, thereby facilitating enhanced communication For individuals with hearing and speech impairments.