Ensuring accessible communication is a way to improve the quality of life for all. To make this goal more attainable, the IEEE CS Karachi Section at the University of Karachi Student Branch as well as the IEEE Educational Activities Khi Section have teamed up with the Pakistan Disabled Foundation to create a Smart Glove to reduce the communication barrier between those who use sign language and those who do not.
The Smart Glove is meant to act as a translator, turning sign language into audible speech to pave the way for easy communication. The glove is to be worn by someone that uses sign language. The device tracks finger and hand movements and uses a Python script to translate the words into corresponding English. Although everyone’s hands are different, the glove is designed to adapt. The gloves have sensors that are read by a Raspberry Pi microcontroller. The words that the user signs are translated into text and then spoken through the device. The device learns sign language through images and video.
The Smart Glove is to be developed with sizes for adults and children. With a series of learning models, the phrases said by those who use sign language will be translated. This can help in educational environments, as a general conversational tool, and even between parents and children.
This project was made possible through a grant of $4000.00 as a part of EPICS in IEEE’s Access and Abilities Competition.