Paper #3

Development of a Wearable Sensor Glove for Real-Time Sign Language Translation

Radzi Ambar, Safyzan Salim, Mohd Helmy Abd Wahab, Muhammad Mahadi Abdul Jamil and Tan Ching Phing

Abstract: This article describes the development of a wearable sensor glove for sign language translation and an Android-based application that can display words and produce speech of the translated gestures in real-time. The objective of this project is to enable a conversation between a deaf person and another person who does not know sign language. The glove is composed of five (5) flexible sensors and an inertial sensor. This article also elaborates the development of an Android-based application using the MIT App Inventor software that produces words and speech of the translated gestures in real-time. The sign language gestures were measured by sensors and transmitted to an Arduino Nano microcontroller to be translated into words. Then, the processed data was transmitted to the Android application via Bluetooth. The application displayed the words and produced the sound of the gesture. Furthermore, preliminary experimental results demonstrated that the glove successfully displayed words and produced the sound of thirteen (13) translated sign languages via the developed application. In the future, it is hoped that further upgrades can produce a device to assist a deaf person communicates with normal people without over-reliance on sign language interpreters.

Keywords: Android application; Sign Language Translator; Smart Glove; Speech; Wearable Technology; Words.