DESIGN AND IMPLEMENTATION OF SIGN LANGUAGE TRANSLATION USING GESTURE RECOGNITION WITH TENSORFLOW

Student: Richard Ukwu Agwupuye
Supervisor: Dr Usman Bello Abubakar
HOD: Dr Usman Idris Abubakar
Department of Computer Science
College of Science and Information Technology
Baze University, Abuja, Fct

Abstract

Communication barriers between individuals who use sign language and those who do not, create challenges in social and professional interactions. This project addresses this issue by developing a gesture recognition system integrated into a React application to translate physical gestures into words and sentences. Using TensorFlow and MediaPipe, the model identifies 26 gesture classes corresponding to the American Sign Language (ASL) alphabet, prioritizing real-time accuracy and responsiveness. The application aims to enhance accessibility and interaction, providing a seamless communication bridge through gesture translation. With applications in assistive technology and human-computer interaction, this project establishes a foundation for advancing gesture-based systems, fostering inclusivity and innovative interaction methods.

Full-Text Access Notice

In accordance with the NERD Policy on promoting peer-reviewed publication, public access to the full text of a project, thesis or dissertation is restricted for three years, allowing the author and supervisors sufficient time to pursue peer-reviewed publication. During this period, researchers with legitimate academic or research purposes may request authorisation directly from the author to enable NERD to release the indexed full texts of the work using the form below.

Request authorisation from the author