AN IMPROVED OBJECT RECOGNITION SYSTEM FOR VISUALLY IMPAIRED PEOPLE WITH AUDIO FEEDBACK

Student: Daniel Oluwagbemiga Ola-Daniel
Supervisor: Dr Temilola Adedamola John-Dewole
HOD: Dr Wilson Evuarherhe Sakpere
Department of Computer Science
Natural and Applied Sciences
Lead City University, Ibadan, Oyo State

Abstract

This research presents the development and evaluation of an improved object recognition system designed to assist visually impaired individuals in identifying objects in their surroundings using deep learning. The background to this study lies in the growing need for cost-effective assistive technologies that leverage artificial intelligence to improve independence and navigation for the visually impaired. Existing systems often suffer from limitations in speed, accuracy, and accessibility, especially in real-time scenarios or on low-powered devices. This project aimed to address these challenges by implementing a lightweight yet effective object detection system using the YOLOv11-nano model pre-trained on the COCO dataset. The primary objectives included deploying a real-time detection system capable of recognizing multiple object classes, generating accurate audio feedback, and optimizing performance for offline and mobile use. The system was developed using Python and OpenCV, with live camera input processed through the YOLOv11-nano model. Audio feedback was provided using text-to-speech integration to inform users of detected objects. To evaluate the system, a small dataset of real-world images was used for testing. Key performance metrics such as precision, recall, F1-score, and Intersection over Union (IoU) were calculated. The results showed a precision of 95%, accuracy of 92%, recall of 90%, F1-score of 92%, and an average IoU of 0.79, demonstrating reliable and accurate performance across varying environments. This system offers a meaningful step toward affordable and accessible visual assistance tools, particularly for offline or mobile deployment. The study concludes that YOLOv11-nano provides a strong balance of speed and accuracy, making it suitable for real-time assistive applications. Future improvements include training on local datasets to reduce misclassification and integrating more advanced audio and navigational feedback features. The research successfully fills a gap in deploying efficient, real-time object recognition systems tailored to the needs of the visually impaired community. Keywords: Object recognition, visually impaired, YOLOv11-nano, deep learning, assistive technology, real-time detection, computer vision, audio feedback, object detection, accessibility. Word Count: 300

Full-Text Access Notice

In accordance with the NERD Policy on promoting peer-reviewed publication, public access to the full text of a project, thesis or dissertation is restricted for three years, allowing the author and supervisors sufficient time to pursue peer-reviewed publication. During this period, researchers with legitimate academic or research purposes may request authorisation directly from the author to enable NERD to release the indexed full texts of the work using the form below.

Request authorisation from the author