Mobile Application to Learn Peruvian Sign Language for People with Hearing Disabilities Using Motion Tracking

Meneses-Torres A.; Castaneda-Chambi K.; Aures-Garcia A.; Rojas F.E.G. · Proceedings of the 2024 IEEE 4th International Conference on Advanced Learning Technologies for Education and Research, ICALTER 2024 (2024) · DOI: 10.1109/icalter65499.2024.10819202

Resumen

This research describes the development of the mobile application 'enSENArte,' which aims to enhance the inclusion of people with hearing disabilities through the learning of Peruvian Sign Language (PSL) using machine learning technologies. This technology incorporates artificial intelligence for sign recognition to validate in real-time their replication in front of the mobile device's camera. Additionally, it provides feedback for learning through intuitive user interfaces and personalized practical exercises. The validation was conducted with a group of 30 users aged between 17 and 25 years, chosen for their sufficient maturity and autonomy within this age range. The results demonstrated effectiveness in promoting retention of basic PSL vocabulary.

Instituciones: Universidad Peruana de Ciencias Aplicadas