Facial recognition of emotions in higher level students during remote classes

Armando Tiznado Ubillus J.; Antonio Rivera Escriba L.; Florencia Mercedes Huamán Martínez M.; Betzabé Velásquez Oyola M.; Salazar-Fierro F.; Fernando Arboleda Huaman J.; Augusto Atoche Pacherres C. · Proceedings of the LACCEI international Multi-conference for Engineering, Education and Technology (2025) · DOI: 10.18687/laccei2025.1.1.1570

Resumen

During remote classes, teachers face the challenge of recognizing students' emotions, especially when their cameras are on. To address this problem, a facial detection and recognition system was developed that allowed measuring emotions in real time, providing data that can be statistically analyzed. The objective was to establish and classify the emotions expressed by students during remote classes, which allows detecting their real-time participation in the virtual environment. To obtain the best predictive model for detecting student participation in real time, different models were adjusted. Various reference data sets were used to measure the performance and accuracy of the proposed system. The results showed that the proposed system achieves accuracy on different reference sets and on the proposed data set itself. The real-time predictive classification model, modelFEC6.h5, outperforms the others with an accuracy of 94.62% for facial emotion classification in real-time virtual learning scenarios.

Instituciones: Universidad Nacional Mayor de San Marcos; Universidad Nacional de Piura; Universidad Nacional José Faustino Sánchez Carrión