Drowsiness Detection System Using Computer Vision for Performance Characterization on a Raspberry Pi

Yauri R.; Castro A.; Espino R. · Proceedings of the LACCEI international Multi-conference for Engineering, Education and Technology (2026) · DOI: 10.18687/laccei2026.1.1.645

Resumen

There is a need to monitor individuals performing critical tasks who are affected by drowsiness or fatigue using computer vision detection processes on embedded devices, but this presents a challenge due to the use of complex processing hardware. Previous research describes how embedded devices and microcontrollers perform drowsiness detection tasks using algorithms optimized for limited resources. Additionally, facial recognition methods, such as Haar Cascades or convolutional neural networks, are used to identify fatigue based on facial features. This research implements a computer vision-based drowsiness detection system that calculates facial metrics on a Raspberry Pi 4, using MediaPipe and OpenCV tools, integrating an ESP32 module for MQTT alerts, and a remote monitoring platform with Node-RED. The system recorded an average processing time per frame of 129.08 ms, with increases during drowsiness events (eye closure at 270 ms and yawning at 230 ms). Furthermore, the analysis on the Raspberry Pi showed a maximum CPU usage value of 52% without saturating this computational resource. The results indicate that it is possible to detect drowsiness and yawning states, characterizing their computational performance, although it has limitations due to the camera resolution and processing time.

Instituciones: Universidad Tecnológica del Perú