DROWSY DRIVER DETECTION SYSTEM – VIA FACIAL RECOGNITION AND DRIVING DATA
DOI:
https://doi.org/10.24191/mjoc.v9i2.25694Keywords:
Driving Data, Drowsy Driver Detection, Facial Recognition, Machine Learning TechniqueAbstract
According to the National Highway Traffic Safety Administration, an estimated 17.6% of all fatal crashes in the years 2017–2021 involved a drowsy driver. This study proposes a drowsy driver detection system that uses both facial recognition and vehicular data to detect if a driver is feeling sleepy behind the wheel. We aim to address a lack of works in the literature that combine data measured from the driver (image or biological data) and vehicular data for drowsy driver detection. Our primary data was collected from simulated driving sessions in which a camera was used to record test drivers’ faces while driving a virtual car in the CARLA simulator in both drowsy and non-drowsy states. The collected data consists of video of test drivers' faces from the camera and vehicular data from the simulated car. The video data was used to obtain facial features such as Mouth Over Eyes (MOE), Eyes Aspect Ratio (EAR), and Mouth Aspect Ratio (MAR), while the vehicle data yielded features such as speed, steering wheel movement and pedal readings. These features were used to train Support Vector Machine (SVM) and Random Forest (RF) models to detect drowsy drivers. The results indicate that RF is a better model to be used as compared to SVM in predictions of drowsiness in drivers with an accuracy of 96.24% and 86.85% respectively.
References
Abbas, Q. (2020). HybridFatigue: A Real-time Driver Drowsiness Detection using Hybrid Features and Transfer Learning. International Journal of Advanced Computer Science and Applications, 11(1), 585-593.
Albadawi, Y., Takruri, M., & Awad, M. (2022). A review of recent developments in driver drowsiness detection systems. Sensors, 22(5), 2069.
Anwar, S., & Sikander, G. (2019, June). Driver Fatigue Detection Systems: A Review. IEEE Transactions on Intelligent Transportation Systems, 20(6), 2339-2352.
Arefnezhad, S., Samiee, S., Eichberger, A., & Na, A. (2019, Feb). Driver Drowsiness Detection Based on Steering Wheel Data Applying Adaptive Neuro Fuzzy Feature Selection. Sensors, 19(4), 943.
Badr, W. (2019, Mar 5). 5 Ways to Detect Outliers/Anomalies That Every Data Scientist Should Know. (Medium) available at https://towardsdatascience.com/5-ways-to-detect outliersthat-every-data-scientist-should-know-python-code-70a54335a623&sa=
Bahari, N., Mohd Nusa , F., Tarudin, N., Mohamad, N., & Md Murozi, A. F. (2023). Factors contributing to road accidents: case study of Jalan Seremban-Tampin. Malaysian Journal of Computing (MJoC), 8(1), 1436-1448.
Chicco, D., Tötsch, N., & Jurman, G. (2021). The Matthews Correlation Coefficient (MCC) is more reliable than balanced accuracy, bookmaker informedness, and markedness in twoclass confusion matrix evaluation. BioData Mining, 14(1), 1-22.
Dewi, C., Chen, R., Jiang, X., & Yu, H. (2022). Adjusting eye aspect ratio for strong eye blink detection based on facial landmarks. PeerJ Computer Science, 8, e943.
Drowsy driving: Asleep at the wheel. (2022, Nov 21). Centers for Disease Control and Prevention. available at https://www.cdc.gov/sleep/features/drowsy-driving.html
Gupta, N., Rajoo, R., & Jacob, P. (2023). Driver drowsiness detection system through facial expression using Convolutional Neural Networks (CNN). Malaysian Journal of Computing (MJoC), 8(1), 1375-1387.
Jeon, Y., Kim, B., & Baek, Y. (2021, Mar). Ensemble CNN to Detect Drowsy Driving with InVehicle Sensor Data. Sensors, 21(7), 2372.
Junaedi, S., & Akbar, H. (2018). Driver Drowsiness Detection Based on Face Feature and PERCLOS. Journal of Physics: Conference Series., 1090, p.012037
Meda, H., H., Ganesh, J., J. M. P., & Sahani, A. (2021). Machine Learning Models for Drowsiness Detection”,. IEEE International Instrumentation and Measurement Technology Conference (I2MTC), (pp. 1–5).
Rivelli, E. (2022, Sept 13). Drowsy Driving Statistics and Facts 2022. (Bankrate) available at https://www.bankrate.com/insurance/car/drowsy driving-statistics/
Romera, E., Bergasa, L., & Arroyo, R. (2015). A Real-Time Multi-scale Vehicle Detection and Tracking Approach for Smartphones. 2015 IEEE 18th International Conference on Intelligent Transportation Systems, (pp. 1298-1303).
Synchrony and time-step - CARLA Simulator. (n.d.). available at https://carla.readthedocs.io/en/latest/adv_synchrony_timestep/
Tefft, B. C. (2024). Drowsy Driving in Fatal Crashes, United States, 2017–2021. Washington: Foundation for Traffic Safety available at https://aaafoundation.org/drowsy-driving-infatal crashes-united-states-2017-2021/#:~:text=Results%20show%20that%20an%20estimated%2017.6%25%20of%20all, were%20killed%20in%20crashes%20that%20involved%2 drowsy%20drivers.
'Tiny naps' While Driving Leading Cause of Road Accidents. (2022, June 25). The Star Newspaper, available at https://www.thestar.com.my/news/nation/2022/06/25/t ny-napswhile-driving-leading-cause-of-road-accidents
Tüfekci, G., Kayabaşı, A., Akagündüz, E., & Ulusoy, İ. (2022, October). Detecting driver drowsiness as an anomaly using lstm autoencoders. In European Conference on Computer Vision (pp. 549-559). Cham: Springer Nature Switzerland.
Vural, E., Cetin, M., Ercil, A., & Littlewort, G. (2007). Drowsy Driver Detection Through Facial Movement Analysis. 2007 IEEE International Conference on Human-Computer Interaction, (pp. 6-18).
Zhong, G. (2021, Jun 10). Drowsiness detection with machine learning. (Medium) available at https://towardsdatascience.com/drowsiness-detection-with-machine-learning765a16ca208a
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Nur Iman Kamila Azharudin, Hafizah Mansor, Shaila Sharmin
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
