Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection

Hamimah, Ujir and Min Jie, Ee and Mohammad Farhaan, Iqbal and Khai Mun, Qan and Irwandi Hipni, Mohamad Hipiny (2021) Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection. In: 2021 8th International Conference on Computer and Communication Engineering (ICCCE), 22-23 June 2021, Kuala Lumpur, Malaysia.

PDF mobile-1.pdf Download (97kB)

Abstract

The current driver's monitoring system requires a set-up that includes the usage of a variety of camera equipment behind the steering wheel. It is highly impractical in a real-world environment as the set-up might cause annoyance or inconvenience to the driver. This project proposes a framework of using mobile devices and cloud services to monitor the driver's head pose, detect angry expression and drowsiness, and alerting them with audio feedback. With the help of a phone camera functionality, the driver’s facial expression data can be collected then further analyzed via image processing under the Microsoft Azure platform. A working mobile app is developed, and it can detect the head pose, angry emotion, and drowsy drivers by monitoring their facial expressions. Whenever an angry or drowsy face is detected, pop-up alert messages and audio feedback will be given to the driver. The benefit of this mobile app is it can remind drivers to drive calmly and safely until drivers manage to handle their emotions where anger or drowsy is no longer detected. The performance of the mobile app in classifying anger emotion is achieved at 96.66% while the performance to detect driver’s drowsiness is 82.2%. On average, the head pose detection success rate across the six scenarios presented is 85.67%.

Item Type:	Proceeding (Paper)
Additional Information:	Information, Communication and Creative Technology
Uncontrolled Keywords:	driver’s monitoring, facial expression, head pose, mobile application, real-time, UNIMAS, University, Borneo, Malaysia, Sarawak, Kuching, Samarahan, IPTA, education, Universiti Malaysia Sarawak
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:	Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology Faculties, Institutes, Centres > Faculty of Computer Science and Information Technology Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology
Depositing User:	Ujir
Date Deposited:	10 Jul 2021 05:33
Last Modified:	12 Sep 2022 02:50
URI:	http://ir.unimas.my/id/eprint/35580

Available Versions of this Item

• Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection. (deposited 08 Jul 2021 07:37)
  • Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection. (deposited 10 Jul 2021 05:33) [Currently Displayed]

Actions (For repository members only: login required)

View Item