10 XI November 2022

https://doi.org/10.22214/ijraset.2022.47516
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 10 Issue XI Nov 2022- Available at www.ijraset.com

Driver Drowsiness Detection Using Machine

Learning
Manoj Rode1, Anirudh Bethi2, Santosh Baddam3, Bala Laxmi Prasanna Kondaveti4, Tejaswini Gadipally5, Naresh Katroth6
1, 2, 3, 4, 5, 6
Dept of ECE CMR Technical Campus

Abstract: Now-a-days many of the road accidents occurring because of driver drowsiness. It is one of the major causes of vehicle
accidents. So, prevention of this fatigue related accidents an intelligent system is need to be developed. The main idea of this
project is to develop a robust system that will detects the driver fatigue and alerts the driver and saves the lives. In this project, we
present a scheme for drowsiness detection. In this model, driver is continuously monitored through webcam or camera. And we
used OpenCV for extracting the driver face from continuous image frames of the camera. This model mainly focuses on the
Region of interest (ROI) i.e., eyes as it is the important factor to detect drowsiness. We used an algorithm to track and analyze
the blinking rate of the eyes. If the eyes are closed in more than two frames then model will detect as driver is drowsy and alerts
the driver by playing alarm sound.
Keywords: Drowsiness, Fatigue, OpenCV, ROI.

I. INTRODUCTION
For a better standard of living, development of technology allowing us to introduce more advanced solutions. Drowsiness is a state
near to sleep, where the person has strong desire for sleep. Drowsiness is dangerous in some cases where there is a need of constant
concentration while performing tasks like driving a vehicle. When a driver has sufficient fatigue then it causes drowsiness and it
leads to road accidents. According to latest statistics about 21 percent of fatal accidents are because of driver driving with drowsy.
As per the estimates of National Highway Traffic Safety Administration (NHTSA) every year 100,000 road accidents are driver
fatigue related. All latest statistics are suggesting that fatigue related accidents increasing every day. Fatigue related accidents are
occurring because of driver tiredness, lack of concentration and other climate conditions.
The development of technology for drowsiness detection and accident prevention is a major challenge. The main object of this
project is to develop a simulation of driver drowsiness detection system. The developed model mainly focuses on the open and
closed state of the eyes. This model will continuously monitor the driver eyes and detects drowsiness at very early stage and avoid
the road accident. Drowsiness detection involves analyzing of multiple image frames of face, and the observation of eyes using an
algorithm. If the eyes are closed then score will increases after it reaches threshold value then the model alerts the driver by playing
alarm sound.

II. LITERATURE SURVEY

Several experiments have been carried out over the years by different groups of researchers. Here are some of the following groups:
[1] Yaman Albadawi, Maen Takruri, Mohammed Awad has proposed a Review of Recent Developments In Driver Drowsiness
Detection Systems. This paper has presented a detailed and up-to-date review of the driver drowsiness detection systems that have
been implemented in the last ten years. It has described the four main approaches followed in designing DDD systems and
categorized them based on the type of drowsiness indicative parameters employed. These four categories are image-, biological-,
vehicle-, and hybrid-based systems. The paper has provided a detailed description of all the presented systems, in terms of the used
features, implemented AI algorithms, and datasets used, as well as the resulting system accuracy, sensitivity, and precision.
[2] Vasundhara Iyer, Atharv Vanjari, Varun Patil, Varad Ingale, Varun Gujarathi, Yogeshwari Rathod has proposed Driver
Drowsiness Detection System. In this face detector was constructed, which is based on the Histogram of Oriented Gradients (HOG).
The quantitative metric used in the proposed algorithm was the Eye Aspect Ratio (EAR) to monitor the Driver Drowsiness. The
average real-time test accuracies obtained using Dlib for Eye Detection Accuracy was found to be 80.17% and Drowsiness
Accuracy as found to be 78.50%. The results of real-time detection are lower as the model currently works well under good lighting
conditions.
[3] Venkata Rami Reddy Chirra, Srinivasulu Reddy Uyyala, Venkata Krishna Kishore Kolli has proposed Deep CNN: A Machine
Learning Approach Driver Drowsiness Detection based on eye state.

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1117
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 10 Issue XI Nov 2022- Available at www.ijraset.com

This determines the state of the eye that is drowsy or non- drowsy and alert with an alarm when state of the eye is drowsy. Face and
eye region are detected using Viola-Jones detection algorithm. Stacked deep convolution neural network is developed to extract
features and used for learning phase. A SoftMax layer in CNN classifier is used to classify the driver as sleep or non-sleep.
Proposed system achieved 96.42% accuracy

III. PROPOSED SYSTEM

Our proposed system is driver drowsiness detection using machine learning which is a car safety technology that detects the driver
fatigue and alerts the driver using alarm sound. It uses OpenCV for extracting face and Region of Interest (ROI) i.e., eyes from the
sequence of images from webcam.
We used an algorithm called Eye Aspect Ratio (EAR) to the proposed model. Model provides landmarks to the both the eyes and
then by using the algorithm EAR model predicts whether the eyes or opened or closed.

Figure.3.1 Eye coordinates

EAR consists numerator as distance between upper lid and lower lid of eye and denominator of EAR consists distance from left to
right corner of the eye, by calculating the EAR ratio for both left and right eye then it takes the average EAR of the both the eyes
then in the next step compare with the threshold value of the EAR i.e.., 0.25. If the EAR is greater than the threshold value then the
system alerts driver by ringing the alarm sound else if EAR less than threshold value then again start monitoring the driver through
webcam such that, this proposed system will help in preventing the fatigue related road accidents.

Figure.3.2 Architecture of the Model

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1118
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 10 Issue XI Nov 2022- Available at www.ijraset.com

IV. RESULT
Feeding real-world images into the proposed model is important to test the effectiveness of the model. Correct predictions indicate
that the model is reliably integrated with designing a real-world application for classifying facial recognition and drowsiness
detection.
In this proposed model, a performance accuracy of around 90-95% was achieved by using the Machine Learning techniques, and by
using Eye Aspect Ratio (EAR).
This indicates that the proposed model of this experiment is highly effective and provides accurate results.
The result of the Driver Drowsiness detection is shown in the figures below-

Figure.4.1 Eyes Opened

The model detected as Eyes are Open and score is zero, it indicates driver is not fatigue.

Figure.4.2 Eyes Closed

The model detected as Eyes are closed but score is less than threshold value. Alarm plays when score exceeds threshold value.

Figure.4.3 Eyes Closed and drowsiness detected

The Model detects driver is Drowsy and Score is maximum than threshold value so, plays an Alarm Sound.
Fig 2,3,4 Show the real time test case generating a score based on the time the eyes were closed and sounding an alarm when
reaching certain threshold.

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1119
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 10 Issue XI Nov 2022- Available at www.ijraset.com

V. CONCLUSION
The project has been developed in a efficient way for detecting drowsiness and alerting driver using the alarm sound to prevent the
road accidents. In this, we have trained a model for Drowsiness detection using OpenCV, Kera’s, NumPy, Pygame and used Eye
Aspect Ratio (EAR) algorithm. With the help of OpenCV we were able to capture the video feed from different sources like
webcam, video file. And detect whether a person is drowsy or not.
The model results show a high accuracy rate in identifying whether the driver is drowsy and not. The model was able to achieve
around 90-95% of performance accuracy, which is a significant achievement. Moreover, this model is also useful in whereas other
drowsy detection applications like in Military, Factories, Offices, Railways etc.

REFERENCES
[1] Yaman Albadawi, Maen Takruri, Mohmmed Awad, “A Review of Recent Developments In Driver Drowsiness Detection Systems”, 2022 Multidisciplinary
Digital Publishing Institute (MDPI), ISSN: 2205-2069, March 2022.
[2] Vasundhara Iyer,Atharv Vanjari,Varun Patil, “Driver Drowsiness Detection System”, 2021 International Journal of Engineering Research and Technolgy
(IJERT), ISSN: 2278-0181,December 2021.
[3] Luntian Mou; Chao Zhou; Pengtao Xie; Pengfei Zhao; Ramesh C. Jain; Wen Gao, "Isotropic Self-supervised Learning for Driver Drowsiness Detection with
Attention-based Multimodal Fusion", in IEEE Transactions on Multimedia, ISSN: 1941-0077, November 2021.
[4] Hafeez Ur Rehman Siddiqui, Adil Ali Saleem, Robert Brown, Bahattin Bademci, Ernesto Lee, Furqan Rustam, Sandra Dudley, “Non-Invasive Driver
Drowsiness Detection System”, 2022 Multidisciplinary Digital Publishing Institute (MDPI), ISSN: 2114-4833, July 2021.
[5] Wanghua Deng, Ruoxue Wu, “Real-Time Drover-Drowsiness Detection using facial features”,2019 IEEE Journal, ISSN: 2169-3536, September 2019
[6] R.RajaSekhar Reddy, Dr.Padmaja Pulicherla, “Driver Drowsiness Detection Using OpenCV Face Recognition”, 2019 Paideuma Journal, ISSN:0090-5674,
December 2019.
[7] Venkata Rami Reddy Chirra, Srinivasulu Reddy Uyyala, Venkata Krishna Kishore Kolli, “Deep CNN: A Machine Learning Approach Driver Drowsiness
Detection Based on Eye State”, International Information and Engineering Technology Association, Vol. 33, No. 6, pp. 461-466, December 2019.
[8] Anuva Chowdhury, Rajan Shankaran, Manolva kavalki, Md.Mokammel Haque, “ Sensor Applications and Physiological Features in Driver Drowsiness
Detection, IEEE Sensors Journal, DOI 10.1109/JSEN.2018.2807245, April 2018.
[9] Mkhuseli Ngxande, Michael Burke, Jules-Raymond Tapamo, “Driver drowsiness detection using behavioural measures and machine Learning techniques-A
review of state-of-art techniques, ISBN: 978-1-5386-2313-8, December 2017.
[10] T. Vesselenyi, S. Moca, A. Rus, T. Mitran, B. Tataru, “Driver drowsiness detection using ANN image processing”, IOP conf. series: Materials science and
engineering, DOI: 10..1088/1757-899X/252/1/012097, November 2017.

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1120