literature review on driver drowsiness detection

IEEE Account

• Change Username/Password
• Update Address

Purchase Details

• Payment Options
• Order History
• View Purchased Documents

Profile Information

• Communications Preferences
• Profession and Education
• Technical Interests
• US & Canada: +1 800 678 4333
• Worldwide: +1 732 981 0060
• Contact & Support
• About IEEE Xplore
• Accessibility
• Terms of Use
• Nondiscrimination Policy
• Privacy & Opting Out of Cookies

A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. © Copyright 2024 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Sensors (Basel)

Detecting Driver Drowsiness Based on Sensors: A Review

In recent years, driver drowsiness has been one of the major causes of road accidents and can lead to severe physical injuries, deaths and significant economic losses. Statistics indicate the need of a reliable driver drowsiness detection system which could alert the driver before a mishap happens. Researchers have attempted to determine driver drowsiness using the following measures: (1) vehicle-based measures; (2) behavioral measures and (3) physiological measures. A detailed review on these measures will provide insight on the present systems, issues associated with them and the enhancements that need to be done to make a robust system. In this paper, we review these three measures as to the sensors used and discuss the advantages and limitations of each. The various ways through which drowsiness has been experimentally manipulated is also discussed. We conclude that by designing a hybrid drowsiness detection system that combines non-intusive physiological measures with other measures one would accurately determine the drowsiness level of a driver. A number of road accidents might then be avoided if an alert is sent to a driver that is deemed drowsy.

1. Introduction

According to available statistical data, over 1.3 million people die each year on the road and 20 to 50 million people suffer non-fatal injuries due to road accidents [ 1 ]. Based on police reports, the US National Highway Traffic Safety Administration (NHTSA) conservatively estimated that a total of 100,000 vehicle crashes each year are the direct result of driver drowsiness. These crashes resulted in approximately 1,550 deaths, 71,000 injuries and $12.5 billion in monetary losses [ 2 ]. In the year 2009, the US National Sleep Foundation (NSF) reported that 54% of adult drivers have driven a vehicle while feeling drowsy and 28% of them actually fell asleep [ 3 ]. The German Road Safety Council (DVR) claims that one in four highway traffic fatalities are a result of momentary driver drowsiness [ 4 ]. These statistics suggest that driver drowsiness is one of the main causes of road accidents.

A driver who falls asleep at the wheel loses control of the vehicle, an action which often results in a crash with either another vehicle or stationary objects. In order to prevent these devastating accidents, the state of drowsiness of the driver should be monitored. The following measures have been used widely for monitoring drowsiness:

• Vehicle-based measures—A number of metrics, including deviations from lane position, movement of the steering wheel, pressure on the acceleration pedal, etc. , are constantly monitored and any change in these that crosses a specified threshold indicates a significantly increased probability that the driver is drowsy [ 5 , 6 ].
• Behavioral measures—The behavior of the driver, including yawning, eye closure, eye blinking, head pose, etc. , is monitored through a camera and the driver is alerted if any of these drowsiness symptoms are detected [ 7 – 9 ].
• Physiological measures—The correlation between physiological signals (electrocardiogram (ECG), electromyogram (EMG), electrooculogram (EoG) and electroencephalogram (EEG)) and driver drowsiness has been studied by many researchers [ 10 – 14 ].

Other than these three, researchers have also used subjective measures where drivers are asked to rate their level of drowsiness either verbally or through a questionnaire. The intensity of drowsiness is determined based on the rating [ 15 , 16 ].

These methods have been studied in detail and the advantages and disadvantages of each have been discussed. However, in order to develop an efficient drowsiness detection system, the strengths of the various measures should be combined into a hybrid system.

The organization of this paper is as follows: Section 2 discusses driver drowsiness in detail. Section 3 describes the simulated environment for drowsiness manipulation and Section 4 analyses the various methods of drowsiness manipulation for study purposes. Section 5 describes the different methods that have been studied for detecting driver drowsiness, Section 6 discusses on driving conditions and hybrid measures, and Section 7 concludes by presenting the benefit of fusing various measures to develop an efficient system.

2. Defining Drowsiness

The term “drowsy” is synonymous with sleepy, which simply means an inclination to fall asleep. The stages of sleep can be categorized as awake, non-rapid eye movement sleep (NREM), and rapid eye movement sleep (REM). The second stage, NREM, can be subdivided into the following three stages [ 17 ]:

• Stage I: transition from awake to asleep (drowsy)
• Stage II: light sleep
• Stages III: deep sleep

In order to analyze driver drowsiness, researchers have mostly studied Stage I, which is the drowsiness phase. The crashes that occur due to driver drowsiness have a number of characteristics [ 18 ]:

• Occur late at night (0:00 am–7:00 am) or during mid-afternoon (2:00 pm–4:00 pm)
• Involve a single vehicle running off the road
• Occur on high-speed roadways
• Driver is often alone
• Driver is often a young male, 16 to 25 years old
• No skid marks or indication of braking

In relation to these characteristics, the Southwest England and the Midlands Police databases use the following criteria to identify accidents that are caused by drowsiness [ 5 ]:

• Blood alcohol level below the legal driving limit
• Vehicle ran off the road or onto the back of another vehicle
• No sign of brakes being applied
• Vehicle has no mechanical defect
• Good weather conditions and clear visibility
• Elimination of “speeding” or “driving too close to the vehicle in front” as potential causes
• The police officer at the scene suspects sleepiness as the primary cause

Statistics derived using these criteria cannot account fully for accidents caused by drowsiness because of the complexity involved; therefore, accidents that can be attributed to driver drowsiness may be more devastating than the statistics reveal. Hence, in order to avoid these types of accidents, it is necessary to derive effective measures to detect driver drowsiness and alert the driver.

3. Simulated Environment for Drowsiness Manipulation

It is not safe and ethical to make a drowsy driver drive on road. Hence, researchers have used simulated environments to carry out their experiments. Experimental control, efficiency, low cost, safety, and ease of data collection are the main advantages of using simulators [ 19 , 20 ]. The driving simulators can be broadly classified as: (1) Low-level simulators ( Figure 1(a) ) consisting of a computer, a monitor, a realistic cockpit, a steering wheel, manual gear box and pedals (clutch, brake and accelerator); (2) Mid-level (Fixed-base) simulators ( Figure 1(b) ) comprising of advanced imaging techniques, a large projection screen, a realistic car, and possibly a simple motion base and (3) High-level (Motion-based) simulators ( Figure 1(c) ) typically providing a view close to 360° and an extensive moving base [ 21 ].

( a ) MiniSim; ( b ) NADS 2; ( c ) NADS 1. Reproduced with permission from (Mini Sim: http://news-releases.uiowa.edu/2010/april/041210mini-sim.html ; NADS 1: http://www.popsci.com/cars/gallery/2009-07/nads-1-worlds-most-advanced-driving-sim ; NADS 2: http://www.nads-sc.uiowa.edu/sim_nads2.php ).

One important limitation of using driving simulators is that the drivers do not perceive any risk. The awareness of being immersed in a simulated environment might give a behavior which is different than that on real road [ 22 ]. However, researchers have validated that driving simulators can create driving environment that are relatively similar to road experiments [ 23 – 25 ]. Researchers have observed behavioral [ 20 , 23 ], vehicle based [ 6 ] and physiological [ 24 ] similarity between simulated and on road experiments.

4. Drowsiness Manipulation for Study Purposes

One of the challenges in developing an efficient drowsiness detection system is how to obtain proper drowsiness data. Due to safety reasons, drowsiness cannot be manipulated in a real environment; thus, the drowsiness detection system has to be developed and tested in a laboratory setting. However, in a laboratory setting, the most reliable and informative data that pertains to driver drowsiness relies only on the way in which the driver falls into the drowsy state.

Driver drowsiness mainly depends on: (i) the quality of the last sleep; (ii) the circadian rhythm (time of day) and (iii) the increase in the duration of the driving task [ 11 , 26 , 27 ]. In some research experiments, the subjects were fully deprived of sleep, whereas they were only partially deprived of sleep in others [ 28 ]. In addition, some researchers recruited night shift workers as their subjects; in these cases, the subjects were totally deprived of sleep because the experiments were conducted in the morning [ 26 , 28 ]. Kokonozi et al. conducted an experiment in which they monitored the participants for 24 h before the experiment began to ensure that they were completely sleep-deprived [ 11 ]. In certain experiments, researchers partially deprived the subjects of sleep by allowing them to sleep for less than 6 h [ 14 ]. Peters et al. studied the same subjects during four consecutive days and considered the effects of no sleep deprivation, partial sleep deprivation and total sleep deprivation on their drowsiness level. They observed that, even in the case of partial sleep deprivation, the subjects tend to get drowsy after some time. Hence, the quality of the last sleep is an important criteria that influences drowsiness [ 29 ].

The performance of the driver deteriorates when physiological activity diminishes [ 30 ]. A circadian rhythm is used to refer to any biological variations or rhythms that occur in a cycle of approximately 24 h. These rhythms are self-sustaining ( i.e. , free running) and will persist even when the organism is placed in an environment devoid of time cues, such as constant light or constant darkness [ 27 ]. Recent statistics from countries such as the United Kingdom, the United States, Israel, Finland, and France indicate that an increased number of vehicle accidents caused by driver drowsiness occurred during the peak drowsiness periods of 2:00 am to 6:00 am and 2:00 pm to 4:00 pm. During these time frames, the circadian rhythm shows higher chance of getting drowsy and drivers are three times more likely to fall asleep at these times than at 10:00 am or at 7:00 pm [ 31 ]. Liu et al. pointed out that the circadian rhythm produces small, but significant, changes in vehicle-based measures [ 5 ]. Researchers have asked subjects to drive between 2:30 pm and 5:30 pm in order to monitor drowsiness by measuring eyelid movement, ECG and EEG [ 14 ].

The duration of the driving task also plays a major role in influencing drowsiness. Otamani et al. found that sleep deprivation alone does not directly influence the brain signals that control drowsiness, whereas the duration of task has a strong influence [ 32 ]. Researchers have also inferred that prolonged driving on a monotonous environment stimulates drowsiness. In fact, it has been observed that the subjects can become drowsy within 20 to 25 min of driving [ 33 ]. This last finding, reported by Philip et al. , contradicts the observation made by Thiffault et al. that, in a real environment, the duration of the drive does not impact the performance during the first two hours [ 15 ]. In addition, researchers have found that drowsiness-related crashes are more probable in a monotonous environment than in a stimulating environment.

Therefore, there is a very high probability that a partially sleep-deprived driver will become drowsy when driving in a monotonous environment at a constant speed for three hours during a time when their circadian rhythm is low. This should be taken into consideration when designing an experiment relating to recording driver drowsiness.

5. Methods for Measuring Drowsiness

Researchers have used various methods to measure driver drowsiness. This section provides a review of the four most widely-used methods, among which the first method is measured either verbally or through questionnaire and the remaining three by means of various sensors.

5.1. Subjective Measures

Subjective measures that evaluate the level of drowsiness are based on the driver’s personal estimation and many tools have been used to translate this rating to a measure of driver drowsiness. The most commonly used drowsiness scale is the Karolinska Sleepiness Scale (KSS), a nine-point scale that has verbal anchors for each step, as shown in Table 1 [ 32 ]. Hu et al. measured the KSS ratings of drivers every 5 min and used it as a reference to the EoG signal collected [ 28 ]. Portouli et al. evaluated EEG data by confirming driver drowsiness through both a questionnaire and a licensed medical practitioner [ 34 ]. Some researchers compared the self-determined KSS, which was recorded every 2 min during the driving task, with the variation of lane position (VLP) and found that these measures were not in agreement [ 35 ]. Ingre et al. determined a relationship between the eye blink duration and the KSS collected every 5 min during the driving task [ 26 ].

Karolinska sleepiness scale (KSS).

Researchers have determined that major lane departures, high eye blink duration and drowsiness-related physiological signals are prevalent for KSS ratings between 5 and 9 [ 26 ]. However, the subjective rating does not fully coincide with vehicle-based, physiological and behavioral measures.

Because the level of drowsiness is measured approximately every 5 min, sudden variations cannot be detected using subjective measures. Another limitation to using subjective ratings is that the self-introspection alerts the driver, thereby reducing their drowsiness level. In addition, it is difficult to obtain drowsiness feedback from a driver in a real driving situation. Therefore, while subjective ratings are useful in determining drowsiness in a simulated environment, the remaining measures may be better suited for the detection of drowsiness in a real environment.

5.2. Vehicle-Based Measures

Another method to measure driver drowsiness involves vehicle-based measurements. In most cases, these measurements are determined in a simulated environment by placing sensors on various vehicle components, including the steering wheel and the acceleration pedal; the signals sent by the sensors are then analyzed to determine the level of drowsiness. Liu et al. [ 5 ] published a review on current vehicle-based measures. Some researchers found that sleep deprivation can result in a larger variability in the driving speed [ 36 ]. However, the two most commonly used vehicle-based measures are the steering wheel movement and the standard deviation of lane position.

Steering Wheel Movement (SWM) is measured using steering angle sensor and it is a widely used vehicle-based measure for detecting the level of driver drowsiness [ 32 , 33 , 36 ]. Using an angle sensor mounted on the steering column, the driver’s steering behavior is measured. When drowsy, the number of micro-corrections on the steering wheel reduces compared to normal driving [ 37 ]. Fairclough and Graham found that sleep deprived drivers made fewer steering wheel reversals than normal drivers [ 36 ]. To eliminate the effect of lane changes, the researchers considered only small steering wheel movements (between 0.5° and 5°), which are needed to adjust the lateral position within the lane [ 32 ]. Hence, based on small SWMs, it is possible to determine the drowsiness state of the driver and thus provide an alert if needed. In a simulated environment, light side winds that pushed the car to the right side of the road were added along a curved road in order to create variations in the lateral position and force the drivers to make corrective SWMs [ 33 ]. Car companies, such as Nissan and Renault, have adopted SWMs but it works in very limited situations [ 38 ]. This is because they can function reliably only at particular environments and are too dependent on the geometric characteristics of the road and to a lesser extent on the kinetic characteristics of the vehicle [ 38 ].

Standard Deviation of Lane Position (SDLP) is another measure through which the level of driver drowsiness can be evaluated [ 26 ]. In a simulated environment, the software itself gives the SDLP and in case of field experiments the position of lane is tracked using an external camera. Ingre et al. conducted an experiment to derive numerical statistics based on SDLP and found that, as KSS ratings increased, SDLP (meters) also increased [ 26 ]. For example, KSS ratings of 1, 5, 8, and 9 corresponded to SDLP measurements of 0.19, 0.26, 0.36 and 0.47, respectively. The SDLP was calculated based on the average of 20 participants; however, with some drivers, the SDLP did not exceeded 0.25 m even for a KSS rating of 9. In the above experiment by performing correlation analysis on a subject to subject basis significant difference is noted. Another limitation of SDLP is that it is purely dependent on external factors like road marking, climatic and lighting conditions. In summary, many studies have determined that vehicle-based measures are a poor predictor of performance error risk due to drowsiness. Moreover, vehicular-based metrics are not specific to drowsiness. SDLP can also be caused by any type of impaired driving, including driving under the influence of alcohol or other drugs, especially depressants [ 39 – 41 ].

5.3. Behavioral Measures

A drowsy person displays a number of characteristic facial movements, including rapid and constant blinking, nodding or swinging their head, and frequent yawning [ 7 ]. Computerized, non-intrusive, behavioral approaches are widely used for determining the drowsiness level of drivers by measuring their abnormal behaviors [ 42 ]. Most of the published studies on using behavioral approaches to determine drowsiness, focus on blinking [ 43 – 45 ]. PERCLOS (which is the percentage of eyelid closure over the pupil over time, reflecting slow eyelid closures, or “droops”, rather than blinks) has been analyzed in many studies [ 8 , 46 – 48 ]. This measurement has been found to be a reliable measure to predict drowsiness [ 46 ] and has been used in commercial products such as Seeing Machines [ 49 ] and Lexus [ 50 ]. Some researchers used multiple facial actions, including inner brow rise, outer brow rise, lip stretch, jaw drop and eye blink, to detect drowsiness [ 9 , 42 ]. However, research on using other behavioral measures, such as yawning [ 51 ] and head or eye position orientation [ 52 , 53 ], to determine the level of drowsiness is ongoing ( Table 2 ).

List of previous works on driver drowsiness detection using behavioral measures.

The main limitation of using a vision-based approach is lighting. Normal cameras do not perform well at night [ 43 ]. In order to overcome this limitation, some researchers have used active illumination utilizing an infrared Light Emitting Diode (LED) [ 43 ]. However, although these work fairly well at night, LEDs are considered less robust during the day [ 54 ]. In addition, most of the methods have been tested on data obtained from drivers mimicking drowsy behavior rather than on real video data in which the driver gets naturally drowsy. Mostly, image is acquired using simple CCD or web camera during day [ 55 ] and IR camera during night [ 56 ] at around 30 fps. After capturing the video, some techniques, including Connected Component Analysis, Cascade of Classifiers or Hough Transform, Gabor Filter, Haar Algorithm are applied to detect the face, eye or mouth [ 8 , 42 , 44 , 56 ]. After localizing the specific region of interest within the image, features such as PERCLOS, yawning frequency and head angle, are extracted using an efficient feature extraction technique, such as Wavelet Decomposition, Gabor Wavelets, Discrete Wavelet Transform or Condensation Algorithm [ 7 , 42 , 44 , 56 ]. The behavior is then analyzed and classified as either normal, slightly drowsy, highly drowsy through the use of classification methods such as support vector machine, fuzzy classifier, neural classifier and linear discriminant analysis [ 7 , 42 – 44 ]. However, it has been found that the rate of detecting the correct feature, or the percentage of success among a number of detection attempts, varies depending on the application and number of classes. The determination of drowsiness using PERCLOS and Eye Blink has a success rate of close to 100% [ 43 ] and 98% [ 45 ], respectively. However it has to be noted that, the high positive detection rate achieved by [ 43 ] was when the subjects didn’t wear glasses. Likewise, as most researchers conducted their experiments in simulated environment they achieved a higher success rate. The positive detection rate decreased significantly when the experiment was carried out in a real environment [ 15 ].

Another limitation of behavioral measure was brought out in an experiment conducted by Golz et al. They evaluated various drowsiness monitoring commercial products, and observed that driver state cannot be correlated to driving performance and vehicle status based on behavioral measures alone [ 57 ].

5.4. Physiological Measures

As drivers become drowsy, their head begins to sway and the vehicle may wander away from the center of the lane. The previously described vehicle-based and vision based measures become apparent only after the driver starts to sleep, which is often too late to prevent an accident.

However, physiological signals start to change in earlier stages of drowsiness. Hence, physiological signals are more suitable to detect drowsiness with few false positives; making it possible to alert a drowsy driver in a timely manner and thereby prevent many road accidents.

Many researchers have considered the following physiological signals to detect drowsiness: electrocardiogram (ECG), electromyogram (EMG), electroencephalogram (EEG) and electro-oculogram (EoG) ( Table 3 ). Some researchers have used the EoG signal to identify driver drowsiness through eye movements [ 12 , 28 , 61 ]. The electric potential difference between the cornea and the retina generates an electrical field that reflects the orientation of the eyes; this electrical field is the measured EoG signal. Researchers have investigated horizontal eye movement by placing a disposable Ag-Cl electrode on the outer corner of each eye and a third electrode at the center of the forehead for reference [ 28 ]. The electrodes were placed as specified so that the parameters - Rapid eye movements (REM) and Slow Eye Movements (SEM) which occur when a subject is awake and drowsy respectively, can be detected easily [ 30 ].

List of previous works on driver drowsiness detection using physiological signals.

The heart rate (HR) also varies significantly between the different stages of drowsiness, such as alertness and fatigue [ 13 , 63 ]. Therefore, heart rate, which can be easily determined by the ECG signal, can also be used to detect drowsiness. Others have measured drowsiness using Heart Rate Variability (HRV), in which the low (LF) and high (HF) frequencies fall in the range of 0.04–0.15 Hz and 0.14–0.4 Hz, respectively [ 12 , 58 ]. HRV is a measure of the beat-to-beat (R-R Intervals) changes in the heart rate. The ratio of LF to HF in the ECG decreases progressively as the driver progresses from an awake to a drowsy state [ 14 , 58 ].

The Electroencephalogram (EEG) is the physiological signal most commonly used to measure drowsiness. The EEG signal has various frequency bands, including the delta band (0.5–4 Hz), which corresponds to sleep activity, the theta band (4–8 Hz), which is related to drowsiness, the alpha band (8–13 Hz), which represents relaxation and creativity, and the beta band (13–25 Hz), which corresponds to alertness [ 10 , 59 , 60 , 62 ]. A decrease in the power changes in the alpha frequency band and an increase in the theta frequency band indicates drowsiness. Akin et al. observed that the success rate of using a combination of EEG and EMG signals to detect drowsiness is higher than using either signal alone [ 10 ].

The measurement of raw physiological signals is always prone to noise and artifacts due to the movement that is involved with driving. Hence, in order to eliminate noise, various preprocessing techniques, such as low pass filter, digital differentiators, have been used ( Table 2 ). In general, an effective digital filtering technique would remove the unwanted artifacts in an optimal manner [ 64 ]. A number of statistical features are then extracted from the processed signal using various feature extraction techniques, including Discrete Wavelet Transform (DWT) and Fast Fourier Transform (FFT) [ 10 , 59 , 60 ]. The extracted features are then classified using Artificial Neural Networks (ANN), Support Vector Machines (SVM), Linear Discriminant Analysis (LDA), or other similar methods [ 12 , 28 , 61 ].

The reliability and accuracy of driver drowsiness detection by using physiological signals is very high compared to other methods. However, the intrusive nature of measuring physiological signals remains an issue to be addressed. To overcome this, researchers have used wireless devices to measure physiological signals in a less intrusive manner by placing the electrodes on the body and obtaining signals using wireless technologies like Zigbee [ 65 ], Bluetooth [ 66 ]. Some researchers have gone further ahead by measuring physiological signals in a non intrusive way; by placing electrodes on the steering wheel [ 67 , 68 ] or on the driver’s seat [ 67 , 69 ]. The signals obtained were then processed in android based smart phone devices [ 70 , 71 ] and the driver was alerted on time. The accuracy of a non-intrusive system is relatively less due to movement artifacts and errors that occur due to improper electrode contact. However, researchers are considering to use this because of its user friendliness. In recent years, experiments are conducted to validate non-intrusive systems [ 68 , 69 ]. The advantages and disadvantages of the different type of measures are summarized in Table 4 .

Advantages and limitations of various measures.

6. Discussion

The various measures of driver drowsiness reviewed in this work are based purely on the level of drowsiness induced in the subject, which, in turn, depends on the time of day, duration of the task and the time that has elapsed since the last sleep. However, when developing a better drowsiness detection system, several other issues need to be addressed; the two most important ones are discussed below.

6.1. Comparison of Simulated and Real Driving Conditions

It is not advisable to force a drowsy driver to drive on roads. Consequently, many experiments have been conducted in simulated environments and the results of the experiments are then elaborately studied. Dinges et al. presented various challenges involved in real time drowsiness detection [ 46 ]. The subjective self-assessment of drowsiness can only be obtained from subjects in simulated environments. In real conditions, it is unfeasible to obtain this information without significantly distracting the driver from their primary task. Some researchers have conducted experiments to confirm the validity of simulated driving environments. For example, Blana et al. observed that the mean lateral displacement of the vehicle from the center of the roadway, obtained in real and simulated environments is statistically different for speeds higher than 70 km/h. This finding implies that real-road drivers feel less safe at higher speeds and, as a result, increase their lateral distance. The drivers in a simulated environment, however, did not appear to perceive this risk [ 72 ]. Most experiments using behavioral measures are conducted in a simulated environment and the results indicate that it is a reliable method to detect drowsiness. However, in real driving conditions, the results might be significantly different because a moving vehicle can present challenges such as variations in lighting, change in background and vibration noise, not to mention the use of sunglasses, caps, etc. Philip et al. compared drowsiness in simulated and real conditions and concluded that it can be equally studied in both environments but the reaction time and the sleepiness self-evaluation are more affected in a simulated environment which provides a more monotonous task [ 15 ]. Engstorm et al. observed that the physiological workload and steering activity was higher in a real environment. This result can be interpreted as an indication of increased effort, which seems reasonable given the higher actual risk in real traffic [ 73 ]. Hence, while developing a drowsiness detection system, the simulated environment should be as close to a replica of the real environment as possible.

6.2. Hybrid Measures

Each method used for detecting drowsiness has its own advantages and limitations. Vehicle-based measures are useful in measuring drowsiness when a lack of vigilance affects vehicle control or deviation. However, in some cases, there was no impact on vehicle-based parameters when the driver was drowsy [ 26 ], which makes a vehicle-based drowsiness detection system unreliable. Behavioral measures are an efficient way to detect drowsiness and some real-time products have been developed [ 74 ]. However, when evaluating the available real-time detection systems, Lawrence et al. observed that different illumination conditions affect the reliability and accuracy of the measurements [ 74 ]. Physiological measures are reliable and accurate because they provide the true internal state of the driver; however, their intrusive nature has to be resolved. Among all physiological parameters investigated, ECG can be measured in a less intrusive manner. EEG signals require a number of electrodes to be placed on the scalp and the electrodes used for measuring EoG signals are placed near the eye which can hinder driving. Non-obtrusive physiological sensors to estimate the drowsiness of drivers are expected to become feasible in the near future [ 70 , 75 ]. The advantages of physiological measures and the increasing availability of non-intrusive measurement equipment make it beneficial to combine physiological signals with behavioral and vehicle-based measures. A sample drowsiness detection system developed by combining ECG signals, standard deviation of lane position and facial images is shown in Figure 2 .

A sample hybrid drowsiness detection system using multiple sensors.

Few research studies are attempting to detect driver drowsiness by the fusion of different methods [ 14 , 76 – 78 ]. Cheng et al. combined behavioral measures and vehicle based measures and concluded that the reliability and accuracy of the hybrid method was significantly higher than those using single sensors [ 78 ]. Guosheng et al. used a mixture of subjective, behavioral (PERCLOS) and physiological measures (ECG, EEG) to detect drowsiness and found that this combination resulted in a significantly higher success rate than any individual metric. The average square error while removing physiological features were 1.2629, while the average square error for fusion was 0.5269 [ 14 ].

Although hybrid systems using different sensors have not been tested in a real environment, it would be interesting to investigate the ability to detect drowsiness using a combination of physiological signals with other measurements.

7. Conclusions

In this paper, we have reviewed the various methods available to determine the drowsiness state of a driver. Although there is no universally accepted definition for drowsiness, the various definitions and the reasons behind them were discussed. This paper also discusses the various ways in which drowsiness can be manipulated in a simulated environment. The various measures used to detect drowsiness include subjective, vehicle-based, physiological and behavioral measures; these were also discussed in detail and the advantages and disadvantages of each measure were described. Although the accuracy rate of using physiological measures to detect drowsiness is high, these are highly intrusive. However, this intrusive nature can be resolved by using contactless electrode placement. Hence, it would be worth fusing physiological measures, such as ECG, with behavioral and vehicle-based measures in the development of an efficient drowsiness detection system. In addition, it is important to consider the driving environment to obtain optimal results.

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings
• My Bibliography
• Collections
• Citation manager

Save citation to file

Email citation, add to collections.

• Create a new collection
• Add to an existing collection

Add to My Bibliography

Your saved search, create a file for external citation management software, your rss feed.

• Search in PubMed
• Search in NLM Catalog
• Add to Search

A Review of Recent Developments in Driver Drowsiness Detection Systems

Affiliations.

• 1 Department of Computer Science and Engineering, American University of Ras Al Khaimah, Ras Al Khaimah 72603, United Arab Emirates.
• 2 Department of Electrical, Electronics and Communications Engineering, American University of Ras Al Khaimah, Ras Al Khaimah 72603, United Arab Emirates.
• PMID: 35271215
• PMCID: PMC8914892
• DOI: 10.3390/s22052069

Continuous advancements in computing technology and artificial intelligence in the past decade have led to improvements in driver monitoring systems. Numerous experimental studies have collected real driver drowsiness data and applied various artificial intelligence algorithms and feature combinations with the goal of significantly enhancing the performance of these systems in real-time. This paper presents an up-to-date review of the driver drowsiness detection systems implemented over the last decade. The paper illustrates and reviews recent systems using different measures to track and detect drowsiness. Each system falls under one of four possible categories, based on the information used. Each system presented in this paper is associated with a detailed description of the features, classification algorithms, and used datasets. In addition, an evaluation of these systems is presented, in terms of the final classification accuracy, sensitivity, and precision. Furthermore, the paper highlights the recent challenges in the area of driver drowsiness detection, discusses the practicality and reliability of each of the four system types, and presents some of the future trends in the field.

Keywords: biological-based measures; driver drowsiness detection; hybrid-based measures; image-based measures; vehicle-based measures.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Driver drowsiness detection measures.

Driver drowsiness detection systems data…

Driver drowsiness detection systems data flow.

Similar articles

• A hybrid approach for driver drowsiness detection utilizing practical data to improve performance system and applicability. Khanehshenas F, Mazloumi A, Nahvi A, Nickabadi A, Sadeghniiat K, Rahimiforoushani A, Aghamalizadeh A. Khanehshenas F, et al. Work. 2024;77(4):1165-1177. doi: 10.3233/WOR-230179. Work. 2024. PMID: 38007634
• System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures. Bajaj JS, Kumar N, Kaushal RK, Gururaj HL, Flammini F, Natarajan R. Bajaj JS, et al. Sensors (Basel). 2023 Jan 23;23(3):1292. doi: 10.3390/s23031292. Sensors (Basel). 2023. PMID: 36772333 Free PMC article.
• Electroencephalogram-Based Approaches for Driver Drowsiness Detection and Management: A Review. Li G, Chung WY. Li G, et al. Sensors (Basel). 2022 Jan 31;22(3):1100. doi: 10.3390/s22031100. Sensors (Basel). 2022. PMID: 35161844 Free PMC article. Review.
• Trends and Future Prospects of the Drowsiness Detection and Estimation Technology. Arakawa T. Arakawa T. Sensors (Basel). 2021 Nov 27;21(23):7921. doi: 10.3390/s21237921. Sensors (Basel). 2021. PMID: 34883924 Free PMC article. Review.
• The detection of drowsiness using a driver monitoring system. Schwarz C, Gaspar J, Miller T, Yousefian R. Schwarz C, et al. Traffic Inj Prev. 2019;20(sup1):S157-S161. doi: 10.1080/15389588.2019.1622005. Traffic Inj Prev. 2019. PMID: 31381433
• Persona-PhysioSync AV: Personalized Interaction through Personality and Physiology Monitoring in Autonomous Vehicles. Giron J, Sela Y, Barenboim L, Gilboa-Freedman G, Amichai-Hamburger Y. Giron J, et al. Sensors (Basel). 2024 Mar 20;24(6):1977. doi: 10.3390/s24061977. Sensors (Basel). 2024. PMID: 38544239 Free PMC article.
• Driver Drowsiness Multi-Method Detection for Vehicles with Autonomous Driving Functions. Beles H, Vesselenyi T, Rus A, Mitran T, Scurt FB, Tolea BA. Beles H, et al. Sensors (Basel). 2024 Feb 28;24(5):1541. doi: 10.3390/s24051541. Sensors (Basel). 2024. PMID: 38475079 Free PMC article.
• Effectiveness and User Perception of an In-Vehicle Voice Warning for Hypoglycemia: Development and Feasibility Trial. Bérubé C, Lehmann VF, Maritsch M, Kraus M, Feuerriegel S, Wortmann F, Züger T, Stettler C, Fleisch E, Kocaballi AB, Kowatsch T. Bérubé C, et al. JMIR Hum Factors. 2024 Jan 9;11:e42823. doi: 10.2196/42823. JMIR Hum Factors. 2024. PMID: 38194257 Free PMC article.
• Detection of Drowsiness among Drivers Using Novel Deep Convolutional Neural Network Model. Majeed F, Shafique U, Safran M, Alfarhood S, Ashraf I. Majeed F, et al. Sensors (Basel). 2023 Oct 26;23(21):8741. doi: 10.3390/s23218741. Sensors (Basel). 2023. PMID: 37960441 Free PMC article.
• DDD TinyML: A TinyML-Based Driver Drowsiness Detection Model Using Deep Learning. Alajlan NN, Ibrahim DM. Alajlan NN, et al. Sensors (Basel). 2023 Jun 18;23(12):5696. doi: 10.3390/s23125696. Sensors (Basel). 2023. PMID: 37420860 Free PMC article.
• National Highway Traffic Safety Administration Drowsy Driving. [(accessed on 10 May 2021)]; Available online: https://www.nhtsa.gov/risky-driving/drowsy-driving .
• Tefft B.C. Prevalence of Motor Vehicle Crashes Involving Drowsy Drivers, United States, 2009–2013. Citeseer; Washington, DC, USA: 2014.
• National Institutes of Health Drowsiness. [(accessed on 10 May 2021)]; Available online: https://medlineplus.gov/ency/article/003208.htm#:~:text=Drowsiness%20ref... .
• Arakawa T. Trends and future prospects of the drowsiness detection and estimation technology. Sensors. 2021;21:7921. doi: 10.3390/s21237921. - DOI - PMC - PubMed
• National Safety Council Drivers are Falling Asleep Behind the Wheel. [(accessed on 10 May 2021)]. Available online: https://www.nsc.org/road-safety/safety-topics/fatigued-driving .

Publication types

• Search in MeSH

Related information

Linkout - more resources, full text sources.

• Europe PubMed Central
• PubMed Central

Miscellaneous

• NCI CPTAC Assay Portal

• Citation Manager

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.

Lightweight YOLOv8 Networks for Driver Profile Face Drowsiness Detection

• Vision and Sensors
• Published: 19 June 2024

Cite this article

• Meng Zhang 1 &
• Fumin Zhang 2  

16 Accesses

Explore all metrics

Vision-based driver monitoring, a non-invasive method designed to identify potentially dangerous operations, has attracted increasing attention in recent years. In this study, a head pitch angle detection method was established to evaluate the driver’s drowsiness. Rather than employing the front facial landmarks to estimate head pitch angle, the proposed method measure this angel directly from driver’s profile face. To meet the requirement of real-time detection, the method applies the YOLOv8 network of single-stage detection and utilizes MobileNetV3 and FasterNet for lightweight improvement. The detector is trained with re-labeled CFP datasets, and real-time speed tests have been performed. Results demonstrate that the non-improved detector can achieve an mAP50 of 97.3% of the keypoints in a single frame, meanwhile realizing the frame rate of 30.41 FPS. After improvement, parameters of the model have been reduced by 21.3% and 40.9% respectively, while the frame rate can be increased to 37.13 FPS and 52.70 FPS, and the mAP50 of keypoints is increased by 0.41% and 0.51%. The results during the in-car experiment have proved that the developed detection method can effectively evaluate the head pitch angle, thus detect the driver’s drowsiness. We provide open-access to the annotated data and pre-trained models in this study.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Real-Time Yawn Extraction for Driver’s Drowsiness Detection

Real-time driver monitoring system with facial landmark-based eye closure detection and head pose recognition

Design and Implementation of a Drowsiness Detection System Up to Extended Head Angle Using FaceMesh Machine Learning Solution

Data availability.

The annotated data involved in this study are publicly available via Harvard dataverse. https://doi.org/10.7910/DVN/C6BPDM . Pre-trained detector models and a configuration file for training are also provided in an external file as examples. https://github.com/MengZ-tech/LIGHTWEIGHT-YOLOV8-NETWORK-FOR-DRIVER-PROFILE-FACE-DROWSINESS-DETECTION

Cai, Y., Yang, M., & Li, Z. (2015). Robust head pose estimation using a 3D morphable model. Mathematical Problems in Engineering, 2015 , 1–10.

Article   Google Scholar  

Chen, J., Kao, S. H., He, H., Zhuo, W., Wen, S., Lee, C. H., & Chan, S. H. G. (2023). Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR) .

Farooq, J., Muaz, M., Khan Jadoon, K., Aafaq, N., & Khan, M. K. A. (2023). An improved YOLOv8 for foreign object debris detection with optimized architecture for small objects. Multimedia Tools and Applications, 83 (21), 60921–60947.

Houshmand, S., Kazemi, R., & Salmanzadeh, H. (2021). A novel convolutional neural network method for subject-independent driver drowsiness detection based on single-channel data and EEG Alpha Spindles. Proceedings of the Institution of Mechanical Engineers, Part h: Journal of Engineering in Medicine, 235 (9), 1069–1078.

Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., Adam, H., & Le, Q. (2019). Searching for MobileNetV3. 2019 IEEE/CVF International Conference on Computer Vision (ICCV) .

Hu, J. (2017). Comparison of different features and classifiers for driver fatigue detection based on a single EEG channel. Computational and Mathematical Methods in Medicine, 2017 , 1–9.

Google Scholar  

Hu, J., Zhang, X., & Maybank, S. (2020). Abnormal driving detection with normalized driving behavior data: A deep learning approach. IEEE Transactions on Vehicular Technology, 69 (7), 6943–6951.

Kang, H.-B. (2013). Various approaches for driver and driving behavior monitoring: A Review. 2013 IEEE International Conference on Computer Vision Workshops.

Nam, D. H., Kim, G. P., Baek, K. H., Lee, D. S., Lee, H. Y., & Suh, M. W. (2022). Prediction of driver’s drowsiness using machine learning algorithms for minimal risk condition. International Journal of Automotive Technology, 23 (4), 917–926.

Pomerleau, D. (1995). Ralph: Rapidly adapting lateral position handler. Proceedings of the Intelligent Vehicles ’95. Symposium .

Ruiz, N., Chong, E., & Rehg, J.M. (2018). Fine-grained head pose estimation without keypoints. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) .

Saleem, A. A., Siddiqui, H. U., Raza, M. A., Rustam, F., Dudley, S., & Ashraf, I. (2022). A systematic review of physiological signals based driver drowsiness detection systems. Cognitive Neurodynamics, 17 (5), 1229–1259.

Sar, I., Routray, A., & Mahanty, B. (2023). A review on existing technologies for the identification and measurement of abnormal driving. International Journal of Intelligent Transportation Systems Research, 21 (1), 159–177.

Scarpelli, S., Alfonsi, V., Gorgoni, M., Camaioni, M., Giannini, A. M., & De Gennaro, L. (2021). Age-related effect of sleepiness on driving performance: A systematic-review. Brain Sciences, 11 (8), 1090.

Sengupta, S., Chen, J.-C., Castillo, C., Patel, V.M., Chellappa, R., & Jacobs, D.W. (2016). Frontal to profile face verification in the wild. 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) .

Sikander, G., & Anwar, S. (2019). Driver fatigue detection systems: A review. IEEE Transactions on Intelligent Transportation Systems, 20 (6), 2339–2352.

Tefft, B.C., (2010). Asleep at the wheel: The prevalence and impact of drowsy driving.

Terven, J., & Cordova-Esparza, D. (2023). A comprehensive review of YOLO: From YOLOv1 to YOLOv8 and beyond. arXiv preprint .

Wang, J., Yu, X., Liu, Q., & Yang, Z. (2019). Research on key technologies of intelligent transportation based on image recognition and anti-fatigue driving. EURASIP Journal on Image and Video Processing . https://doi.org/10.1186/s13640-018-0403-6

Werner, P., Saxen, F., & Al-Hamadi, A. (2017). Landmark based head pose estimation benchmark and method. 2017 IEEE International Conference on Image Processing (ICIP) .

Yang, S., Luo, P., Loy, C.C., & Tang, X. (2016). Wider face: A face detection benchmark. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) .

Yi, H., Liu, B., Zhao, B., & Liu, E. (2023). Small Object Detection Algorithm Based on Improved YOLOv8 for Remote Sensing. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing .

Yu, Y., Mora, K.A., & Odobez, J.-M. (2017). Robust and accurate 3D head pose estimation through 3DMM and online head model reconstruction. 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) .

Zamuner, L., Bailly, K., & Bigorgne, E. (2014). A pose-adaptive constrained local model for accurate head pose tracking. 2014 22nd International Conference on Pattern Recognition .

Zhu, X., & Ramanan, D. (2012). Face detection, pose estimation, and landmark localization in the wild. 2012 IEEE Conference on Computer Vision and Pattern Recognition .

Download references

Author information

Authors and affiliations.

School of Industrial and Information Engineering, Politecnico di Milano, 20156, Milan, Italy

Zhongda Hospital, Southeast University, Nanjing, 210000, China

Fumin Zhang

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Meng Zhang .

Ethics declarations

Conflict of interest.

The authors declare no conflict of interest and did not receive support from any organization for the submitted work.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Zhang, M., Zhang, F. Lightweight YOLOv8 Networks for Driver Profile Face Drowsiness Detection. Int.J Automot. Technol. (2024). https://doi.org/10.1007/s12239-024-00103-w

Download citation

Received : 20 July 2023

Revised : 03 April 2024

Accepted : 08 May 2024

Published : 19 June 2024

DOI : https://doi.org/10.1007/s12239-024-00103-w

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Drowsiness detection
• Facial landmarks
• Keypoint detection
• MobileNetV3
• Find a journal
• Publish with us
• Track your research

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to  upgrade your browser .

Enter the email address you signed up with and we'll email you a reset link.

• We're Hiring!
• Help Center

Driver Drowsiness Detection Based on Drivers’ Physical Behaviours: A Systematic Literature Review

Computer Engineering and Applications Journal

One of the most common causes of traffic accidents is human error. One such factor involves the drowsy drivers that do not focus on the road before them. Driver drowsiness often occurs due to fatigue in long distances or long durations of driving. The signs of a drowsy driver may be detected based on one out of three types of tests; i.e., performance test, physiological test, and behavioural test. Since the physiological and performance tests are quite difficult and expensive to implement, the behavioural test is a good choice to use for detecting early drowsiness. Behaviour-based driver drowsiness detection has been one of the hot research topics in recent years and is still increasingly developing. There are many approaches for behavioural driver drowsiness detection, such as Neural Networks, Multi Layer Perceptron, Support Vector Machine, Vander Lugt Correlator, Haar Cascade, and Eye Aspect Ratio. Therefore, this study aims to conduct a systematic literature review to elaborate o...

Related Papers

Grenze International Journal of Engineering and Technology GIJET

Drowsiness is one of the leading causes of road accidents, hence a monitoring system is required to identify drowsiness. Driver monitoring systems typically detect three sorts of data: biometric, vehicle, and driver graphic. Nowadays, several devices including navigation systems and warning alarm systems are available to help drivers. The human mistake causes numerous traffic fatalities and injuries worldwide. Drowsiness and mapping while driving is widely recognized as contributing factors to deadly car accidents. This article reviews several sleepiness detecting methods. The characteristics of these approaches are categorized and contrasted. One of them is computer vision-based picture processing. It utilizes the driver's eyes and facial gestures to identify tiredness. This survey study focuses on this strategy.

Accident; analysis and prevention

Christophe Bourdin

Not just detecting but also predicting impairment of a car driver's operational state is a challenge. This study aims to determine whether the standard sources of information used to detect drowsiness can also be used to predict when a given drowsiness level will be reached. Moreover, we explore whether adding data such as driving time and participant information improves the accuracy of detection and prediction of drowsiness. Twenty-one participants drove a car simulator for 110min under conditions optimized to induce drowsiness. We measured physiological and behavioral indicators such as heart rate and variability, respiration rate, head and eyelid movements (blink duration, frequency and PERCLOS) and recorded driving behavior such as time-to-lane-crossing, speed, steering wheel angle, position on the lane. Different combinations of this information were tested against the real state of the driver, namely the ground truth, as defined from video recordings via the Trained Obser...

International Journal of Research in Advent Technology

Desanamukula Venkata Subbaiah

2017 Pattern Recognition Association of South Africa and Robotics and Mechatronics (PRASA-RobMech)

Mkhuseli Ngxande

Advances in Mathematics: Scientific Journal

Muskan Kumar

arXiv (Cornell University)

Kamal Kassmi

Journal of Pharmaceutical Negative Results ¦ Volume 13 ¦ Special Issue 10 ¦ 2022

Jagbeer Singh

The majority of human deaths and injuries are caused by traffic accidents. A million people worldwide die each year due to traffic accident injuries, consistent with the World Health Organization. Drivers who do not receive enough sleep, rest, or who feel weary may fall asleep behind the wheel, endangering both themselves and other road users. The research on road accidents specified that major road accidents occur due to drowsiness while driving. These days, it is observed that tired driving is the main reason to occur drowsiness. Now, drowsiness becomes the main principle for to increase in the number of road accidents. This becomes a major issue in a world which is very important to resolve as soon as possible. The predominant goal of all devices is to improve the performance to detect drowsiness in real time. Many devices were developed to detect drowsiness, which depend on different artificial intelligence algorithms. So, our research is also related to driver drowsiness detection which can identify the drowsiness of a driver by identifying the face and then followed by eye tracking. The extracted eye image is matched with the dataset by the system. With the help of the dataset, the system detected that if eyes were close for a certain range, it could ring an alarm to alert the driver and if the eyes were open after the alert, then it could continue tracking. If the eyes were open then the score that we set decreased and if the eyes were closed then the score increased. This paper focus to resolve the problem of drowsiness detection with an accuracy of 80% and helps to reduce road accidents.

Inattentiveness in drivers is the major contributing factor in road crashes. Inattention can be caused by several reasons and one amongst them is fatigue. Fatigue is the subjective feeling of tiredness which is distinct from weakness. Fatigue can be defined as the state of impairment that can include physical, mental or both the elements associated with lower alertness and reduced performance. Thus performing a physical activity becomes difficult with the increasing fatigue level. Fatigue can have physical or mental causes. Alertness of a person is typically characterized by the various visual cues like eyelid movement, gaze movement, head movement and facial expressions. They can also be deduced from the driver's behaviour with the vehicle like distance maintained between vehicles, lane deviation, steering wheel control, breaking and gearing of the vehicle. Mental state of the driver can best be determined from the Electroencephalogram signals. This paper gives a brief review o...

International Journal of Advances in Engineering Architecture Science and Technology (IJAEAST)

Background: The purpose of this review paper is to develop a driver drowsiness detection system along with an alert system using deep learning techniques. The goal will be to develop a system that can accurately determine whether the driver is sleepy or not. This project uses CNN-based detection of drivers' drowsiness. Objectives: The objectives of this project are to identify the driver's drowsiness, reduce the number of accidents caused by the driver's drowsiness and provide safety to the driver early and cost-effectively. Methods: An integrated approach depends on the eye and mouth closure status (PERCLOS) along with the calculation of the new proposed vector FAR (Facial Aspect Ratio), similarly to EAR and MAR. This helps to find the status of the closed eyes or opened mouth, like yawning, and any frame that has hand gestures like nodding or covering the opened mouth with a hand, as is the innate nature of humans when trying to control sleepiness. Statistical Analysis: The CNN Yolo model algorithm is used to achieve precise results and ensure safety by preventing accidents resulting from driver drowsiness. The system includes a drowsiness detection mechanism that promptly alerts the driver to mitigate the risk of road accidents caused by drowsiness, thereby preventing potential incidents. Findings: Existing systems that rely on specific facial features, such as the ear, nose, and mouth, for drowsiness detection have limitations in accuracy. Applications: We are developing an improved system that considers all facial features for more reliable predictions. Additionally, we have integrated an alarm to alert drivers if they are becoming too drowsy. Improvements: An automatic and efficient drowsiness detection and driver mood predictionbased system is required to be implemented for real-time applications. This will help to reduce road accidents and increase people's safety.

International Journal for Research in Applied Science & Engineering Technology (IJRASET)

IJRASET Publication

We proposed to use this system to minimise the frequency of accidents caused by driver exhaustion, hence improving road safety. This device uses optical information and artificial intelligence to identify driver sleepiness automatically. We use Softmax to find, monitor, and analyse the driver's face and eyes in order to calculate PERCLOS (% of eye closure). It will also employ alcohol pulse detection to determine whether or not the person is normal. Due to extended driving durations and boredom in crowded settings, driver weariness is one of the leading causes of traffic accidents, particularly for drivers of big vehicles (such as buses and heavy trucks).

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

RELATED PAPERS

IRJET Journal

Rajesh Natarajan

International Journal for Research in Applied Science and Engineering Technology IJRASET

IJERA Journal

International Journal of Image, Graphics and Signal Processing(IJIGSP)

anis-ul-islam rafid , Amit Niloy , Atiqul Islam Chowdhury

Sensors (Basel, Switzerland)

M Murugappan

Aytul Ercil

International Journal of Scientific Research in Computer Science, Engineering and Information Technology

International Journal of Scientific Research in Computer Science, Engineering and Information Technology IJSRCSEIT

International Journal IJRITCC

International Journal of All Research Education & Scientific Methods (IJARESM)

Masum Hossain

Priyanka Sharma

Husam Al-Ameen

RELATED TOPICS

•   We're Hiring!
•   Help Center
• Find new research papers in:
• Health Sciences
• Earth Sciences
• Cognitive Science
• Mathematics
• Computer Science
• Academia ©2024

• DOI: 10.1109/ISCV49265.2020.9204306
• Corpus ID: 221916195

Literature Review on Driver’s Drowsiness and Fatigue Detection

• Hamed Laouz , Soheyb Ayad , L. Terrissa
• Published in International Symposium on… 1 June 2020
• Engineering, Psychology

Figures and Tables from this paper

8 Citations

Implementation of driver's drowsiness assistance model based on eye movements detection, drowsiness detection systems: comparison and technical criteria for industrial deployment, physiological-based driver monitoring systems: a scoping review, survey and synthesis of state of the art in driver monitoring, real-time monitoring of driver distraction: state-of-the-art and future insights., toward safer vehicular transit: implementing deep learning on single channel eeg systems for microsleep detection, "iot-based vehicle monitoring and driver assistance system framework for safety and smart fleet management", mmassist : passive monitoring of driver's attentiveness using mmwave sensors, 44 references, detection and analysis: driver state with electrocardiogram (ecg), a hybrid approach to detect driver drowsiness utilizing physiological signals to improve system performance and wearability, the monitoring method of driver's fatigue based on neural network, driver drowsiness detection: a comparison between intrusive and non-intrusive signal acquisition methods.

• Highly Influential

Detecting Driver Drowsiness Based on Sensors: A Review

Iot based real-time drowsy driving detection system for the prevention of road accidents, driver drowsiness classification using fuzzy wavelet-packet-based feature-extraction algorithm, eeg-based drowsiness estimation for safety driving using independent component analysis, automatic fatigue detection of drivers through pupil detection and yawning analysis, real-time nonintrusive detection of driver drowsiness, related papers.

Showing 1 through 3 of 0 Related Papers

Information

• Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

• Active Journals
• Find a Journal
• Proceedings Series
• For Authors
• For Reviewers
• For Editors
• For Librarians
• For Publishers
• For Societies
• For Conference Organizers
• Open Access Policy
• Institutional Open Access Program
• Special Issues Guidelines
• Editorial Process
• Research and Publication Ethics
• Article Processing Charges
• Testimonials
• Preprints.org
• SciProfiles
• Encyclopedia

Article Menu

• Subscribe SciFeed
• Recommended Articles
• Author Biographies
• Google Scholar
• on Google Scholar
• Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

E-dnet: an end-to-end dual-branch network for driver steering intention detection.

Share and Cite

Fu, Y.; Xue, H.; Fu, J.; Xu, Z. E-DNet: An End-to-End Dual-Branch Network for Driver Steering Intention Detection. Electronics 2024 , 13 , 2477. https://doi.org/10.3390/electronics13132477

Fu Y, Xue H, Fu J, Xu Z. E-DNet: An End-to-End Dual-Branch Network for Driver Steering Intention Detection. Electronics . 2024; 13(13):2477. https://doi.org/10.3390/electronics13132477

Fu, Youjia, Huixia Xue, Junsong Fu, and Zihao Xu. 2024. "E-DNet: An End-to-End Dual-Branch Network for Driver Steering Intention Detection" Electronics 13, no. 13: 2477. https://doi.org/10.3390/electronics13132477

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

Subscribe to receive issue release notifications and newsletters from MDPI journals