Car-Driver Drowsiness Monitoring by Multi-layers Deep Learning Framework and Motion Analysis

  • Francesco RundoEmail author
  • Sabrina Conoci
  • Francesca Trenta
  • Sebastiano Battiato
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 629)


Recent developments in the automotive industry have led to an interest in monitoring car driver drowsiness. The purpose is to develop an efficient system for the detection of bad psychophysical states in order to reduce the number of fatigue-related car accidents. Much of the current literature pays particular attention to the study of physiological signals to obtain information about cardiac activity by measuring the Heart Rate Variability (HRV). In fact, the HRV represents a useful indicator for evaluating physiological stress because it provides information about the cardiovascular system activity controlled by the Autonomic Nervous system. The present study is designed to analyze the skin micro-movements caused by blood pressure by extracting facial landmarks in order to reconstruct the photoplethysmogram (PPG) signal in a robust way. To conclude, we obtained evidence from the validation results to support the idea that the PPG signal detected by sensors and the reconstructed PPG by using facial landmarks are strongly correlated.


Machine learning LSTM Driver-drowsiness 


  1. 1.
  2. 2.
    Melo HM, Nascimento LM, Takase E (2017) Mental fatigue and heart rate variability (HRV): the time-on-task effect. Psychol Neurosci 10:428–436CrossRefGoogle Scholar
  3. 3.
    Rundo F, Ortis A, Battiato S, Conoci S (2018) Advanced bio-inspired system for noninvasive cuff-less blood pressure estimation from physiological signal analysis. Computation 6:46CrossRefGoogle Scholar
  4. 4.
    Zhang W, Cheng B, Lin Y (2012) Driver drowsiness recognition based on computer vision technology. Tsinghua Sci Technol 17:354–362CrossRefGoogle Scholar
  5. 5.
    Haq ZA, Hasan Z (2016) Eye-blink rate detection for fatigue determination. In: 1st India international conference on information processing (IICIP), Delhi, India, pp 1–5Google Scholar
  6. 6.
    Xu YJ, Ding F, Wu Z, Wang J, Ma Q, Chon K, Clancy E, Qin M, Mendelson Y, Fu N, Assad S, Jarvis S, Huang X (2012) Drowsiness control center by photoplythesmogram. In: Proceedings of 38th annual northeast bioengineering conference (NEBEC), Philadelphia, USA, pp 430–431Google Scholar
  7. 7.
    Koh S, Cho BR, Lee J-I, Kwon S-O, Lee S, Lim JB, Lee SB, Kweon H-D (2017) Driver drowsiness detection via PPG biosignals by using multimodal head support. In: Proceedings of the 4th international conference on control, decision and information technologies (CoDIT), Barcelona, Spain, pp 383–388Google Scholar
  8. 8.
    Wu H-Y, Rubinstein M, Shih E, Guttag J, Durand F, Freeman WT (2012) Eulerian video magnification for revealing subtle changes in the world. ACM Trans Graph 31:1–8CrossRefGoogle Scholar
  9. 9.
    Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780CrossRefGoogle Scholar
  10. 10.
    Lecun Y, Bengio Y (1995) Convolutional networks for images, speech, and time-series. In: The handbook of brain theory and neural networksGoogle Scholar
  11. 11.
    Kazemi V, Sullivan J (2014) One millisecond face alignment with an ensemble of regression trees. In: 2014 IEEE conference on computer vision and pattern recognition, Columbus, USA, pp 1867–1874Google Scholar
  12. 12.
    Mazzillo M, Maddiona L, Rundo F, Sciuto A, Libertino S, Lombardo S (2018) Characterization of SiPMs With NIR long-pass interferential and plastic filters. IEEE Photonics J 10:1–12CrossRefGoogle Scholar
  13. 13.
    Rundo F, Conoci S, Banna GL, Ortis A, Stanco F, Battiato S (2018) Evaluation of Levenberg-Marquardt neural networks and stacked autoencoders clustering for skin lesion analysis, screening and follow-up. IET Comput Vis 12:957–962CrossRefGoogle Scholar
  14. 14.
    Rundo F, Ortis A, Battiato S, Conoci S (2018) Advanced bio-inspired system for noninvasive cuff-less blood pressure estimation from physiological signal analysis. Computation 6(3):46CrossRefGoogle Scholar
  15. 15.
    Rundo F, Spampinato C, Conoci S (2019) Ad-hoc shallow neural network to learn hyper filtered photoplethysmographic (PPG) signal for efficient car-driver drowsiness monitoring. Electronics (Switzerland) 8:890CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Francesco Rundo
    • 1
    Email author
  • Sabrina Conoci
    • 1
  • Francesca Trenta
    • 2
  • Sebastiano Battiato
    • 2
  1. 1.STMicroelectronics-ADG Central R&DCataniaItaly
  2. 2.IPLAB, Department of Mathematics and Computer ScienceUniversity of CataniaCataniaItaly

Personalised recommendations