Skip to main content

Detection of Drowsiness Using Fusion of Yawning and Eyelid Movements

  • Conference paper
Advances in Computing, Communication, and Control (ICAC3 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 361))

Abstract

Use of technology in building human comforts and automation is growing fast, particularly in automobile industry. Safety of human being is the major concern in vehicle automation. Statistics shows that 20% of all the traffic accidents are due to diminished vigilance level of driver and hence use of technology in detecting drowsiness and alerting driver is of prime importance. In this paper, method for detection of drowsiness based on multidimensional facial features like eyelid movements and yawning is proposed. The geometrical features of mouth and eyelid movement are processed, in parallel to detect drowsiness. Harr classifiers are used to detect eyes and mouth region. Only the position of lower lip is selected to check for drowsiness as during yawn only lower lip is moved due to downward movement of lower jaw and position of the upper lip is fixed. Processing is done only on one of the eye to analyze attributes of eyelid movement in drowsiness, thus increasing the speed and reducing the false detection. Experimental results show that the algorithm can achieve a 80% performance for drowsiness detection under varying lighting conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bergasa, L.M., Nuevo, J., Sotelo, M.A., Barea, R., Lopez, M.E.: Real-time system for monitoring driver vigilance. IEEE Transactions on Intelligent Transportation Systems 7(1), 63–77 (2006) ISSN: 1524-9050

    Article  Google Scholar 

  2. Ueno, H., Kaneda, M., Tsukino, M.: Development of drowsiness detection system. In: Proc. Vehicle Navigation and Information Systems Conf., pp. 15–20 (1994)

    Google Scholar 

  3. Lee, B.-G., Chung, W.-Y.: Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals. IEEE Sensors Journal 12, doi:10.1109/JSEN.2012.2190505

    Google Scholar 

  4. Hu, S., Zheng, G.: Driver drowsiness detection with eyelid related parameters by Support Vector Machine. Expert Systems with Applications 36, 7651–7658 (2009), doi:10.1016/j.eswa.2008.09.030

    Article  Google Scholar 

  5. Abtahi, S., Hariri, B., Shimiohammadi, S.: Driver Drowsiness Monitoring Based on Yawning Detection, 978-1-4244-7935-1/11/IEEE

    Google Scholar 

  6. Hong, T., Qin, H.: Drivers Drowsiness Detection in Embedded System, 1-4244-1266-8/07/IEEE

    Google Scholar 

  7. Liu, D., Sun, P., Xiao, Y., Yin, Y.: Drowsiness Detection Based on Eyelid Movement. In: 2010 Second International Workshop on Education Technology and Computer Science. IEEE (2010) 978-0-7695-3987-4/10, doi:10.1109/ETCS.2010.292

    Google Scholar 

  8. Flores, M.J., Armingol, J.M., de la Escalera, A.: Real-Time Drowsiness Detection System for an Intelligent Vehicle. In: 2008 IEEE Intelligent Vehicles Symposium (2008), 978-1-4244-2569-3/08/IEEE

    Google Scholar 

  9. Picot, A., Charbonnier, S., Caplier, A.: Drowsiness detection based on visual signs: blinking analysis based on high frame rate video, 978-1-4244-2833-5/10/IEEE

    Google Scholar 

  10. Smith, P., Shah, M., da Vitoria Lobo, N.: Monitoring head/eye motionfor driver alertness with one camera. In: Proc. 15th Int. Conf. Pattern Recognition, Barcelona, Spain, vol. 4, pp. 636–642 (2000)

    Google Scholar 

  11. Smith, P., Shah, M., da Vitoria Lobo, N.: Determine driver visual attention with one camera. Intelligent Transportation Systems 4, 205–218 (2003)

    Article  Google Scholar 

  12. Eskandarian, A., Mortazavi, A.: Evaluation of a Smart Algorithm for Commercial Vehicle Driver Drowsiness Detection. In: Proceedings of the 2007 IEEE Intelligent Vehicles Symposium (2007), 1-4244-1068-1/07/IEEE

    Google Scholar 

  13. Danisman, T., Bilasco, I.M., Djeraba, C., Ihaddadene, N.: Drowsy Driver Detection System Using Eye Blink Patterns, 978-1-4244-8611-3/10/IEEE

    Google Scholar 

  14. Xiong, X., Deng, L., Zhang, Y., Chen, L.: Objective Evaluation of Driver Fatigue by Using Spontaneous Pupillary fluctuation, 978-1-4244-5089-3/11/IEEE

    Google Scholar 

  15. Regan, M.A., Hallett, C., Gordon, C.P.: Driver distraction and driver inattention: Definition, relationship and taxonomy. Accident Analysis and Prevention 43, 1771–1781 (2011)

    Article  Google Scholar 

  16. Fan, X., Sun, Y., Yin, B., Guo, X.: Gabor-based dynamic representation for human fatigue monitoring in facial image sequences. Pattern Recognition Letters 31, 234–243 (2010)

    Article  Google Scholar 

  17. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 12, pp. I-511–I-518 (2001)

    Google Scholar 

  18. Intel Open Source Computer Vision Library, http://www.intel.com/technology/computing/opencv/index.htm

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hemadri, V.B., Kulkarni, U.P. (2013). Detection of Drowsiness Using Fusion of Yawning and Eyelid Movements. In: Unnikrishnan, S., Surve, S., Bhoir, D. (eds) Advances in Computing, Communication, and Control. ICAC3 2013. Communications in Computer and Information Science, vol 361. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36321-4_55

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-36321-4_55

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-36320-7

  • Online ISBN: 978-3-642-36321-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics