Detection and Tracking of Driver’s Hands in Real Time

  • Raúl Crespo
  • Isaac Martín de Diego
  • Cristina Conde
  • Enrique Cabello
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6419)


In this paper a complete driver’s hands detection and tracking system suitable for working in real time conditions has been developed. The proposed system has been successfully tested in close-real world conditions in different scenarios on a very realistic and immersive cabin truck simulator. A database of 24 video sequences monitoring the driving task in different circuits, illumination conditions and video resolutions has been obtained. The hands detection rate and the computational times needed to process each frame are presented. The proposed system has proven to be high accurate and fast enough to work in real time conditions. In the future, the selected algorithm will be included as part of an automotive compliance embedded system placed in a real truck cabin.


Image Processing Real Time Tracking Automotive Application 


  1. 1.
    Dingus, T., et al.: The 100-Car Naturalistic Driving Study. Virginia Tech Transportation Institute, NHTS (2006)Google Scholar
  2. 2.
    Zhang, H., Schreiner, C., Zhang, K., Torkkola, K.: Naturalistic use of cell phones in driving and context-based user assistance. In: Lew, M., Sebe, N., Huang, T.S., Bakker, E.M. (eds.) HCI 2007. LNCS, vol. 4796, pp. 273–276. Springer, Heidelberg (2007)Google Scholar
  3. 3.
    McAllister, G., McKenna, S.J., Ricketta, I.W.: Tracking a driver’s hands using computer vision. In: IEEE International Conference on Systems, Man, and Cybernetics (2000)Google Scholar
  4. 4.
    Tran, C., Trivedi, M.M.: Driver Assistance for “Keeping Hands on the Wheel and Eyes on the Road”. In: IEEE International Conference on Vehicular Electronics and Safety (2009)Google Scholar
  5. 5.
    Tran, C., Trivedi, M.M.: Introducing XMOB: Extremity Movement Observation Framework for Upper Body Pose Tracking in 3D. In: IEEE Int. Symp. on Multimedia (2009)Google Scholar
  6. 6.
    Murphy-Chutorian, E., Trivedi, M.M.: HyHOPE: Hybrid Head Orientation and Position Estimation for Vision-based Driver Head Tracking. In: IEEE Int. Vehicles Symposium (2008)Google Scholar
  7. 7.
    Brazalez, A., Delgado, B., Sevillano, M., Garcia, I., Matey, L.: Cabintec: Cabina inteligente para el transporte por carretera. In: Proc. VIII Cong. Esp. Sist. Int. de Transporte (2008)Google Scholar
  8. 8.
    Siordia, O.S., Martín de Diego, I., Conde, C., Reyes, G., Cabello, E.: Driving risk ın, classification based on experts evaluation. In: Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, IV 2010 (2010)Google Scholar
  9. 9.
    Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal, 2nd Quarter (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Raúl Crespo
    • 1
  • Isaac Martín de Diego
    • 1
  • Cristina Conde
    • 1
  • Enrique Cabello
    • 1
  1. 1.Face Recognition and Artificial Vision GroupUniversidad Rey Juan CarlosMostoles

Personalised recommendations