Head Dynamic Analysis: A Multi-view Framework

  • Ashish Tawari
  • Moham M. Trivedi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8158)


Analysis of driver’s head behavior is an integral part of driver monitoring system. In particular, head pose and dynamics are strong indicators of driver’s focus of attention. In this paper, we present a distributed camera framework for head pose estimation with emphasis on the ability to operate reliably and continuously. To evaluate the proposed framework, we collected a novel head pose dataset of naturalistic on-road driving in urban streets and freeways. As oppose to utilizing all the data collected during the whole ride where for large portion of the time driver is front facing, we use data during particular maneuvers typically involving large head deviation from frontal pose. While this makes the dataset challenging, it provides an opportunity to evaluate algorithms during non-frontal glances which are of special interest to driver safety. We conduct a comparative study between proposed multi-view based approach and single-view based approach. Our analyses show promising results.


Facial Feature Head Orientation Lane Change Driver Safety Facial Feature Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Chen, J., Ji, Q.: 3D gaze estimation with a single camera without ir illumination. In: 19th International Conference on Pattern Recognition, pp. 1–4 (December 2008)Google Scholar
  2. 2.
    Dementhon, D.F., Davis, L.S.: Model-based object pose in 25 lines of code. International Journal of Computer Vision 15, 123–141 (1995)CrossRefGoogle Scholar
  3. 3.
    Doshi, A., Trivedi, M.M.: On the roles of eye gaze and head dynamics in predicting driver’s intent to change lanes. IEEE Transactions on Intelligent Transportation Systems 10(3), 453–462 (2009)CrossRefGoogle Scholar
  4. 4.
    Gee, A., Cipolla, R.: Determining the gaze of faces in images. Image and Vision Computing 12(10), 639–647 (1994)CrossRefGoogle Scholar
  5. 5.
    Guestrin, E.D., Eizenman, M.: General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Engineering 53(6), 1124–1133 (2006)CrossRefGoogle Scholar
  6. 6.
    Lee, S.J., Jo, J., Jung, H.G., Park, K.R., Kim, J.: Real-time gaze estimator based on driver’s head orientation for forward collision warning system. IEEE Transactions on Intelligent Transportation Systems 12(1), 254–267 (2011)CrossRefGoogle Scholar
  7. 7.
    Martin, S., Tawari, A., Chutorian, E.M., Cheng, S.Y., Trivedi, M.M.: On the design and evaluation of robust head pose for visual user interfaces: Algorithms, databases, and comparisons. In: 4th ACM SIGCHI International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AUTO-UI (2012)Google Scholar
  8. 8.
    Murphy-Chutorian, E., Trivedi, M.: Head pose estimation in computer vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(4), 607–626 (2009)CrossRefGoogle Scholar
  9. 9.
    Ohue, K., Yamada, Y., Uozumi, S., Tokoro, S., Hattori, A., Hayashi, T.: Development of a new pre-crash safety system. In: SAE 2006 World Congress & Exhibition. SAE Technical Paper 2006-01-1461 (April 3, 2006)Google Scholar
  10. 10.
    Saragih, J., Lucey, S., Cohn, J.: Face alignment through subspace constrained mean-shifts. In: Int. Conf. on Computer Vision, pp. 1034–1041 (2009)Google Scholar
  11. 11.
    Stiefelhagen, R., Zhu, J.: Head orientation and gaze direction in meetings. In: CHI 2002 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2002, pp. 858–859. ACM, New York (2002), Google Scholar
  12. 12.
    Wang, J.G., Sung, E.: Em enhancement of 3D head pose estimated by point at infinity. Image and Vision Computing 25(12), 1864–1874 (2007), the age of human computer interactionCrossRefGoogle Scholar
  13. 13.
    Zhang, H., Smith, M., Dufour, R.: A final report of safety vehicles using adaptive interface technology: Visual distraction (February 2008),
  14. 14.
    Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2879–2886. IEEE (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ashish Tawari
    • 1
  • Moham M. Trivedi
    • 1
  1. 1.University of CaliforniaSan DiegoUSA

Personalised recommendations