Abstract
In human-computer interaction, gaze orientation is an important and promising source of information to demonstrate the attention and focus of users. Gaze detection can also be an extremely useful metric for analysing human mood and affect. Furthermore, gaze can be used as an input method for human-computer interaction. However, currently real-time and accurate gaze estimation is still an open problem. In this paper, we propose a simple and novel estimation model of the real-time gaze direction of a user on a computer screen. This method utilises cheap capturing devices, a HD webcam and a Microsoft Kinect. We consider that the gaze motion from a user facing forwards is composed of the local gaze motion shifted by eye motion and the global gaze motion driven by face motion. We validate our proposed model of gaze estimation and provide experimental evaluation of the reliability and the precision of the method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Duchowski, A.T.: A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments & Computers 34(4), 455–470 (2002)
Hansen, D.W., Ji, Q.: In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(3), 478–500 (2010)
Duchowski, A.T.: Eye tracking methodology: Theory and practice, vol. 373. Springer (2007)
Morimoto, C.H., et al.: Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98(1), 4–24 (2005)
Bohme, M., Meyer, A., Martinetz, T., et al.: Remote eye tracking: State of the art and directions for future development. In: Proc. of the 2006 Conference on Communication by Gaze Interaction (COGAIN), pp. 12–17 (2006)
Wang, J.G., et al.: Eye gaze estimation from a single image of one eye. In: Proceedings of the Ninth IEEE International Conference on Computer Vision, pp. 136–143 (2003)
Kim, K.N., Ramakrishna, R.S.: Vision-based eye-gaze tracking for human computer interface. In: IEEE SMC 1999 Conference Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, pp. 324–329. IEEE, MLA (1999)
Tan, K.H., et al.: Appearance-based eye gaze estimation. In: Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision, pp. 191–195. IEEE (2002)
Reale, M., et al.: Using eye gaze, head pose, and facial expression for personalized non-player character interaction. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 13–18 (2011)
Langton, S.R.H., Honeyman, H., Tessler, E.: The influence of head contour and nose angle on the perception of eye-gaze direction. Perception & Psychophysics 66(5), 752–771 (2004)
Funes Mora, K.A., Odobez, J.-M.: Gaze estimation from multimodal Kinect data. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 25–30 (2012)
Li, Y., Wei, H., Monaghan, D.S., OConnor, N.E.: A Hybrid Head and Eye Tracking System for Realistic Eye Movements in Virtual Avatars. In: The International Conference on Multimedia Modeling (2014)
Jafari, R., Ziou, D.: Gaze estimation using Kinect/PTZ camera. In: IEEE International Symposium on Robotic and Sensors Environments (ROSE), pp. 13–18 (2012)
Andrist, S., Pejsa, T., Mutlu, B., Gleicher, M.: A head-eye coordination model for animating gaze shifts of virtual characters. In: Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction (2012)
Ciger, J., et al.: Evaluation of gaze tracking technology for social interaction in virtual environments. In: Proc. of the 2nd Workshop on Modeling and Motion Capture Techniques for Virtual Environments (CAPTECH 2004) (2004)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24(6), 381–395 (1981)
Villanueva, A., Cabeza, R.: Models for gaze tracking systems. Journal on Image and Video Processing 2007(3), 4 (2007)
Li, D., et al.: openEyes: A low-cost headmounted eye-tracking solution. In: Proceedings of the ACM Eye Tracking Research and Applications Symposium (2006)
Nussbaum, G., Veigl, C., Acedo, J., et al.: AsTeRICS-Towards a Rapid Integration Construction Set for Assistive Technologies. In: AAATE Conference (2011)
Zielinski, P.: Opengazer: open-source gaze tracker for ordinary webcams (software), Samsung and The Gatsby Charitable Foundation, http://www.inference.phy.cam.ac.uk/opengazer/
Savas, Z.: TrackEye: Real time tracking of human eyes using a webcam, http://www.codeproject.com/KB/cpp/TrackEye.aspx
San Agustin, J., Skovsgaard, H., Hansen, J.P., et al.: Low-cost gaze interaction: ready to deliver the promises. In: CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 4453–4458. ACM (2009)
San Agustin, J., et al.: Evaluation of a low-cost open-source gaze tracker. In: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications. ACM (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Li, Y., Monaghan, D.S., O’Connor, N.E. (2014). Real-Time Gaze Estimation Using a Kinect and a HD Webcam. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds) MultiMedia Modeling. MMM 2014. Lecture Notes in Computer Science, vol 8325. Springer, Cham. https://doi.org/10.1007/978-3-319-04114-8_43
Download citation
DOI: https://doi.org/10.1007/978-3-319-04114-8_43
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04113-1
Online ISBN: 978-3-319-04114-8
eBook Packages: Computer ScienceComputer Science (R0)