Skip to main content
SpringerLink
Log in

Estimating 3D Gaze Point on Object Using Stereo Scene Cameras

  • Conference paper
  • First Online:
Intelligent Robotics and Applications (ICIRA 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10462))

Included in the following conference series:

  • 5546 Accesses

Abstract

3D eye gaze estimation in real environment is still challenging. A novel method of scene-based 3D gaze estimation is proposed in this paper. As this model combines two models, the 2D nonlinear polynomial mapping model of traditional regression-based gaze estimation and the 3D visual axis linear ray model of traditional geometry-based gaze estimation, it includes two steps. The first step is to estimate the visual axis from the pupil center in an eye camera image. The second one is to estimate the 3D gaze point which is the intersection between the visual axis and the scene object, which can be obtained by stereo scene cameras. As the 3D gaze points are on the object, rather than outside or inside the object like geometry-based 3D gaze estimation, this method is potential for human robot interaction in real environment. Through a simple test, the accuracy of our 3D gaze estimation system is acceptable.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Carrasco, M., Clady, X.: Exploiting eye–hand coordination to detect grasping movements. Image Vis. Comput. 30(11), 860–874 (2012)

    Article  Google Scholar 

  2. Duchowski, A.T.: Eye Tracking Methodology: Theory and Practice. Springer, Heidelberg (2007)

    MATH  Google Scholar 

  3. Frisoli, A., Loconsole, C., Leonardis, D., Banno, F., Barsotti, M., Chisari, C., et al.: A new Gaze-BCI-Driven control of an upper limb exoskeleton for rehabilitation in real-world tasks. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 42(6), 1169–1179 (2012)

    Article  Google Scholar 

  4. Hansen, D.W., Ji, Q.: In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 478–500 (2010)

    Article  Google Scholar 

  5. Shih, S.-W., Liu, J.: A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans. Syst. Man Cybern. Part B Cybern. 34(1), 234–245 (2004)

    Article  Google Scholar 

  6. Zhu, Z., Ji, Q.: Novel eye gaze tracking techniques under natural head movement. IEEE Trans. Biomed. Eng. 54(12), 2246–2260 (2007)

    Article  Google Scholar 

  7. Villanueva, A., Cabeza, R.: A novel gaze estimation system with one calibration point. IEEE Trans. Syst. Man Cybern. Part B Cybern. 38(4), 1123–1138 (2008)

    Article  Google Scholar 

  8. Craig, H., Peter, L.: Noncontact binocular Eye-Gaze tracking for point-of-gaze estimation in three dimensions. IEEE Trans. Biomed. Eng. 56(3), 790 (2009)

    Article  Google Scholar 

  9. Morimoto, C.H., Koons, D., Amir, A., Flickner, M.: Pupil detection and tracking using multiple light sources. Image Vis. Comput. 18(4), 331–335 (2000)

    Article  Google Scholar 

  10. Lee, J.W., Cho, C.W., Shin, K.Y., Lee, E.C., Kang, R.P.: 3D gaze tracking method using Purkinje images on eye optical model and pupil. Opt. Lasers Eng. 50(5), 736–751 (2012)

    Article  Google Scholar 

  11. Li, S., Zhang, X., Webb, J.: 3D-Gaze-based robotic grasping through mimicking human visuomotor function for people with motion impairments. IEEE Trans. Bio-med. Eng. (2017)

    Google Scholar 

  12. Sigut, J., Sidha, S.-A.: Iris center corneal reflection method for gaze tracking using visible light. IEEE Trans. Biomed. Eng. 58(2), 411–419 (2011)

    Article  Google Scholar 

  13. Takemura, K., Takahashi, K., Takamatsu, J., Ogasawara, T.: Estimating 3-D point-of-regard in a real environment using a head-mounted eye-tracking system. IEEE Trans. Human-Mach. Syst. 44(4), 531–536 (2014)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported in part by the National Natural Science Foundation of China under Grants 91648203 and 51335004, the Program of International S&T Cooperation of China under Grant 2016YFE0113600, and the Science Foundation for Distinguished Young Scholars of Hubei Province under Grant 2015CFA004.

Author information

Authors and Affiliations

  1. State Key Lab of Digital Manufacturing Equipment and Technology, Institute of Rehabilitation and Medical Robotics, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, The People’s Republic of China

    Zhonghua Wan & Caihua Xiong

Authors
  1. Zhonghua Wan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Caihua Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhonghua Wan .

Editor information

Editors and Affiliations

  1. School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China

    YongAn Huang

  2. School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China

    Hao Wu

  3. Institute of Industrial Research, University of Portsmouth, Portsmouth, United Kingdom

    Honghai Liu

  4. School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China

    Zhouping Yin

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Wan, Z., Xiong, C. (2017). Estimating 3D Gaze Point on Object Using Stereo Scene Cameras. In: Huang, Y., Wu, H., Liu, H., Yin, Z. (eds) Intelligent Robotics and Applications. ICIRA 2017. Lecture Notes in Computer Science(), vol 10462. Springer, Cham. https://doi.org/10.1007/978-3-319-65289-4_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65289-4_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65288-7

  • Online ISBN: 978-3-319-65289-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation