Skip to main content
SpringerLink
Log in

Biophysics of the Eye in Computer Vision: Methods and Advanced Technologies

  • Chapter
Physics of Automatic Target Recognition

Part of the book series: Advanced Sciences and Technologies for Security Applications ((ASTSA,volume 3))

Abstract

The eyes have it! This chapter describes cutting-edge computer vision methods employed in advanced vision sensing technologies for medical, safety, and security applications, where the human eye represents the object of interest for both the imager and the computer. A camera receives light from the real eye to form a sequence of digital images of it. As the eye scans the environment, or focuses on particular objects in the scene, the computer simultaneously localizes the eye position, tracks its movement over time, and infers measures such as the attention level, and the gaze direction in real time and fully automatic. The main focus of this chapter is on computer vision and pattern recognition algorithms for eye appearance variability modeling, automatic eye detection, and robust eye position tracking. This chapter offers good readings and solid methodologies to build the two fundamental low-level building blocks of a vision-based eye tracking technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. ACM Eye Tracking Research and Applications (ETRA) Symposium, 2000, 2002, 2004.

    Google Scholar 

  2. Gaze Tracking Methodology: Theory and Practice. Springer, London, UK, 2003.

    Google Scholar 

  3. A. Amir, L. Zimet, A. Sangiovanni-Vincentelli, and S. Kao. An embedded system for an eye-detection sensor. CVIU, 98(1):104–123, April 2005.

    Google Scholar 

  4. H.H.K. Andersen and G. Hauland. Measuring team situation awareness of reactor operators during normal operation: A technical pilot study. In Proceedings of the First Human Performance, Situation Awareness and Automation Conference, pp. 268–273, 2000.

    Google Scholar 

  5. Y. Bar-Shalom and T. Fortmann. Tracking and Data Association. Academic Press, 1988.

    Google Scholar 

  6. Patrick Baudisch, Doug DeCarlo, Andrew T. Duchowski, and Wilson S. Geisler. Focusing on the essential: Considering attention in display design. Communications of the ACM, 46(3):60–66, 2003.

    Article  Google Scholar 

  7. S. Belongie, J. Malik, and J. Puzicha. Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Analysis and Machine Intelligence, pp. 509–522, 2002.

    Google Scholar 

  8. A. Blake and M. Isard. Active Contours: The Application of Techniques From Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion. Springer-Verlag, 1998.

    Google Scholar 

  9. C. Burges. A tutorial on support vector machines for pattern revognition. Data Mining Knowledge Discovery, 2:121–167, 1998.

    Article  Google Scholar 

  10. K. Choo and D.J. Fleet. People tracking using hybrid Monte Carlo filtering. In International Conference on Computer Vision, pp. II: 321–328, 2001.

    Google Scholar 

  11. D. Comaniciu, V. Ramesh, and P. Meer. Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5):564–577, 2003.

    Article  Google Scholar 

  12. T. F. Cootes and Taylor. Active shape models—“smart snakes”. In Proceedings. British Machine Vision Conf., BMVC92, pp. 266–275, 1992.

    Google Scholar 

  13. Ronald Satria Dan Witzner Hansen, Riad Hammoud and Jakob Sorensen. Improved likelihood function in particle-based ir eye tracking. In IEEE CVPR Workshop on Object Tracking and Classification Beyond the Visible Spectrum, San Diego, CA, June 2005.

    Google Scholar 

  14. J.Y. Deng and F. Lai. Region-based template deformation and masking for eye-feature extraction and description. Pattern Recogn, 30:403–419, 1997.

    Article  Google Scholar 

  15. Arnaud Doucet, Nando de Freitas, and Neil Gordon. Sequential Monte Carlo Methods in Practice. Springer-Verlag, ISBN: 0-387-95146-6, 2001.

    Google Scholar 

  16. A. T. Duchowski. A breath-first survey of eye tracking applications. Behavior Research Methods, Instruments, and Computers (BRMIC), 34(4):455–470, 2002.

    Article  Google Scholar 

  17. Y. Ebisawa and S. Satoh. Effectiveness of pupil area detection technique using two light sources and image difference method. In 5th Annual Int. Conf. of the IEEE Eng. in Medicine and Biology Society, pp. 1268–1269, 1993.

    Google Scholar 

  18. N. Edenborough, R. I. Hammoud, A. Harbach, et al. Drowsy driver monitor from delphi. In Demon Session, IEEE Computer Vision and Pattern Recognition Conference, 2004.

    Google Scholar 

  19. N. Edenborough, R. I. Hammoud, and A. Harbach et al. Driver state monitor from delphi. In Demon session, IEEE Computer Vision And Pattern Recognition Conference, 2005.

    Google Scholar 

  20. I. R. Fasel and M. S. Bartlett. A comparison of gabor filter methods for automatic detection of facial landmarks. In Proceedings of International Conference on Automatic Face and Gesture Recognition, pp. 242–246, 2002.

    Google Scholar 

  21. I.R. Fasel, B. Fortenberry, and J.R. Movellan. A generative framework for real time object detection and classification. Computer Vision and Image Understanding, 98(1):182–210, April 2005.

    Article  Google Scholar 

  22. K. Grauman, M. Betke, J. Gips, and G.R. Bradski. Communication via eye blinks: Detection and duration analysis in real time. In IEEE Computer Vision and Pattern Recognition (CVPR), pp. I:1010–1017, 2001.

    Google Scholar 

  23. Riad I. Hammoud. A robust eye position traker based on invariant local features, eye motion and infrared-eye responses. In SPIE Defense and Security Symposium, Automatic Target Recognition Conference, Proceedings of SPIE Vol. Nb. 5807, pp. 35–43, Orlando, FL, March 2005.

    Google Scholar 

  24. Riad I. Hammoud, Andrew Wilhelm, Phillip Malawey, and Gerald J. Witt. Efficient real-time algorithms for eye state and head pose tracking in advanced driver support systems. In IEEE Computer Vision and Pattern Recognition Conference, 2005.

    Google Scholar 

  25. Dan Witzner Hansen, John Paulin Hansen, Mads Nielsen, Anders Sewerin Johansen, and Mikkel B. Stegmann. Eye typing using markov and active appearance models. In IEEE Workshop on Applications on Computer Vision, pp. 132–136, 2003.

    Google Scholar 

  26. D. W. Hansen and A.E.C. Pece. Eye tracking in the wild. Comp. Vision Image Understand. 98(1):155–181, April 2005.

    Article  Google Scholar 

  27. Andrew P. Harbach, Gregory K. Scharenbroch, Gerald J. Witt, Timothy J. Newman, Nancy Edenborough, and Hammoud Riad I. Imaging system and method for monitoring an eye. United States, Patent, US 2005/0100191 A1, 2005, (issued).

    Google Scholar 

  28. A. Haro, M. Flickner, and I. Essa. Detecting and tracking eyes by using their physiological properties, dynamics, and appearance. In IEEE Conf. Comp. Vision and Pattern Recognition, Hilton Head Island, SC, June 2000.

    Google Scholar 

  29. R. Herpers, M. Michaelis, K. Lichtenauer, and G. Sommer. Edge and keypoint detection in facial regions. In International Conference on Automatic Face and Gesture-Recognition, pp. 212–217, 1996.

    Google Scholar 

  30. J. Huang and D. Mumford. Statistics of natural images and models. In IEEE Computer Vision and Pattern Recognition (CVPR), pp. I: 541–547, 1999.

    Google Scholar 

  31. J. Huang and H. Wechsler. Eye location using genetic algorithms. In 2nd Int'l conference in Audio and Video-Based Biometric Person Authentication (AVBPA), 1999.

    Google Scholar 

  32. D. Huttenlocher, G. Klanderman, and W. Rucklidge. Comparing images using hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15(9):850–863, 1993.

    Article  Google Scholar 

  33. M. Isard and A. Blake. Condensation—conditional density propagation for visual tracking, 1998.

    Google Scholar 

  34. Michael Isard and Andrew Blake. Contour tracking by stochastic propagation of conditional density. In European Conference on Computer Vision, pp. 343–356, 1996.

    Google Scholar 

  35. J.P. Ivins and J. Porrill. A deformable model of the human iris for measuring small 3-dimensional eye movements. Mach. Vision Appl. 11(1):42–51, 1998.

    Article  Google Scholar 

  36. R.J.K Jacob. Eye Tracking in Advanced Interface Design, Vols. 3–22. Oxford University Press, 1995.

    Google Scholar 

  37. Q. Ji and X. Yang. Real time visual cues extraction for monitoring driver vigilance. In Workshop on Computer Vision Systems, CVPR, Vancouver, Canada, 2001.

    Google Scholar 

  38. S. Julier and J. Uhlmann. A new extension of the kalman filter to nonlinear systems, 1997.

    Google Scholar 

  39. S. Kawato and N. Tetsutani. Detection and tracking of eyes for gaze-camera control, 2002.

    Google Scholar 

  40. S. Kawato and N. Tetsutani. Detection and tracking of eyes for gaze-camera control, 2002.

    Google Scholar 

  41. Irwin King and Lei Xu. Localized principal component analysis learning for face feature extraction and recognition. In Proceedings to the Workshop on 3D Computer Vision, pp. 124–128, Shatin, Hong Kong, 1997.

    Google Scholar 

  42. J.J. Koenderink and A.J. van Doorn. Representation of local geometry in the visual system. 55:367–375, 1987.

    MATH  Google Scholar 

  43. K.M. Lam and H. Yan. Locating and extracting the eye in human face images. Pattern Recogn., 29:771–779, 1996.

    Article  Google Scholar 

  44. L. J. Latecki, R. Lakamper, and U. Eckhardt. Shape descriptors for non-rigid shapes with a single closed contour. In Proc. IEEE Conf. Comput. Vision and Pattern Recogn., pp. 424–429, 2000.

    Google Scholar 

  45. http://www.eyegaze.com. LC Technologies INC., 2004.

    Google Scholar 

  46. Simon P. Liversedge and John M. Findlay. Saccadic eye movements and cognition. Trends Cogn. Sci., 4(1):6–14, January 2000.

    Article  Google Scholar 

  47. G. Loy and A. Zelinsky. Fast radial symmetry for detecting points of interest. PAMI, pp. 959–973, August 2003.

    Google Scholar 

  48. John MacCormick and Michael Isard. Partitioned sampling, articulated objects, and interface-quality hand tracking. In European Conference on Computer Vision, pp. 3–19, 2000.

    Google Scholar 

  49. Päivi Majaranta and Kari-Jouko Räihä. Twenty years of eye typing: Systems and design issues. In Symposium on ETRA 2002: Eye Tracking Research Applications Symposium, New Orleans, Louisiana, pp. 944–950, 2002.

    Google Scholar 

  50. Y. Matsumoto and A. Zelinsky. An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In International Conference on Automatic Face and Gesture Recognition, pp. 499–504, 2000.

    Google Scholar 

  51. Fan Johnson Messom. Machine vision for an intelligent tutor.

    Google Scholar 

  52. C.H. Morimoto, D. Koons, A. Amir, and M. Flickner. Pupil detection and tracking using multiple light sources. IVC, 18(4):331–335, 2000.

    Article  Google Scholar 

  53. http://www.multimap.com. MultiMap, UK aerial photo coverage, 2003.

    Google Scholar 

  54. R. Newman, Y. Matsumoto, S. Rougeaux, and A. Zelinsky. Real-time stereo tracking for head pose and gaze estimation. In International Conference on Automatic Face and Gesture Recognition, pp. 122–128, 2000.

    Google Scholar 

  55. Stavri Nikolov, Timothy Newman, Michael Jones, and Iain Gilchrist. Gaze-contingent display using texture mapping and opengl: System and applications. In ACM Eye Tracking Research and Applications Symposium, pp. 11–18, 2004.

    Google Scholar 

  56. M. Nixon. Eye spacing measurements for facial recognition. Applications of Digital Image Processing, 575(VIII):279–285, 1985.

    ADS  MathSciNet  Google Scholar 

  57. B. Noureddin, P.D. Lawrence, and C.F. Man. A non-contact device for tracking gaze in a human computer interface. Comp. Vision Image Understand. 98(1): 52–82, April 2005.

    Article  Google Scholar 

  58. E. Osuna, R. Freund, and F. Girosi. Training support vector machines: an application to face detecition. pp. 130–136, 1997.

    Google Scholar 

  59. A.E.C. Pece and A.D. Worrall. Tracking with the EM contour algorithm. In European Conference on Computer Vision, pp. I: 3–17., 2002.

    Google Scholar 

  60. L.R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE, 77(2):257–286, 1989.

    Article  Google Scholar 

  61. C. Schmid and R. Mohr. Local grayvalue invariants for image retrieval. 19(5):530–534, 1997.

    Google Scholar 

  62. B. Scholkopf, C. J. C. Burges, and A. J. Smola. Advances in Kernel Methods: Support Vector Learning. MIT Press, 1999.

    Google Scholar 

  63. B. Scholkopf, S. Mika, C. J. C., Burges, P. Knirsch, K.-R. Mueller, G. Raetsch, and A. J. Smola. Input space versus feature space in kernel-based methods. IEEE Trans. Neural Networks, 1999.

    Google Scholar 

  64. http://www.seeingmachines.com.au. SEEINGMACHINES, FaceLab, 2003.

    Google Scholar 

  65. http://www.smarteye.se. Smart Eyes A/B, 2004.

    Google Scholar 

  66. K.K. Sung and T. Poggio. Example-based learning for view-based human face detection. 20(1):39–51, 1998.

    Google Scholar 

  67. M. E. Tipping. Sparse bayesian learning and the relevance vector machine. J. of Mach. Learn. Res., 2001.

    Google Scholar 

  68. http://www.tobii.se/. Tobii Technologies, 2004.

    Google Scholar 

  69. A. Tomono, M. Iida, and Y. Kobayashi. A TV camera system which extracts feature points for non-contact eye movement detection. In SPIE Optics, Illumination, and Image Sensing for Machine Vision, volume 1194, pp. 2–12, 1989.

    ADS  Google Scholar 

  70. M. Turk and A. Pentland. Face recognition using eigenfaces. pp. 586–591, 1991.

    Google Scholar 

  71. R.C. Veltkamp and M. Hagedoorm. State of the art in shape matching. In Technical Report UU-CS-1999-27, Utrecht, 1999.

    Google Scholar 

  72. P. Viola and M. Jones. Robust real-time face detection. In International Conference on Computer Vision, pp. II: 747, 2001.

    Google Scholar 

  73. V. Vogelhuber and C. Schmid. Face detection based on generic local descriptors and spatial constraints. vol. 1, pp. 1084–1087, 2000.

    Google Scholar 

  74. Colin Ware. Information Visualization. Morgan Kaufman Publishers, 2000.

    Google Scholar 

  75. M. Wedel and R. Peiters. Eye fixations on advertisments and memory for brands: A model and findings. Market. Sci. 19(4):297–312, 2000.

    Article  Google Scholar 

  76. Jie Yang, Rainer Stiefelhagen, Uwe Meier, and Alex Waibel. Robust detection of facial features by generalized symmetry. In International Conference on Pattern Recognition, pp. I:117–120, 1992.

    Google Scholar 

  77. David Young, Hilary Tunley, and Richard Samuels. Specialised hough transform and active contour methods for real-time eye tracking. Technical Report 386, School of Cognitive and Computing Sciences, University of Sussex, 1995.

    Google Scholar 

  78. A. L. Yuille, P. W. Hallinan, and D.S Cohen. Feature extraction from faces using deformable templates. Int. J. Comput. Vision, 8(2):99–111, 1992.

    Article  Google Scholar 

  79. Z. Zhu and Q. Ji. Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Comput. Vision Image Understand. 98(1):124–154, April 2005.

    Article  Google Scholar 

  80. Zhiwei Zhu, Qiang Ji, Kikuo Fujimura, and Kuangchih Lee. Combining kalman filtering and mean shift for real tracking under active illumination. In ICPR 2002, Québec, Canada, August 11–15 2002.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Delphi Electronics & Safety, One Corporate Center, 9005, 46904-9005, Kokomo, IN, USA

    Riad I. Hammoud

  2. IT University, Copenhagen, Rued Langaardsvej 7, 2300 Copenhagen S, Denmark

    Dan Witzner Hansen

Authors
  1. Riad I. Hammoud
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dan Witzner Hansen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Staff Scientist, LMC, 3400 Highcrest Road Saint Anthony, 55418, MN, USA

    Firooz Sadjadi

  2. Distinguished Professor of Electrical and Computer Engineering, Electrical and Computer Engineering Department University of Connecticut, 371 Fairfax Road, Unit 1157 Storrs, 06269-1157, CT, USA

    Bahram Javidi

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer

About this chapter

Cite this chapter

Hammoud, R.I., Hansen, D.W. (2007). Biophysics of the Eye in Computer Vision: Methods and Advanced Technologies. In: Sadjadi, F., Javidi, B. (eds) Physics of Automatic Target Recognition. Advanced Sciences and Technologies for Security Applications, vol 3. Springer, New York, NY. https://doi.org/10.1007/978-0-387-36943-3_9

Download citation

Publish with us

Policies and ethics

Search

Navigation