Synthetic Eyes

  • Behrooz Kamgar-Parsi
  • Behzad Kamgar-Parsi
  • Anil K. Jain
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2688)


It is difficult to have a dependable face recognition system when only a single (or a few) image(s) per subject is used in the training set. Due to significant natural facial variations, e.g., facial expression, and appearances due to lighting condition, and head pose (even when dealing with “frontal view”), the use of a collection of images covering these variations and appearances will be of great help. We show that the expansion of the training set, by careful construction of synthetic images that capture all or most of the desired appearances can significantly improve the performance, especially when only one (or several, but very similar) real image(s) of a given individual are available. To have a better understanding of the issues involved, we address an inherently simpler problem, i.e. face/identity recognition/verification using only one eye and its associated eyebrow. We will particularly emphasize the synthesis and automation issues. Moreover, our experimental results indicate that the eye is rich in discriminative information, perhaps providing more information than what is normally utilized by humans. This wealth of information, however, can be exploited by machines for close-up images. Finally, we speculate that a similar improvement can be achieved when the training set is enriched with carefully generated synthetic images of the entire face.


Face Recognition Real Image Lower eyeLid Synthetic Image Head Tilt 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Belhumeur, P.N., Hespanha, J., and Kriegman, D., “Eigenfaces vs. fisherfaces: Recognition using class specific linear projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711–720, July 1997.CrossRefGoogle Scholar
  2. [2]
    Hjelmas, E., Wroldsen, J., “Recognizing faces from the eyes only,” Proc. Scandinavian Image Analysis Conference, 1997.Google Scholar
  3. [3]
    “Recognizing Eyes,” Kamgar-Parsi, Behrooz, Kamgar-Parsi, Behzad, Naval Research Laboratory, NCARAI Technical Report, 2002.Google Scholar
  4. [4]
    Kotropoulos, C., Tefas A., and Pitas, I., “Frontal face authentication using morphological elastic graph matching,” IEEE Trans. Image Processing, vol. 9, pp. 555–560, 2000.CrossRefGoogle Scholar
  5. [5]
    Moghaddam, B., Wahid, W., and Pentland, A., “Beyond eigenfaces: Probabilistic matching for face recognition,” Proc. Int’l Conf. Automatic Face and Gesture Recognition, pp. 30–35, Nara, Japan, April 1998.Google Scholar
  6. [6]
    Penev, P. S., and Atick, J. J., “Local feature analysis: A general statistical theory for object representation,” Network: Computation in Neural Systems, vol. 7, pp. 477–500, 1996.zbMATHCrossRefGoogle Scholar
  7. [7]
    Sim, T. and Kanade, T., “Combining models and Exemplars for Face Recognition: An Illuminating Example,” Proc. CVPR 2001 Workshop on Models versus Exemplars in Computer Vision, Dec. 2001.Google Scholar
  8. [8]
    Lee, Kuang-Chil, Ho, J., and Kriegman, D. J., “Nine points of light: acquiring subspaces for face recognition under variable lighting,” Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 519–526, Dec. 2001.Google Scholar
  9. [9]
    Turk, M., and Pentland, A., “Eigenfaces for recognition,” Journal of Cognitive Neuroscience, vol. 3, no. 1, pp. 71–86, 1991.CrossRefGoogle Scholar
  10. [10]
    Wiskott, L., Fellous J. M., Krüger, N., and von der Malsburg, C., “Face Recognition by Elastic Bunch Graph Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol 19, pp. 775–779, 1997.CrossRefGoogle Scholar
  11. [11]
    Zhang, J., Yan, Y., and Lades, M., “Face recognition: Eigenfaces, elastic matching, and neural nets,” Proc. IEEE, vol. 85, pp. 1422–1435, 1997.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Behrooz Kamgar-Parsi
    • 1
  • Behzad Kamgar-Parsi
    • 1
  • Anil K. Jain
    • 2
  1. 1.Information Technology DivisionNaval Research LaboratoryWashington
  2. 2.Department of Computer ScienceMichigan State UniversityEast Lansing

Personalised recommendations