Skip to main content

Techniques for Mimicry and Identity Blending Using Morph Space PCA

  • Conference paper
  • 2746 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7729))

Abstract

We describe a face modelling tool allowing image representation in a high-dimensional morph space, compression to a small number of coefficients using PCA [1], and expression transfer between face models by projection of the source morph description (a parameterisation of complex facial motion) into the target morph space. This technique allows creation of an identity-blended avatar model whose high degree of realism enables diverse applications in visual psychophysics, stimulus generation for perceptual experiments, animation and affective computing.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jolliffe, I., MyiLibrary: Principal component analysis, vol. 2. Wiley Online Library (2002)

    Google Scholar 

  2. Haxby, J., Hoffman, E., Gobbini, M.: The distributed human neural system for face perception. Trends in Cognitive Sciences 4, 223–233 (2000)

    Article  Google Scholar 

  3. Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., Nayar, S.: Face swapping: automatically replacing faces in photographs. ACM Transactions on Graphics (TOG) 27, 39 (2008)

    Article  Google Scholar 

  4. Hasselmo, M., Rolls, E., Baylis, G.: The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural Brain Research 32, 203–218 (1989)

    Article  Google Scholar 

  5. Parry, F., Young, A., Shona, J., Saul, M., Moss, A.: Dissociable face processing impairments after brain injury. Journal of Clinical and Experimental Neuropsychology 13, 545–558 (1991)

    Article  Google Scholar 

  6. Calder, A., Burton, A., Miller, P., Young, A., Akamatsu, S.: A principal component analysis of facial expressions. Vision Research 41, 1179–1208 (2001)

    Article  Google Scholar 

  7. Rosenblum, M., Yacoob, Y., Davis, L.: Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks 7, 1121–1138 (1996)

    Article  Google Scholar 

  8. Essa, I., Pentland, A.: Facial expression recognition using a dynamic model and motion energy. In: Proceedings of the Fifth International Conference on Computer Vision, pp. 360–367. IEEE (1995)

    Google Scholar 

  9. Bassili, J.: Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance 4, 373 (1978)

    Article  Google Scholar 

  10. Grossberg, S., Vladusich, T.: How do children learn to follow gaze, share joint attention, imitate their teachers, and use tools during social interactions? Neural Networks 23, 940–965 (2010)

    Article  Google Scholar 

  11. Valentine, T.: Face-space models of face recognition. In: Computational, Geometric, and Process Perspectives on Facial Cognition: Contexts and Challenges, pp. 83–113 (2001)

    Google Scholar 

  12. Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1991, pp. 586–591. IEEE (1991)

    Google Scholar 

  13. Itti, L., Dhavale, N., Pighin, F.: Realistic avatar eye and head animation using a neurobiological model of visual attention. Technical report, DTIC Document (2003)

    Google Scholar 

  14. Rajan, V., Subramanian, S., Keenan, D., Johnson, A., Sandin, D., DeFanti, T.: A realistic video avatar system for networked virtual environments. In: Proceedings of IPT (2002)

    Google Scholar 

  15. Mori, M.: The uncanny valley. Energy 7, 33–35 (1970)

    Google Scholar 

  16. McOwan, P., Johnston, A.: The algorithms of natural vision: The multi-channel gradient model. In: First International Conference on Genetic Algorithms in Engineering Systems: Innovations and Applications, GALESIA (Conf. Publ. No. 414), pp. 319–324. IET (1995)

    Google Scholar 

  17. Anderson, K., McOwan, P.: Real-time Emotion Recognition Using Biologically Inspired Models. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 1056–1056. Springer, Heidelberg (2003)

    Google Scholar 

  18. Seeing Machines.: Faceapi product page (2012)

    Google Scholar 

  19. Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194. ACM Press/Addison-Wesley Publishing Co. (1999)

    Google Scholar 

  20. Brennan, S.: Caricature generator: The dynamic exaggeration of faces by computer. Leonardo 18, 170–178 (1985)

    Article  Google Scholar 

  21. Rotshtein, P., Henson, R., Treves, A., Driver, J., Dolan, R.: Morphing marilyn into maggie dissociates physical and identity face representations in the brain. Nature Neuroscience 8, 107–113 (2004)

    Article  Google Scholar 

  22. Galton, F.: Composite portraits, made by combining those of many different persons into a single resultant figure. The Journal of the Anthropological Institute of Great Britain and Ireland 8, 132–144 (1879)

    Article  Google Scholar 

  23. Polesel, A., Ramponi, G., Mathews, V.: Image enhancement via adaptive unsharp masking. IEEE Transactions on Image Processing 9, 505–510 (2000)

    Article  Google Scholar 

  24. Liu, Z., Shan, Y., Zhang, Z.: Expressive expression mapping with ratio images. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 271–276. ACM (2001)

    Google Scholar 

  25. Theobald, B., Matthews, I., Cohn, J., Boker, S.: Real-time expression cloning using appearance models. In: Proceedings of the 9th International Conference on Multimodal Interfaces, pp. 134–139. ACM (2007)

    Google Scholar 

  26. Cook, R., Johnston, A., Heyes, C.: Self-recognition of avatar motion: how do i know it’s me? Proceedings of the Royal Society B: Biological Sciences 279, 669–674 (2012)

    Article  Google Scholar 

  27. Grammer, K., Thornhill, R.: Human (homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. Journal of Comparative Psychology 108, 233 (1994)

    Article  Google Scholar 

  28. Müller, W., Spierling, U., Alexa, M., Rieger, T.: Face-to-face with your assistant. Realization issues of animated user interface agents for home appliances. Computers & Graphics 25, 593–600 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nagle, F., Griffin, H., Johnston, A., McOwan, P. (2013). Techniques for Mimicry and Identity Blending Using Morph Space PCA. In: Park, JI., Kim, J. (eds) Computer Vision - ACCV 2012 Workshops. ACCV 2012. Lecture Notes in Computer Science, vol 7729. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37484-5_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37484-5_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37483-8

  • Online ISBN: 978-3-642-37484-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics