Skip to main content

Deep Learning of Neuromuscular Control for Biomechanical Human Animation

  • Conference paper
  • First Online:
Advances in Visual Computing (ISVC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9474))

Included in the following conference series:

Abstract

Increasingly complex physics-based models enhance the realism of character animation in computer graphics, but they pose difficult motor control challenges. This is especially the case when controlling a biomechanically simulated virtual human with an anatomically realistic structure that is actuated in a natural manner by a multitude of contractile muscles. Graphics researchers have pursued machine learning approaches to neuromuscular control, but traditional neural network learning methods suffer limitations when applied to complex biomechanical models and their associated high-dimensional training datasets. We demonstrate that “deep learning” is a useful approach to training neuromuscular controllers for biomechanical character animation. In particular, we propose a deep neural network architecture that can effectively and efficiently control (online) a dynamic musculoskeletal model of the human neck-head-face complex after having learned (offline) a high-dimensional map relating head orientation changes to neck muscle activations. To our knowledge, this is the first application of deep learning to biomechanical human animation with a muscle-driven model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Due to space limitations, the appendices are found in a supporting document (see, e.g., https://db.tt/wn37j8rg).

References

  1. Ng-Thow-Hing, V.: Anatomically-based models for physical and geometric reconstruction of humans and other animals. Ph.D. thesis, University of Toronto, Computer Science Department (2001)

    Google Scholar 

  2. Irving, G., Teran, J., Fedkiw, R.: Invertible finite elements for robust simulation of large deformation. In: Proceedings of the ACM SIGGRAPH/EG Symposium on Computer Animation, p. 131. ACM Press, New York (2004)

    Google Scholar 

  3. van Nierop, O.A., van der Helm, A., Overbeeke, K.J., Djajadiningrat, T.J.: A natural human hand model. Vis. Comput. 24, 31–44 (2007)

    Article  Google Scholar 

  4. Tsang, W., Singh, K., Fiume, E.: Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion. In: Proceedings of the ACM SIGGRAPH/EG Symposium on Computer Animation, pp. 319–328 (2005)

    Google Scholar 

  5. Sueda, S., Kaufman, A., Pai, D.K.: Musculotendon simulation for hand animation. ACM Trans. Graph. 27, 83 (2008)

    Article  Google Scholar 

  6. Sifakis, E., Neverov, I., Fedkiw, R.: Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24, 417–425 (2005)

    Article  Google Scholar 

  7. DiLorenzo, P., Zordan, V., Sanders, B.: Laughing out loud: control for modeling anatomically inspired laughter using audio. ACM Trans. Graph. 27, Article no. 125 (2008). ACM SIGGRAPH Asia 2008 Proceedings

    Google Scholar 

  8. Lee, S.H., Sifakis, E., Terzopoulos, D.: Comprehensive biomechanical modeling and simulation of the upper body. ACM Trans. Graph. 28(99), 1–17 (2009)

    Google Scholar 

  9. Lee, Y., Terzopoulos, D., Waters, K.: Realistic modeling for facial animation. In: Proceedings of ACM SIGGRAPH 1995, pp. 55–62 (1995)

    Google Scholar 

  10. Kähler, K., Haber, J., Yamauchi, H., Seidel, H.: Head shop: generating animated head models with anatomical structure. In: Proceedings of the ACM SIGGRAPH/EG Symposium on Computer Animation, pp. 55–63 (2002)

    Google Scholar 

  11. Sifakis, E., Neverov, I., Fedkiw, R.: Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 1, 417–425 (2005)

    Article  Google Scholar 

  12. Lee, S.H., Terzopoulos, D.: Heads up! Biomechanical modeling and neuromuscular control of the neck. ACM Trans. Graph. 23, 1188–1198 (2006)

    Article  Google Scholar 

  13. Si, W., Lee, S.H., Sifakis, E., Terzopoulos, D.: Realistic biomechanical simulation and control of human swimming. ACM Trans. Graph. 34(10), 1–15 (2014)

    Article  Google Scholar 

  14. Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H.: Greedy layer-wise training of deep networks. In: Advances in Neural Information Processing Systems 19 (NIPS 2007), pp. 153–160 (2007)

    Google Scholar 

  15. Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: International Conference on Artificial Intelligence and Statistics, vol. 9, pp. 249–256 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Masaki Nakada .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Nakada, M., Terzopoulos, D. (2015). Deep Learning of Neuromuscular Control for Biomechanical Human Animation. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9474. Springer, Cham. https://doi.org/10.1007/978-3-319-27857-5_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27857-5_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27856-8

  • Online ISBN: 978-3-319-27857-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics