Skip to main content
SpringerLink
Log in

Robotic Puppets and the Engineering of Autonomous Theater

  • Chapter
  • First Online:
Controls and Art

Abstract

This chapter outlines the design of software for embedded control of robotic marionettes using choreography. In traditional marionette puppetry, the puppets often possess dynamics that are quite different from the creatures they imitate. Puppeteers must therefore understand and leverage the inherent dynamics of the puppets to create believable and expressive characters. Because marionettes are actuated by strings, the mechanical description of the marionettes either creates a multiscale or degenerate system—making simulation of the constrained dynamics challenging. Moreover, marionettes have 40–50 degrees of freedom with closed kinematic chains. Generating puppet choreography that is mimetic (that is, recognizably human) results in a high-dimensional nonlinear optimal control problem that must be solved for each motion. In performance, these motion primitives must be combined in a way that preserves stability, resulting in an optimal timing control problem. Our software accounts for the efficient computation of the (1) discrete time dynamics that preserve the constraints and other integrals of motion, (2) nonlinear optimal control policies (including optimal control of LTV systems), and (3) optimal timing of choreography, all within a single framework. We discuss our current results and the potential application of our findings across disciplines, including the development of entertainment robots and autonomous theater.

This material is based upon work supported by the National Science Foundation under award IIS-0917837. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Goodman N (1978) Ways of worldmaking. Hackett Publishing, Indianapolis

    Google Scholar 

  2. Kant I (1911) Critique of aesthetic judgement (1790). Oxford University Press, Oxford

    Google Scholar 

  3. Schiller F (1794) On the aesthetic education of man. Oxford University Press, Oxford

    Google Scholar 

  4. Smith R (2008) Open dynamics engine. http://www.ode.org

  5. Smith R (2004) Dynamics simulation: a whirlwind tour (current state, and new frontiers). http://ode.org/slides/parc/dynamics.pdf

  6. Baraff D (1996) Linear-time dynamics using Lagrange multipliers. In: SIGGRAPH, pp 137–146

    Google Scholar 

  7. Baraff D (1994) Fast contact force computation for nonpenetrating rigid bodies. In: SIGGRAPH

    Google Scholar 

  8. Baraff D (1993) Non-penetrating rigid body simulation. In: State of the Art Reports

    Google Scholar 

  9. Featherstone R (1987) Robot dynamics algorithms. Kluwer Academic Publishers, Boston. The Springer International Series in Engineering and Computer Science Vol 22, Springer US New York

    Google Scholar 

  10. Francis P (2012) Puppetry. Palgrave Macmillan, London

    Google Scholar 

  11. Kleist H (1972) On the marionette theatre. Drama Rev 16(3):22–26

    Google Scholar 

  12. Craig EG (2009) On the art of the theatre. Routledge, London

    Google Scholar 

  13. Kaplin S (1999) A puppet tree: a model for the field of puppet theatre. TDR 43(3):28–35

    Google Scholar 

  14. Jochum E (2013) King kong by Craig Lucas and Marius de Vries (review). Theatre J 65(4):580–582

    Google Scholar 

  15. Burnham J (1968) Beyond modern sculpture: the effects of science and technology on the sculpture of this century. George Braziller, New York

    Google Scholar 

  16. Salter C (2010) Entangled: technology and the transformation of performance. MIT Press, Cambridge

    Google Scholar 

  17. Wood G (2002) Edison’s Eve: a magical history of the quest for mechanical life. A.A. Knopf, New York

    Google Scholar 

  18. Jurkowski H (1988) Aspects of puppet theatre. Puppet Centre Trust, London

    Google Scholar 

  19. Johnson E, Murphey T (2007) Dynamic modeling and motion planning for marionettes: Rigid bodies articulated by massless strings. In: International conference on robotics and automation, Vol 2007. Rome

    Google Scholar 

  20. Johnson ER, Murphey TD (2010) Scalable variational integrators for constrained mechanical systems in generalized coordinates. IEEE Trans Rob. 25(6):1249–1261

    Google Scholar 

  21. Bullo F, Lewis A (2005) Low-order controllability and kinematic reductions for affine connection control systems. SIAM J Control Optim 44(3):885–908

    Google Scholar 

  22. Bullo F, Lewis A (2004) Geometric control of mechanical systems, ser. number 49 in texts in applied mathematics. Springer, London

    Google Scholar 

  23. Nakamura Y, Yamane K (2000) Dynamics computation of structure-varying kinematic chains and its application to human figures. IEEE Trans Robot Autom 16(2):124–134

    Google Scholar 

  24. Johnson E, Murphey TD (2010) Linearizations for mechanical systems in generalized coordinates. In: American controls conference (ACC), pp 629–633

    Google Scholar 

  25. Hauser J (2002) A projection operator approach to optimization of trajectory functionals. In: IFAC world congress, Barcelona, 2002

    Google Scholar 

  26. Martin P, Johnson E, Murphey TD, Egerstedt M (2010) Constructing and implementing motion programs for robotic marionettes. IEEE Trans Autom Control 56(4):902–907

    Google Scholar 

  27. Egerstedt M, Murphey TD, Ludwig J (2007) Hybrid systems: computation and control. In: Bemporad A, Bicchi A, Buttazzo GC (eds) Motion programs for puppet choreography and control. Lecture notes in computer science, vol TBD. Springer, pp 190–202

    Google Scholar 

  28. Murphey TD, Egerstedt ME (2007) Choreography for marionettes: imitation, planning, and control. In: IEEE international conference on intelligent robots and systems workshop on art and robotics, p 6

    Google Scholar 

  29. Johnson E, Murphey TD (2010) Second-order switching time optimization for nonlinear time-varying dynamic systems. IEEE Trans Autom Control. 56(8):1953–1957

    Google Scholar 

  30. Caldwell T, Murphey TD (2011) Switching mode generation and optimal estimation with application to skid-steering. Automatica 47(1):50–64

    Google Scholar 

  31. Egerstedt M, Wardi Y, Delmotte F (2003) Optimal control of switching times in switched dynamical systems. In: IEEE conference on decision and control, Maui, Dec 2003

    Google Scholar 

  32. Egerstedt M, Wardi Y, Axelsson H (2003) Optimal control of switching times in hybrid systems. In: IEEE methods and models in automation and robotics, Miedzyzdroje

    Google Scholar 

  33. Johnson E, Murphey TD (2009) Scalable variational integrators for constrained mechanical systems in generalized coordinates. IEEE Trans Robot 25(6):1249–1261

    Google Scholar 

  34. Nichols K, Murphey TD (2008) Variational integrators for constrained cables. In: IEEE international conference on automation science and engineering (CASE), pp 802–807

    Google Scholar 

  35. Kharevych L, Yang W, Tong Y, Kanso E, Marsden JE, Schroder P, Desbrun M (2006) Geometric, variational integrators for computer animation. Eurographics/ACM SIGGRAPH symposium on computer, animation

    Google Scholar 

  36. Lew A, Marsden JE, Ortiz M, West M (2004) Variational time integrators. Int J Numer Meth Eng 60:153–212

    Google Scholar 

  37. Lew A, Marsden JE, Ortiz M, West M (2004) An overview of variational integrators. In: Finite element methods: 1970’s and beyond, pp 98–115

    Google Scholar 

  38. West M (2004) Variational integrators. California Institute of Technology Thesis

    Google Scholar 

  39. Lew A, Marsden JE, Ortiz M, West M (2003) Asynchronous variational integrators. Arch Ration Mech Anal 167:85–146

    Google Scholar 

  40. Marsen JE, West M (2001) Discrete mechanics and variational integrators. Acta Numerica 10:357–514

    Google Scholar 

  41. Anderson B, Moore J (1971) Linear optimal control. Prentice Hall Inc, Englewood Cliffs. Upper Saddle River, New Jersey

    Google Scholar 

  42. Snyder K, Murphey TD (2010) Second-order DMOC using projections. In IEEE international conference on decision and control (CDC), 2010

    Google Scholar 

  43. Paynter B (2009) Robodinos: what could possibly go wrong? Wired magazine. Issue 17.08

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Northwestern University, Evanston, IL, USA

    Elizabeth Jochum, Jarvis Schultz, Elliot Johnson & T. D. Murphey

Authors
  1. Elizabeth Jochum
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jarvis Schultz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elliot Johnson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. T. D. Murphey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to T. D. Murphey .

Editor information

Editors and Affiliations

  1. Systems and Information Engineering Department, University of Virginia, Charlottesville, Virginia, USA

    Amy LaViers

  2. School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, Georgia, USA

    Magnus Egerstedt

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Jochum, E., Schultz, J., Johnson, E., Murphey, T.D. (2014). Robotic Puppets and the Engineering of Autonomous Theater . In: LaViers, A., Egerstedt, M. (eds) Controls and Art. Springer, Cham. https://doi.org/10.1007/978-3-319-03904-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-03904-6_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-03903-9

  • Online ISBN: 978-3-319-03904-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation