Skip to main content

Mathematical Models of Perception and Generation of Art Works by Dynamic Motions

  • Conference paper
  • First Online:
Modeling, Simulation and Optimization of Complex Processes - HPSC 2012

Abstract

This paper presents a study on the role of dynamic motions in the creation and perception processes of action-art paintings. Although there is a lot of interest and some qualitative knowledge around, there are no quantitative models in the scientific computing sense about this process yet. To create such models and implement them on a robotic platform is the objective of our work. Therefore, we performed motion capture experiments with an artist and reconstructed the recorded motions by fitting the data to a rigid-body model of the artist’s arm. A second model of a 6-DOF robotic platform is used to generate new motions by means of optimization and optimal control algorithms. Additionally, we present an image analysis framework that computes certain image characteristics related to aesthetic perception and a web tool that we developed to perform online sorting and cluster studies with participants. We present first results concerning motion reconstruction and perception studies and give an outlook to what will be the next steps towards an autonomous painting robotic platform.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rosenberg, H.: The American action painters. Art News 51/8, 22 1952

    Google Scholar 

  2. Felis, M., Mombaur, K.: Modeling and optimization of human walking. Cognitive Systems Monographs, Springer LNEE. 18, 31–42 (2013)

    Google Scholar 

  3. Leder, H., Belke, B., Oeberst, A., Augustin, D.: A model of aesthetic appreciation and aesthetic judgments. Br. J. Psychol. 95(4), 489–508 (2004)

    Article  Google Scholar 

  4. Buxbaum, L.J., Kyle, K.M., Menon, R.: On beyond mirror neurons: internal representations subserving imitation and recognition of skilled object-related actions in humans. Cogn. Brain Res. 25, 226–239 (2005)

    Article  Google Scholar 

  5. Urgesi, C., Moro, V., Candidi, M., Aglioti, S.M.: Mapping implied body actions in the human motor system. J. Neurosci. 26, 7942–7949 (2006)

    Article  Google Scholar 

  6. Knoblich, G., Seigerschmidt, W., Flach, R., Prinz, W.: Authorship effects in the prediction of handwriting strokes: evidence for action simulation during action perception. Q. J. Exp. Psychol. 55(3), 1027–1046 (2002)

    Article  Google Scholar 

  7. Freedberg, D., Gallese, V.: Motion, emotion and empathy in esthetic experience. Trends Cogn. Sci. 11, 197–203 (2007)

    Article  Google Scholar 

  8. Taylor, J.E.T., Witt, J.K., Grimaldi, P.J.: Uncovering the connection between artist and audience: viewing painted brushstrokes evokes corresponding action representations in the observer. Cognition 125(1), 26–36 (2012)

    Article  Google Scholar 

  9. Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–126 (2000)

    Google Scholar 

  10. Ducati, D.: ComputergestĂ¼tzte Bildanalyse in der Robotik. Thesis, IWR, University of Heidelberg (2012)

    Google Scholar 

  11. Taylor, R.P., Micolich, A.P., Jonas, D.: Fractal analysis of Pollock’s drip paintings. Nature 399, 422 (1999)

    Article  Google Scholar 

  12. Bock, H.G., Plitt, K.J.: A multiple shooting algorithm for direct solution of optimal control problems. In: Proceedings 9th IFAC World Congress, Budapest. Pergamon Press, pp. 242–247 (1984)

    Google Scholar 

  13. Leineweber, D.B., Bauer, I., Bock, H.G., Schlöder, J.P.: An efficient multiple shooting based reduced SQP strategy for large-scale dynamic process optimization – part I: theoretical aspects. Comput. Chem. Eng. 27, 157–166 (2003)

    Article  Google Scholar 

  14. Felis, M.: RBDL – the Rigid Body Dynamics Library (2011). http://rbdl.bitbucket.org.Cited15May2012

  15. Schultz, G., Mombaur, K.: Modeling and optimal control of human-like running. IEEE/ASME Trans. Mechatron. 15(5), 783–792, (2010, published online 2009)

    Google Scholar 

  16. Felis, M., Mombaur, K., Berthoz, A.: Mathematical modeling of emotional body language during human walking. In: Modeling, Simulation and Optimization of Complex Processes - HPSC 2012, Proceedings of the 5th International Conference on HPSC, March 5-9, 2012, Hanoi, Vietnam

    Google Scholar 

  17. Raschke, M., Mombaur, K., Schubert, A.: An optimisation-based robot platform for the generation of action paintings. Int. J. Arts Technol. 4(2), 181–195 (2011)

    Article  Google Scholar 

  18. de Leva, P.: Adjustments to Zatsiorsky-Seluyanov’s segment inertia parameters. J. Biomech. 29(9), 1223–1230 (1996)

    Article  Google Scholar 

  19. Mombaur, K., Truong, A., Laumond, J-P.: From human to humanoid locomotion – an inverse optimal control approach. Auton. Robots 28(3), 369–383 (2010)

    Google Scholar 

  20. Hatz, K., Schlöder, J.P., Bock, H.G.: Estimating parameters in optimal control problems. SIAM J. Sci. Comput. 34(3), A1707–A1728 (2012)

    Article  MATH  Google Scholar 

Download references

Acknowledgements

The authors want to thank the Simulation and Optimization research group of IWR at the University of Heidelberg for the permission to work with the software package MUSCOD-II. We greatfully acknowledge financial and scientific support that was given by the Heidelberg Graduate School of Mathematical and Computational Methods for the Sciences, funded by DFG (Deutsche Forschungsgemeinschaft). We also greatfully acknowledge financial travel support granted by DAAD (Deutscher Akademischer Austauschdienst). Finally, we want to thank Nicole Suska for the possibility to perform motion capture experiments with her.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Schubert .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Schubert, A., Mombaur, K., Funke, J. (2014). Mathematical Models of Perception and Generation of Art Works by Dynamic Motions. In: Bock, H., Hoang, X., Rannacher, R., Schlöder, J. (eds) Modeling, Simulation and Optimization of Complex Processes - HPSC 2012. Springer, Cham. https://doi.org/10.1007/978-3-319-09063-4_17

Download citation

Publish with us

Policies and ethics