Skip to main content

Using Motion Expressiveness and Human Pose Estimation for Collaborative Surveillance Art

  • Conference paper
  • First Online:
Interactivity, Game Creation, Design, Learning, and Innovation (ArtsIT 2018, DLI 2018)

Abstract

Surveillance art is a contemporary art practice that deals with the notion of human expressiveness in public spaces and how monitoring data can be transformed into more poetic forms, unleashing their creative potential. Surveillance, in a sociopolitical context, is a participatory activity that has changed radically in recent years and could be argued to produce, not only social control but also to contribute to the formation of a collective image of feelings and affects expressed in modern societies. The paper explores a multidisciplinary approach based on tracking human motion from surveillance cameras on New York Time Square. The performed human trajectories were tracked with a real-time machine vision framework and the outcomes were used to feed a generative design algorithm in order to transform the data into emotionally expressive 3D visualizations. Finally, a study was conducted to assess the expressive power of this approach so as to better understand the relationships among perceived affective qualities and human behaviors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Miebach, N.: Weather (2018). http://nathaliemiebach.com/weather.html

  2. Frick, L.: Sleep Patterns (2012). http://www.lauriefrick.com/sleep-patterns

  3. Cao, Z., Simon, T., Wei, S. E., Sheikh, Y.: Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 (2017). https://doi.org/10.1109/CVPR.2017.143

  4. Qiao, S., Wang, Y., Li, J.: Real-time human gesture grading based on OpenPose. In: Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017 (2018). https://doi.org/10.1109/CISP-BMEI.2017.8301910

  5. Obradović, M., Marković, S.: Creating 3D shapes by time extrusion of moving objects. In: 20th Generative Art Conference GA 2017 (2017)

    Google Scholar 

  6. Takahashi, K.: Voxelman, 30 May 2018. https://github.com/keijiro/Voxelman

  7. Carlucci, D., Schiuma, G., Santarsiero, F.: Toward a data-driven world: challenges and opportunities in arts and humanities. In: Big Data in the Arts and the Humanities: Theory and Practice. CRC Press (2018)

    Google Scholar 

  8. Depoorter, D.: Jaywalking (2016). https://driesdepoorter.be/jaywalking/

  9. Lee-Delisle, S.: Lunar Trails, 25 May 2012. http://seb.ly/work/lunar-trails/

  10. McCormack, J., Bown, O., Dorin, A., McCabe, J., Monro, G., Whitelaw, M.: Ten questions concerning generative computer art. Leonardo 47(2), 135–141 (2014)

    Article  Google Scholar 

  11. Edmonds, E.: From interaction to influence: generating form and space. In: GA 2015 – XVIII Generative Art Conference (2015)

    Google Scholar 

  12. Bisig, D., Bogner, F.: Pendulum – Exploiting Simple Physics for Generative Art. In: Generative Art Conference GA 2017 (2017)

    Google Scholar 

  13. Posner, J., Russell, J.A., Peterson, B.S.: The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 17(3), 715–734 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to George Palamas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Billeskov, J.A., Møller, T.N., Triantafyllidis, G., Palamas, G. (2019). Using Motion Expressiveness and Human Pose Estimation for Collaborative Surveillance Art. In: Brooks, A., Brooks, E., Sylla, C. (eds) Interactivity, Game Creation, Design, Learning, and Innovation. ArtsIT DLI 2018 2018. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 265. Springer, Cham. https://doi.org/10.1007/978-3-030-06134-0_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-06134-0_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-06133-3

  • Online ISBN: 978-3-030-06134-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics