Using Motion Expressiveness and Human Pose Estimation for Collaborative Surveillance Art

  • Jonas Aksel Billeskov
  • Tobias Nordvig Møller
  • Georgios Triantafyllidis
  • George PalamasEmail author
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 265)


Surveillance art is a contemporary art practice that deals with the notion of human expressiveness in public spaces and how monitoring data can be transformed into more poetic forms, unleashing their creative potential. Surveillance, in a sociopolitical context, is a participatory activity that has changed radically in recent years and could be argued to produce, not only social control but also to contribute to the formation of a collective image of feelings and affects expressed in modern societies. The paper explores a multidisciplinary approach based on tracking human motion from surveillance cameras on New York Time Square. The performed human trajectories were tracked with a real-time machine vision framework and the outcomes were used to feed a generative design algorithm in order to transform the data into emotionally expressive 3D visualizations. Finally, a study was conducted to assess the expressive power of this approach so as to better understand the relationships among perceived affective qualities and human behaviors.


Generative art Surveillance data Motion expressiveness Data transformation Human pose estimation 3D visualization 


  1. 1.
    Miebach, N.: Weather (2018).
  2. 2.
    Frick, L.: Sleep Patterns (2012).
  3. 3.
    Cao, Z., Simon, T., Wei, S. E., Sheikh, Y.: Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 (2017).
  4. 4.
    Qiao, S., Wang, Y., Li, J.: Real-time human gesture grading based on OpenPose. In: Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017 (2018).
  5. 5.
    Obradović, M., Marković, S.: Creating 3D shapes by time extrusion of moving objects. In: 20th Generative Art Conference GA 2017 (2017)Google Scholar
  6. 6.
    Takahashi, K.: Voxelman, 30 May 2018.
  7. 7.
    Carlucci, D., Schiuma, G., Santarsiero, F.: Toward a data-driven world: challenges and opportunities in arts and humanities. In: Big Data in the Arts and the Humanities: Theory and Practice. CRC Press (2018)Google Scholar
  8. 8.
    Depoorter, D.: Jaywalking (2016).
  9. 9.
    Lee-Delisle, S.: Lunar Trails, 25 May 2012.
  10. 10.
    McCormack, J., Bown, O., Dorin, A., McCabe, J., Monro, G., Whitelaw, M.: Ten questions concerning generative computer art. Leonardo 47(2), 135–141 (2014)CrossRefGoogle Scholar
  11. 11.
    Edmonds, E.: From interaction to influence: generating form and space. In: GA 2015 – XVIII Generative Art Conference (2015)Google Scholar
  12. 12.
    Bisig, D., Bogner, F.: Pendulum – Exploiting Simple Physics for Generative Art. In: Generative Art Conference GA 2017 (2017)Google Scholar
  13. 13.
    Posner, J., Russell, J.A., Peterson, B.S.: The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 17(3), 715–734 (2005)CrossRefGoogle Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Jonas Aksel Billeskov
    • 1
  • Tobias Nordvig Møller
    • 1
  • Georgios Triantafyllidis
    • 1
  • George Palamas
    • 1
    Email author
  1. 1.Aalborg University CopenhagenCopenhagenDenmark

Personalised recommendations