Creation of Shadow Media Using Point Cloud and Design of Co-creative Expression Space

  • Maho HayashiEmail author
  • Yoshiyuki Miwa
  • Shiroh Itai
  • Hiroko Nishi
  • Yuto Yamakawa
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9735)


The authors have previously shown that, by using shadow media that transforms the color and shapes of shadows to transform the relationship between individuals and shadow media, a variety of bodily expressions is created from individual performers. In this study, we attempted to support co-creative expressions by transforming the relationships between performers and shadow media space. Specifically, we developed shadow media utilizing point clouds (dappled shadows) and made it possible to freely alter the light source position of shadow media. In addition, we implemented a shadow media system that displays a shadow agent moving according to the movements of a group of performers (a virtual light source robot) on a stage, and used its position as a light source. As a result, we found that the expression space of performers expanded in comparison with existing shadow media systems. This result shows the possibility that this system supports the emergence of co-creative expressions.


Co-creation Bodily expression Shadow media Point cloud Virtual light source 



This study received support from a JSPS Grant-in-Aid for Scientific Research (B) (Principal investigator: Yoshiyuki Miwa, No. 26280131) and the support of the “Principal of emergence for empathetic “Ba” and its applicability to communication technology” project at the RISE Waseda University. Graduate students Yusuke Kajita, Kento Yamaguchi, Ibuki Mizuno, Takemi Watanuk, Takahiro Sugano et al. assisted with system development and experiment execution. The authors wish to express their gratitude here.


  1. 1.
    Miwa, Y.: Co-creative expressions and communicability support. J. Soc. Instrum. Control Eng. 51(11), 1016–1022 (2012)Google Scholar
  2. 2.
    Miwa, Y., Ishibiki, C.: Shadow communication: system for embodied interaction with remote partners. In: Proceeding of CSCW 2004, pp. 467–476 (2004)Google Scholar
  3. 3.
    Miwa, Y., Itai, S., Watanabeand, T., Nishi, H.: Shadow awareness: enhancing theater space through the mutual projection of images on a connective slit-screen. Leonardo J. Int. Soc. Arts Sci. Technol. 44(4), 325–333 (2011). (SIGGRAPH 2011 Art paper)Google Scholar
  4. 4.
    Kajita, Y., Takahashi, T., Miwa, Y., Itai, S.: Designing the embodied shadow media using virtual three-dimensional space. In: Yamamoto, S., de Oliveira, N.P. (eds.) HIMI 2015. LNCS, vol. 9173, pp. 610–621. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-20618-9_60 CrossRefGoogle Scholar
  5. 5.
    Aitor, A., Marton, Z., Tombari, F., Wohlkinger, W., Potthast, C., Zeisl, B., Rusu, R., Gedikli, S., Vincze, M.: Point cloud library. IEEE Robot. Autom. Mag. 19, 80–91 (2012)CrossRefGoogle Scholar
  6. 6.
    Mitra, N.J., Nguyen, A.: Esting surface normal in noisy point cloud data. In: Proceedings of the Nineteenth Annual Symposium on Computational Geometry, pp. 322–328 (2003)Google Scholar
  7. 7.
    Watanabe, T., Miwa, Y.: Duality of embodiment and support for co-creation in hand contact improvisation. J. Adv. Mech. Des. Syst. Manuf. 6(7), 1307–1319 (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Maho Hayashi
    • 1
    Email author
  • Yoshiyuki Miwa
    • 2
  • Shiroh Itai
    • 2
  • Hiroko Nishi
    • 3
  • Yuto Yamakawa
    • 1
  1. 1.Graduate School of Creative Science and EngineeringWaseda UniversityTokyoJapan
  2. 2.Faculty of Science and EngineeringWaseda UniversityTokyoJapan
  3. 3.Faculty of Human ScienceToyo Eiwa UniversityKanagawaJapan

Personalised recommendations