Digital Diorama: AR Exhibition System to Convey Background Information for Museums

  • Takuji Narumi
  • Oribe Hayashi
  • Kazuhiro Kasada
  • Mitsuhiko Yamazaki
  • Tomohiro Tanikawa
  • Michitaka Hirose
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6773)


In this paper, we propose a MR museum exhibition system, the “Digital Diorama” system, to convey background information intuitively. The The system aims to offer more features than the function of existing dioramas in museum exhibitions by using mixed reality technology. The system superimposes computer generated diorama scene reconstructed from related image/video materials onto real exhibits. First, we implement and evaluate location estimation methods of photos and movies are taken in past time. Then, we implement and install two types of prototype system at the estimated position to superimpose virtual scenes onto real exhibit in the Railway Museum. By looking into an eyehole type device of the proposed system, visitors can feel as if they time-trip around the exhibited steam locomotive and understand historical differences between current and previous appearance.


Mixed Reality Museum Exhibition Digital Museum 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bimber, O., Encarnacao, L.M., Schmalstieg, D.: The virtual showcase as a new platform for augmented reality digital storytelling. In: Proc. of the Workshop on Virtual Environments 2003, vol. 39, pp. 87–95 (2003)Google Scholar
  2. 2.
    Bimber, O., Coriand, F., Kleppe, A., Bruns, E., Zollmann, S., Langlotz, T.: Superimposing pictorial artwork with projected imagery. In: ACM SIGGRAPH 2005 Courses, p. 6 (2005)Google Scholar
  3. 3.
    Yoshida, T., Nii, H., Kawakami, N., Tachi, S.: Twincle: Interface for using handheld projectors to interact with physycal surfaces. In: ACM SIGGRAPH 2009 Emerging Technologies (2009)Google Scholar
  4. 4.
    Ueoka, R., Hirose, M., Kuma, K., Sone, M., Kohiyama, K., Kawamura, T., Hiroto, K.: Wearable computer application for open air exhibition in expo 2005. In: Proc. of the 2nd IEEE Pacific Rim Conference on Multimedia, pp. 8–15 (2001)Google Scholar
  5. 5.
    Kakuta, T., Oishi, T., Ikeuchi, K.: Virtual kawaradera: Fast shadow texture for augmented reality. In: Proc. of Intl. Society on Virtual Systems and MultiMedia 2004, pp. 141–150 (2004)Google Scholar
  6. 6.
    Papagiannakis, G., Schertenleib, S., O’Kennedy, B., Arevalo-Poizat, M., Magnenat-Thalmann, N., Stoddart, A., Thalmann, D.: Mixing virtual and real scenes in the site of ancient pompeii. Computer Animation & Virtual Worlds 16, 11–24 (2005)CrossRefGoogle Scholar
  7. 7.
    Vlahakis, V., Karigiannis, J., Tsotros, M., Gounaris, M., Almeida, L., Stricker, D., Gleue, T., Christou, I.T., Carlucci, R., Ioannidis, N.: Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites. In: Proc. of the 2001 Conference on Virtual Reality, Archeology and Cultural Heritage, pp. 131–140 (2001)Google Scholar
  8. 8.
    Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proc. of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 11–20 (1996)Google Scholar
  9. 9.
    Aoki, T., Tanikawa, T., Hirose, M.: Virtual 3D world construction by inter-connecting photograh-based 3D modeles. In: Proc. of IEEE Virtual Reality 2008, pp. 243–244 (2008)Google Scholar
  10. 10.
    Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Reconstructing building interiors from images. In: Twelfth IEEE Intl. Conference on Computer Vision, ICCV 2009 (2009)Google Scholar
  11. 11.
    Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: Exploring photo collections in 3D. In: Proc. of SIGGRAPH 2006, pp. 835–846 (2006)Google Scholar
  12. 12.
    Hirose, M., Watanabe, S., Endo, T.: Generation of wide-range virtual spaces using photographic images. In: Proc. of 4th IEEE Virtual Reality Annual Intl. Symposium, pp. 234–241 (1998)Google Scholar
  13. 13.
    Google Street View,
  14. 14.
    Gvili, R., Kaplan, A., Ofek, E., Yahav, G.: Depth keying. In: SPIE, pp. 564–574 (2003)Google Scholar
  15. 15.
    Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)CrossRefGoogle Scholar
  16. 16.
    Hartley, R.I.: In defense of the eight-point algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 580–593 (1997)CrossRefGoogle Scholar
  17. 17.
    Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proc. of ISMAR 2007, pp. 1–10 (2007)Google Scholar
  18. 18.
    Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the 1981 DARPA Image Understanding Workshop, pp. 121–130 (1981)Google Scholar
  19. 19.
    Kakuta, T., Oishi, T., Ikeuchi, K.: Shading and shadowing of architecture in mixed reality. In: Proceedings of ISMAR 2005, pp. 200–201 (2005)Google Scholar
  20. 20.
    Kiyokawa, K., Billinghurst, M., Campbell, B., Woods, E.: An occlusion-capable optical see-through head mount display for supporting co-located collaboration. In: Proc. of ISMAR 2003, pp. 133–141 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Takuji Narumi
    • 1
  • Oribe Hayashi
    • 2
  • Kazuhiro Kasada
    • 2
  • Mitsuhiko Yamazaki
    • 2
  • Tomohiro Tanikawa
    • 2
  • Michitaka Hirose
    • 2
  1. 1.Graduate School of EngineeringThe University of Tokyo / JSPSTokyoJapan
  2. 2.Graduate School of Information Science and TechnologyThe University of TokyoTokyoJapan

Personalised recommendations