A Realtime and Direct-Touch Interaction System for the 3D Cultural Artifact Exhibition

  • Wataru Wakita
  • Katsuhito Akahane
  • Masaharu Isshiki
  • Hiromi T. Tanaka
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6774)


We propose a realtime and direct-touch interaction system for 3D cultural artifact exhibition based on a texture-based haptic rendering technique. In the field of digital archive, it is important to archive and exhibit the cultural artifact at the high-definition. To archive the shape, color and texture of the cultural artifact, it is important to archive and represent not only visual effect but haptic impression. Therefore, multimodal digital archiving, realtime multisensory rendering, and intuitive and immersive exhibition system are necessary. Therefore, we develop a realtime and direct-touch interaction system for the 3D cultural artifact exhibition based on a texture-based haptic rendering technique. In our system, the viewer can directly touch a stereoscopic vision of 3D digital archived cultural artifact with the string-based and scalable haptic interface device "SPIDAR" and vibration motor.


Digital Museum Virtual Reality Computer Graphics Haptics 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Tanaka, H.T., Yano, K., Hachimura, K., Nishiura, T., Choi, W., Fukumori, T., Furukawa, K., Wakita, W., Tsuchida, M., Saiwaki, N.: Digital Archiving of the World Intangible Cultural heritage “Gion Festival in Kyoto”: Reproduction of “Fune-boko” Float of the Gion Festival Parade in “Virtual Kyoto”. In: Proceedings of the ASIAGRAPH 2010, Shanghai, China (2010)Google Scholar
  2. 2.
    Tanaka, H.T., Hachimura, K., Yano, K., Tanaka, S., Furukawa, K., Nishiura, T., Tsutida, M., Choi, W., Wakita, W.: Multimodal Digital Archiving and Reproduction of the World Cultural Heritage “Gion Festival in Kyoto”. In: Proceedings of the ACM SIGGRAPH Sponsored 9th International Conference on VR Continuum and Its Applications in Industry (VRCAI 2010), COEX, Seoul, Korea (2010)Google Scholar
  3. 3.
    Sato, M.: Development of string-based force display: Spidar. In: Proceedings of the 8th International Conference on Virtual Systems and Multi Media (VSMM 2002), Gyeongju, Korea (2002)Google Scholar
  4. 4.
    Mark, W.R., Randolph, S.C., Finch, M., Verth, J.M.V., Taylor II, R.M.: Adding Force Feedback to Graphics Systems: Issues and Solutions. In: Proceedings of the SIGGRAPH 1996, New Orleans, U.S.A, pp. 447–452 (1996)Google Scholar
  5. 5.
    Massie, T.H., Salisburg, J.K.: The PHANTOM Haptic Interface: A Device for Probing Virtual Objects. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, DSC, Chicago, U.S.A, vol. 55(1), pp. 295–301 (1994)Google Scholar
  6. 6.
    Zilles, C., Salisbury, K.: A constraint-based God-object method for haptic display. In: Proceedings of the IEEE/RSJ International Conference Intelligent Robots and Systems, Pittsburgh, U.S.A, pp. 146–151 (1995)Google Scholar
  7. 7.
    Stanney, K.: Haptic Rendering In Virtual Environments. Handbook of Virtual Environments. In: Basdogan, C., Srinivasan, M.A. (eds.), pp. 117–134. Lawrence Erlbaum Associates, Inc., London (2001)Google Scholar
  8. 8.
    Theoktisto, V., Fairén, M., Navazo, I., Moncĺus, E.: Rendering detailed haptic textures. In: Proceeding of the 2nd Workshop in Virtual Reality Interactions and Physical Simulations (VRIPHYS 2005), Pisa, Italy, pp. 16–23 (2005)Google Scholar
  9. 9.
    Wakita, W., Ido, S.: A Material System under Haptic Rendering for Pseudo-Roughness. IEICE Trans. Inf. & Syst (Japanese Edition) J91-D(8), 2061–2070 (2008)Google Scholar
  10. 10.
    Wakita, W., Ido, S.: A Haptic Rendering for High Polygon Model Using Distance Map and Normal Map. IPSJ Journal 49(7), 2509–2517 (2008)Google Scholar
  11. 11.
    Ozaki, R., Nishiwaki, Y., Takeda, Y.: Weave pattern modeling of silk-like fabrics from multi-illuminated HDR image analysis. Transactions of the Virtual Reality Society of Japan 14, 315–324 (2009)Google Scholar
  12. 12.
    Nomura, K., Yin, X., Sakaguchi, Y., Tanaka, H.: Modeling system of tactile feeling based on photometoric images analysis. IEICE Trans. Inf. & Syst (Japanese Edition) J93-D(10), 2326–2329 (2010)Google Scholar
  13. 13.
    Christou, C., Angus, C., Celine Loscos, C., Dettori, A., Roussou, M.: A Versatile Large-Scale Multimodal VR System for Cultural Heritage Visualization. In: Proceeding of the ACM symposium on Virtual Reality Software and Technology (VRST 2006), Limassol, Cyprus, pp. 133–140 (2006)Google Scholar
  14. 14.
    Carrozzino, M., Bergamasco, M.: Beyond virtual museums: Experiencing immersive virtual reality in real museums. Journal of Cultural Heritage 11(4), 452–458 (2010)CrossRefGoogle Scholar
  15. 15.
    Inami, M., Kawakami, N., Sekiguchi, D., Yanagida, Y., Maeda, T., Tachi, S.: Visuo-Haptic Display Using Head-Mounted Projector. In: Proceedings of the IEEE Virtual Reality 2000, pp. 233–240 (2000)Google Scholar
  16. 16.
    Arsenault, R., Ware, C.: Eye-hand co-ordination with force feedback. In: Proceedings of the ACM Conferernce on Human Factors in Computing Systems (CHI 2000), pp. 408–414 (2000)Google Scholar
  17. 17.
    Arsenault, R., Ware, C.: The Importance of Stereo and Eye Coupled Perspective for Eye-Hand Coordination in Fish Tank VR. Presence 13(5), 549–559 (2004)CrossRefGoogle Scholar
  18. 18.
    Vallino, J., Brown, C.: Haptics in augmented reality. In: Proceedings of the IEEE. Int’l Conf. on Multimedia Computing and Systems (ICMCS), vol. 1, pp. 195–200 (1999)Google Scholar
  19. 19.
    Bianchi, G., Knoerlein, B., Szekely, G., Harders, M.: High precision augmented reality haptics. In: Proceedings of EuroHaptics, pp. 169–178 (2006)Google Scholar
  20. 20.
    Sandor, C., Uchiyama, S., Yamamoto, H.: Visuo-Haptic Systems: Half-Mirrors Considered Harmful. In: Proceedings of the WHC 2007, pp. 292–297 (2007)Google Scholar
  21. 21.
    Sandor, C., Kuroki, T., Uchiyama, S., Yamamoto, H.: Exploring Visuo-Haptic Mixed Reality. Technical Report PRMU 2006-199 IEICE, Tokyo, Japan, vol. 106, pp. 31–36 (2007)Google Scholar
  22. 22.
    Brederson, J.D., Ikits, M., Johnson, C., Hansen, C.: In: Proceedings of the PHANToM Users Group Workshop, Aspen, CO, pp. 46–49 (2000)Google Scholar
  23. 23.
    Ikits, M., Hansen, C., Johnson, C.: A Comprehensive Calibration and Registration Procedure for the Visual Haptic Workbench. In: Proceedings of the Eurographics Workshop on Virtual Environments, Zurich, Switzerland, pp. 247–254 (2003)Google Scholar
  24. 24.
    Ikits, M., Brederson, J.D.: In: Hansen, C., Johnson, C. (eds.) Visualization Handbook, pp. 431–447. Academic Press, London (2004)Google Scholar
  25. 25.
    Yoshida, T., Kamuro, S., Minamizawa, K., Nii, H., Tachi, S.: RePro3D: Full-Parallax 3D Display Using Retro-Reflective Projection Technology. In: Proceedings of the ACM SIGGRAPH 2010 Emerging Technologies, Los Angeles, California (2010)Google Scholar
  26. 26.
    Wakita, W., Murakami, K., Ido, S.: Development of a Texture-Based Haptic Modeling System. IEICE Trans. Inf. & Syst. (Japanese Edition) J91-D(12), 2773–2780 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Wataru Wakita
    • 1
  • Katsuhito Akahane
    • 2
  • Masaharu Isshiki
    • 3
  • Hiromi T. Tanaka
    • 1
  1. 1.Department of Human and Computer Intelligence, College of Information Science and EngineeringRitsumeikan UniversityKusatsuJapan
  2. 2.Precision and Intelligence LabTokyo Institute of TechnologyYokohamaJapan
  3. 3.Department of Electrical and Electronic Engineering and Computer ScienceEhime UniversityMatsuyamaJapan

Personalised recommendations