Abstract
New-generation media such as the 4D film have appeared lately to deliver immersive physical experiences, yet the authoring has relied on content artists, impeding the popularization of such media. An automated approach for the authoring becomes increasingly crucial in lowering production costs and saving user interruption. This paper presents a fully automated framework of authoring tactile effects from existing video images to render synchronized visuotactile stimuli in real time. The spatiotemporal features of video images are analyzed in terms of visual saliency and translated into tactile cues that are rendered on tactors installed on a chair. A user study was conducted to evaluate the usability of visuotactile rendering against visual-only presentation. The result indicated that the visuotactile rendering can improve the movie to be more interesting, immersive, appealing, and understandable.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cha, J., Kim, S.Y., Ho, Y.S., Ryu, J.: 3D Video Player System with Haptic Interaction based on Depth Image-Based Representation. IEEE Trans. Consumer Electronics 52(2), 477–484 (2006)
C.I.E: Recommendations on uniform colour spaces, colour difference equations, psychometric colour terms, supplement No.2 to CIE publication No.15 (E.-1.3.1) 1971/(TC-1.3.) (1978)
Collins, C.: Tactile Television-Mechanical and Electrical Image Projection. IEEE Trans. Man-Machine Systems 11(1), 65–71 (1970)
Connor, C.E., Egeth, H.E., Yantis, S.: Visual attention: Bottom-up versus top-down. Current Biology 14(19), R850–R852 (2004)
Desimone, R., Duncan, J.: Neural mechanisms of selective visual attention. Annual Review of Neuroscience 18(1), 193–222 (1995)
Hamed, H.M., Hema, R.A.: The Application of the 4-D Movie Theater System in Egyptian Museums for Enhancing Cultural Tourism. Journal of Tourism 10(1), 37–53 (2009)
Hoffman, D., Singh, M.: Salience of visual parts. Cognition 63(1), 29–78 (1997)
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Kim, Y., Cha, J., Ryu, J., Oakley, I.: A Tactile Glove Design and Authoring System for Immersive Multimedia. IEEE Multimedia 17(3), 34–45 (2010)
Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4(4), 219–227 (1985)
Lee, S., Kim, G.J., Choi, S.: Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD. IEEE Trans. Visualization and Computer Graphics 15(1), 6–19 (2009)
Lemmens, P., Crompvoets, F., Brokken, D., van den Eerenbeemd, J., De Vries, G.: A body-conforming tactile jacket to enrich movie viewing. In: Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 7–12 (2009)
Oh, E., Lee, M., Lee, S.: How 4D Effects cause different types of Presence experience? In: Proc. the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, pp. 375–378 (2011)
Parkhurst, D., Law, K., Niebur, E.: Modeling the role of salience in the allocation of overt visual attention. Vision Research 42(1), 107–123 (2002)
Treisman, A.M., Gelade, G.: A Feature-Integration Theory of Attention. Cognitive Psychology 12, 97–136 (1980)
Walther, D., Itti, L., Riesenhuber, M., Poggio, T., Koch, C.: Attentional Selection for Object Recognition - A Gentle Way. In: Bülthoff, H.H., Lee, S.-W., Poggio, T.A., Wallraven, C. (eds.) BMCV 2002. LNCS, vol. 2525, pp. 472–479. Springer, Heidelberg (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, M., Lee, S., Choi, S. (2012). Saliency-Driven Tactile Effect Authoring for Real-Time Visuotactile Feedback. In: Isokoski, P., Springare, J. (eds) Haptics: Perception, Devices, Mobility, and Communication. EuroHaptics 2012. Lecture Notes in Computer Science, vol 7282. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31401-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-31401-8_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31400-1
Online ISBN: 978-3-642-31401-8
eBook Packages: Computer ScienceComputer Science (R0)