Abstract
We present our recent project on visual substitution by Ambisonic 3D-sound fields. Ideally, our system should be used by blind or visually impaired subjects having already seen. The original idea behind our targeted prototype is the use of an eye tracker and musical instrument sounds encoding coloured pixels. The role of the eye tracker is to activate the process of attention inherent in the vision and to restore by simulation the mechanisms of central and peripheral vision. Moreover, we advocate the view that cerebral areas devoted to the integration of information will play a role by rebuilding a global image of the environment. Finally, the role of colour itself is to help subjects distinguishing coloured objects or perceiving textures, such as sky, walls, grass and trees, etc ...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Algazi, V.R., Duda, R.O., Thompson, D.P., Avendano: The CIPIC HRTF Database. In: IEEE Proc. WASPAA 2001, New Paltz, NY (2001)
Andersen, R.A., Snyder, L.H., Bradley, D.C., Xing, J.: Multimodal Representation of Space in the Posterior Parietal Cortex and its Use in Planning. Annu. Rev. Neurosci. 20, 303–330 (1997)
Bamford, J.S.: An Analysis of Ambisonic Sound Systems of First and Second Order. Master Thesis, Waterloo, Ontario, Canada (1995)
Begault, R.: 3-D Sound for Virtual Reality and Multimedia. Boston A.P. Professional (1994) ISBN: 0120847353
Brown, C.P., Duda, R.O.: A Structural Model for Binaural Sound Synthesis. IEEE Trans. Speech and Audio Processing 6(5) (1998)
Capelle, C., Trullemans, C., Arno, P., Veraart, C.: A Real Time Experimental Prototype for Enhancement of Vision Rehabilitation Using Auditory Substitution. IEEE T. Bio-Med. Eng. 45, 1279–1293 (1998)
Colby, C.L., Goldberg, M.E.: Space and Attention in Parietal Cortex. Annu. Rev. Neurosci. 22, 319–349 (1999)
Cronly-Dillon, J., Persaud, K., Gregory, R.P.F.: The Perception of Visual Images Encoded in Musical Form: a Study in Cross-Modality Information. Proc. Biological Sciences 266, 2427–2433 (1999)
Daniel, J.: Acoustic Field Representation, Application to the Transmission and the Reproduction of Complex Sound Environments in a Multimedia Context. PhD thesis, University of Paris 6 (in French, English abstract available) (2000)
Gerzon, M.A.: Design of Ambisonic Decoders for Multispeaker Surround Sound. Journal of the Audio Engineering Society (Abstracts) 25, 1064 (1977)
Gonzalez-Mora, J.L., Rodriguez-Hernandez, A., Rodriguez-Ramos, L.F., Dfaz-Saco, L., Sosa, N.: Development of a New Space Perception System for Blind People, Based on the Creation of a Virtual Acoustic Space. In: Mira, J. (ed.) IWANN 1999. LNCS, vol. 1606, pp. 321–330. Springer, Heidelberg (1999)
Kay, L.: A Sonar Aid to Enhance Spatial Perception of the Blind: Engineering Design and Evaluation. The Radio and Electronic Engineer 44, 605–627 (1974)
Malham, D.G., Myatt, A.: 3-D Sound Spatialisation using Ambisonic Techniques. Computer Music Journal 19(4), 58–70 (1995)
Meijer, P.B.L.: An Experimental System for Auditory Image Representations. IEEE Transactions on Biomedical Engineering 39(2), 112–121 (1992)
Wong, F.H.T., Nagarajan, R., Yaacob, S., Chekima, A., Belkhamza, N.E.: A Stereo Auditory Display for Visually Impaired. In: Proc. TENCON, pp. 377–383 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bologna, G., Vinckenbosch, M. (2005). Eye Tracking in Coloured Image Scenes Represented by Ambisonic Fields of Musical Instrument Sounds. In: Mira, J., Álvarez, J.R. (eds) Mechanisms, Symbols, and Models Underlying Cognition. IWINAC 2005. Lecture Notes in Computer Science, vol 3561. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11499220_34
Download citation
DOI: https://doi.org/10.1007/11499220_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26298-5
Online ISBN: 978-3-540-31672-5
eBook Packages: Computer ScienceComputer Science (R0)