Blind Navigation along a Sinuous Path by Means of the See ColOr Interface

  • Guido Bologna
  • Benoît Deville
  • Thierry Pun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5602)


The See ColOr interface transforms a small portion of a coloured video image into sound sources represented by spatialized musical instruments. This interface aims at providing visually impaired people with a capability of perception of the environment. In this work, the purpose is to verify the hypothesis that it is possible to use sounds from musical instruments to replace colour. Compared to state of the art devices, a quality of the See ColOr interface is that it allows the user to receive a feed-back auditory signal from the environment and its colours, promptly. An experiment based on a head mounted camera has been performed. Specifically, this experiment is related to outdoor navigation for which the purpose is to follow a sinuous path. Our participants successfully went along a red serpentine path for more than 80 meters.


Sound Source Musical Instrument Blind Person Blind Individual Instrument Sound 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Algazi, V.R., Duda, R.O., Thompson, D.P.: The CIPIC HRTF database. In: IEEE Proc. Workshop on Applications of Signal Processing to Audio and Acoustics, Mohonk Mountain House (WASPAA 2001), New Paltz, NY (2001)Google Scholar
  2. 2.
    Begault, R.: 3-D Sound for virtual reality and multimedia. A.P. Professional, Boston (1994)Google Scholar
  3. 3.
    Bologna, G., Vinckenbosch, M.: Eye Tracking in Coloured Image Scenes Represented by Ambisonic Fields of Musical Instrument Sounds. In: Mira, J., Álvarez, J.R. (eds.) IWINAC 2005. LNCS, vol. 3561, pp. 327–337. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  4. 4.
    Bologna, G., Deville, B., Pun, T., Vinckenbosch, M.: Identifying major components of pictures by audio encoding of colors. In: Mira, J., Álvarez, J.R. (eds.) IWINAC 2007. LNCS, vol. 4528, pp. 81–89. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  5. 5.
    Bologna, G., Deville, B., Pun, T., Vinckenbosch, M.: Transforming 3D coloured pixels into musical instrument notes for vision substitution applications. In: Caplier, A., Pun, T., Tzovaras, D. (Guest eds.) Eurasip J. of Image and Video Processing, Article ID 76204, 14 pages (Open access article) (2008)Google Scholar
  6. 6.
    Bologna, G., Deville, B., Vinckenbosch, M., Pun, T.: A perceptual interface for vision substitution in a color matching experiment. In: Proc. IEEE IJCNN, Int. Joint Conf. Neural Networks, Part of IEEE World Congress on Computational Intelligence, Hong Kong, June 1-6 (2008)Google Scholar
  7. 7.
    Gonzalez-Mora, J.L., Rodriguez-Hernandez, A., Rodriguez-Ramos, L.F., Dfaz-Saco, L., Sosa, N.: Development of a new space perception system for blind people, based on the creation of a virtual acoustic space. In: Proc. IWANN, pp. 321–330 (1999)Google Scholar
  8. 8.
    Kay, L.: A sonar aid to enhance spatial perception of the blind: engineering design and evaluation. The Radio and Electronic Engineer 44, 605–627 (1974)CrossRefGoogle Scholar
  9. 9.
    Meijer, P.B.L.: An experimental system for auditory image representations. IEEE Transactions on Biomedical Engineering 39(2), 112–121 (1992)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Guido Bologna
    • 1
  • Benoît Deville
    • 2
  • Thierry Pun
    • 2
  1. 1.Laboratoire d’Informatique IndustrielleUniversity of Applied Science HES-SOGenevaSwitzerland
  2. 2.Computer Science DepartmentUniversity of GenevaCarougeSwitzerland

Personalised recommendations