Skip to main content

Adaptive Visual/Auditory Fusion in the Target Localization System of the Barn Owl

  • Conference paper
Multisensor Fusion for Computer Vision

Part of the book series: NATO ASI Series ((NATO ASI F,volume 99))

  • 153 Accesses

Abstract

The target localization system of the barn owl adaptively fuses its separate visual and auditory representations of object position into a single joint representation used for head orientation. The building block in this system is the neuronal map. Neuronal maps are large arrays of locally interconnected neurons that represent information in a map-like form, that is, the value of stimulus parameters is encoded by the position of neural activation in the array. The computational load is distributed to a hierarchy of maps, and computation is performed in stages by transforming the representation from map to map via the geometry of the projections between the maps and the local interactions within the maps. In the owl one sequence of maps is used to compute azimuth from binaural phase difference, while another sequence is used to derive elevation from binaural intensity difference. These separate streams are recombined to produce a map of space. In doing this, the owl’s nervous system must deal with at least two kinds of ghosts that are eliminated before the visual and auditory maps of space are fused. We present models for the elimination of these ghosts. These models suggest mechanisms for the adaptive registration of the visual and auditory inputs to the fused map of space in the optic tectum.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Dean, P., P. Redgrave, and G.W.M. Westby: Event or emergency? Two response systems in the mammalian superior colliculus. Trends in Neurosci. 12: 137–147 (1989)

    Article  Google Scholar 

  2. Hartline, P., L. Kass, and M. Loop: Merging of modalities in the optic tectum: infrared and visual integration in rattlesnakes. Science 199: 1225–1229 (1978)

    Article  Google Scholar 

  3. Bullock, T.: Electroreception. Ann. Rev. Neurosci. 5: 121 (1982)

    Article  Google Scholar 

  4. Bastian, J.: Vision and electroreception: integration of sensory information in the optic tectum of the weakly electric fish Apteronotus albifrons. J. Comp. Physiol. 147: 287–297 (1982)

    Article  Google Scholar 

  5. Heiligenberg, W.: Central processing of sensory information in electric fish. J. Comp. Physiol. A 161: 621–631 (1987)

    Article  Google Scholar 

  6. Knudsen, E.I., S. du Lac, and S. D. Esterly: Computational maps in the brain. Ann. Rev. Neuroscience 10: 41–65 (1987)

    Article  Google Scholar 

  7. Knudsen, E.I., G.G. Blasdel, and M. Konishi: Sound localization by the barn owl (Tyto alba) measured with the search coil technique. J. Comp. Physio1. 133: 1–11 (1979)

    Article  Google Scholar 

  8. Pettigrew, J.D. and M. Konishi: Neurons selective for orientation and binocular disparity in the visual wulst of the barn owl (Tyto alba). Science 193: 675–678 (1976)

    Article  Google Scholar 

  9. Knudsen, E.I. and M. Konishi: A neural map of auditory space in the owl. Science 200: 795–797 (1978)

    Article  Google Scholar 

  10. Knudsen, E.I. and M. Konishi: Space and frequency are represented separately in auditory midbrain of the owl. J. Neurophysiol. 41: 870–884 (1978)

    Google Scholar 

  11. du Lac, S. and E.I. Knudsen: The optic tectum encodes saccade magnitude in a push-pull fashion in the barn owl. Soc. Neurosci. Abstr. 14: 393 (1987)

    Google Scholar 

  12. Knudsen, E.I. and M. Konishi: Monaural Occlusion Shifts Receptive Field Locations of Auditory Midbrain Units in the Owl. J. Neurophysiol. 44: 687–695 (1980)

    Google Scholar 

  13. Knudsen, E.I.: Experience Alters the Spatial Tuning of Auditory Units in the Optic Tectum during a Sensitive Period in the Barn Owl. J. Neurosci. 5: 3094–3109 (1985)

    Google Scholar 

  14. Knudsen, E.I. and P. F. Knudsen: The Sensitive Period for Auditory Localization in Barn Owls is Limited by Age, not by Experience. J. Neurosci. 6: 1918–1924 (1986)

    Google Scholar 

  15. Pearson, J.C., J. J. Gelfand, W. E. Sullivan and R. M. Peterson: A Neural Network Computational Map Approach to Sensory Fusion. In: Proc. 1988 SPIE Symposium on Sensor Fusion (C.B. Weaver, ed.). SPIE Proc. Vol. 931. pp. 103–108.

    Google Scholar 

  16. Knudsen, E.I.: private communication

    Google Scholar 

  17. Moiseff, A.: Binaural disparity cues available to the barn owl for sound localization. J. Comp. Physiol. 164: 629–636 (1989)

    Article  Google Scholar 

  18. Payne, R.S.: Acoustic location of prey by barn owls (Tyto alba). J. Exp. Biol. 54: 535–573 (1971)

    Google Scholar 

  19. Moiseff, A. and M. Konishi: Binaural characteristics of units in the owl’s brainstem auditory pathway: precursors of restricted spatial receptive fields. J. of Neurosci. 3: 2553–2562 (1983)

    Google Scholar 

  20. Sullivan, W.E. and M. Konishi: Neural map of interaural phase difference in the owl’s brainstem. PNAS 83: 8400–8404 (1986)

    Article  Google Scholar 

  21. Wagner, H., T. Takahashi and M. Konishi: Representation of interaural time difference in the central nucleus of the barn owl’s inferior colliculus. J. Neurosci. 7: 3105–3116 (1987)

    Google Scholar 

  22. Takahashi T.T. and M. Konishi: Projections of the cochlear nuclei and nucleus laminaris to the inferior colliculus of the barn owl. J. Comp. Neurol. 274: 190–211 (1988)

    Article  Google Scholar 

  23. Manley, G.A., A.C. Köppl and M. Konishi: Neural map of interaural intensity differences in the brain stem of the barn owl. J. Neurosci. 8: 2665–2676 (1988)

    Google Scholar 

  24. Moiseff A. and M. Konishi: Neuronal and behavioral sensitivity to binaural time differences in the owl. J. Neurosci. 1: 40–48 (1981)

    Google Scholar 

  25. Knudsen, E.I.: Auditory properties of space-tuned units in the owl’s optic tectum. J. Neurophysiol. 52: 709–723 (1984)

    Google Scholar 

  26. Fujita, I.: private communication.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1993 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Spence, C.D., Pearson, J.C. (1993). Adaptive Visual/Auditory Fusion in the Target Localization System of the Barn Owl. In: Aggarwal, J.K. (eds) Multisensor Fusion for Computer Vision. NATO ASI Series, vol 99. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-02957-2_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-02957-2_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-08135-4

  • Online ISBN: 978-3-662-02957-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics