Local cross-modality image alignment using unsupervised learning

  • Öjvind Bernander
  • Christof Koch
Part of the Lecture Notes in Computer Science book series (LNCS, volume 427)


We propose a method for automatically aligning images with local distortions from different sensors, using real images instead of calibration objects. The algorithm has three components. First, we extract intensity discontinuities, because this is a feature that is likely to show up across modalities. Second, we use a correlation scheme that averages over time rather than space, for high precision. Third, we propose an architecture and a learning scheme that learn the correlation surfaces over time and implement the image coordinate transform.


  1. [1]
    Barniv, Y. and Casasent, D. (1981) Multisensor image registration: experimental verification, SPIE 292: Processing of images and data from optical sensors, 160–171.Google Scholar
  2. [2]
    Knudsen, E.I. (1983) Early auditory experience aligns the auditory map of space in the optic tectum of the barn owl, Science 222, 939–942.Google Scholar
  3. [3]
    Kohonen, T. (1984) Self-organization and associative memory, Springer-Verlag, Berlin.Google Scholar
  4. [4]
    Pearson, J.C., Sullivan, W.E., Gelfand, J.J., Peterson, R.M. (1987) A computational map approach to sensory fusion, AOG/AAAIC Proc. Joint conf. on merging tomorrow's technologies with defense readiness requirementsGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1990

Authors and Affiliations

  • Öjvind Bernander
    • 1
  • Christof Koch
    • 1
  1. 1.Computation and Neural Systems Program, 216-76California Institute of TechnologyPasadena

Personalised recommendations