A New Framework for Fusing Stereo Images with Volumetric Medical Images

  • Fabienne Betting
  • Jacques Feldmar
  • Nicholas Ayache
  • Frédéric Devernay
Part of the Lecture Notes in Computer Science book series (LNCS, volume 905)


Some medical interventions require knowing the correspondence between an MRI/CT image and the actual position of the patient. Examples are in neurosurgery or radiotherapy, but also in video surgery (laparoscopy). Recently, computer vision techniques have been proposed to find this correspondence without any artificial markers. Following the pioneering work of [GLPI+94], [CZH+94], [CDT+92], [SHK94] and [STAL94], we propose in this paper an alternative approach.

We propose to trade the laser range finder for two cameras. Hence, we get dense reconstruction of the patient’s surface and this allows us to compute the normals to the surface. We present a new method for rigid registration when surfaces are described by points and normals. It does not depend on the initial positions of the surfaces, deals with occlusion in a strict way and takes advantage of the normal information.

Results are presented on real images.


Video Image Extended Kalman Filter Normal Information Laser Range Finder Rigid Registration 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [Aya91]
    N. Ayache. Artificial Vision for Mobile Robots — Stereo-Vision and Multisensory Perception. Mit-Press, 1991.Google Scholar
  2. [Aya93]
    N. Ayache. Analysis of three-dimensional medical images - results and challenges. research report 2050, INRIA, 1993.Google Scholar
  3. [BM92]
    Paul Besl and Neil McKay. A method for registration of 3-D shapes. PAMI, 14 (2): 239–256, February 1992.CrossRefGoogle Scholar
  4. [CDT+92]
    P. Cinquin, P. Demongeot, J. Troccaz, S. Lavallee, G. Champleboux, L. Brunie, F. Leitner, P. Sautot, B. Mazier, A. Perez M. Djaid, T. Fortin, M. Chenin, and A. Chapel. Igor: Image guided operating robot. methodology, medical applications, results. ITBM, 13: 373–393, 1992.Google Scholar
  5. [CLSB92]
    G. Champleboux, S. Lavallée, R. Szeliski, and L. Brunie. From accurate range imaging sensor calibration to accurate model-based 3-D object localization. In CVPR, Urbana Champaign, June 1992.Google Scholar
  6. [CM92]
    Y. Chen and G. Medioni. Object modeling by registration of multiple range images. Image and Vision Computing, 10 (3): 145–155, 1992.CrossRefGoogle Scholar
  7. [CZH+94]
    A.C.F. Colchester, J. Zhao, C. Henri, R.L. Evans, P. Roberts, N. Maitland, D.J. Hawkes, D.L.G. Hill, A.J. Strong, D.G. Thomas, M.J. Gleeson, and T.C.S Cox. Craniotomy simulation and guidance using a stereo video based tracking system (vislan). In Visualization in Biomedical Computing, Rochester, Minnesota, October 1994.Google Scholar
  8. [DF94]
    F. Devernay and O. D. Faugeras. Computing differential properties of 3d shapes from stereoscopic images without 3d models. In CVPR, Seattle, USA, June 1994.Google Scholar
  9. [FAF94]
    J. Feldmar, N. Ayache, and F.Betting. 3d-2d projective registration of freeform curves and surfaces. research report 2434, INRIA, 1994. Available via ftp anonymous on, file /pub/rapports/ and via WWW Scholar
  10. [GLPI+94]
    W.E.L. Grimson, T. Lozano-Perez, W.M. Wells III, G.J. Ettinger, S.J White, and R. Kikinis. An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization. In CVPR, Seattle, USA, June 1994.Google Scholar
  11. [GMPO92]
    Luc Van Gool, Theo Moons, Eric Pauwels, and André Oosterlinck. Semi-differential invariants. In Joseph L. Mundy and Andrew Zisserman, editors, Geometric Invariance in Computer Vision. Mit-Press, 1992.Google Scholar
  12. [Kan93]
    T. Kanade. very fast 3d sensing hardware. Internationnal Symposium on Robotic Research, October 1993.Google Scholar
  13. [LC90]
    S. Lavallée and P. Cinquin. Computer assisted medical intervention, volume 60. Hohne K.H. et al ed, Imaging in Medicine. Springer Verlag, 1990.Google Scholar
  14. [LSB91]
    Stéphane Lavallée, Richard Szeliski, and Lionel Brunie. Matching 3-d smooth surfaces with their 2-d projections using 3-d distance maps. In SPIE, Geometric Methods in Computer Vision, San Diego, Ca, July 1991.Google Scholar
  15. [SHK94]
    D. Simon, M. Hebert, and T. Kanade. Techniques for fast and accurate intra-surgical registration. In First international symposium on medical robotics and computer assisted surgery, Pittsburgh, September 1994.Google Scholar
  16. [STAL94]
    A. Shweikard, R. Tombropoulos, J. Adler, and J.C. Latombe. Planning for image-guided radiosurgery. In AAAI 1994 Spring Symposium Series. Application of Computer Vision in Medical Image Processing,Stanford University, March 1994. Also in Proc. IEEE Int. Conf. Robotics and Automation.Google Scholar
  17. [Tay93]
    R. Taylor. An overview of computer assisted surgery research. Internation- nal Symposium on Robotic Research, October 1993.Google Scholar
  18. [TLBM94]
    R.H. Taylor, S. Lavallee, G.C. Burdea, and R.W. Mosge. Computer integrated surgery. Mit-Press, 1994. To appear.Google Scholar
  19. [Zha94]
    Z. Zhang. Iterative point matching for registration of free-form curves and surfaces. IJCV,13(2):119–152, 1994. Also RR No.1658, INRIA, 1992.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1995

Authors and Affiliations

  • Fabienne Betting
    • 1
  • Jacques Feldmar
    • 1
  • Nicholas Ayache
    • 1
  • Frédéric Devernay
    • 2
  1. 1.Projet EpidaureINRIA SOPHIASophia Antipolis CedexFrance
  2. 2.Projet RobotvisINRIA SOPHIASophia Antipolis CedexFrance

Personalised recommendations