Towards visual matching as a way of transferring pre-operative surgery planning

  • Stijn De Buck
  • Johan Van Cleynenbreugel
  • Guy Marchal
  • Paul Suetens
Conference paper
Part of the Eurographics book series (EUROGRAPH)


This paper presents a case study towards intra-operative visualization of pre-operative medical images and surgery planning information. We describe a two stage procedure to provide a surgeon with valuable information during surgery, by augmenting live video with a 3D visualization of surgery planning. A first stage consists of automatic determination of the intrinsic parameters of the video camera by means of one image of a calibration object. It comprises an automatic ellipse extraction and a Solution to the 2D-3D correspondence problem. With the intrinsic camera parameters known, we perform a second stage to compute the extrinsic camera parameters with respect to the patient under surgery, allowing us to position and visualize the medical images in the right place. Techniques are investigated to visualize and manipulate the pre-operative medical images in order to cope with changes in the surgery scene.


Augmented Reality Virtual Object Camera Calibration Augmented Reality System Visual Match 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    J. Vallino. Introduction to augmented reality. Scholar
  2. 2.
    J.P. Mellor. Enhanced reality visualization in a surgical environment. In MIT AI-TR, 1995.Google Scholar
  3. 3.
    Colchester et al. Development and preliminary evaluation of VISLAN, a surgical planning and guidance system using intra-operative video imaging. Medical Image Analysis, 1(1):73–90, March 1996.CrossRefGoogle Scholar
  4. 4.
    Grimson et al. An automatic registration method for frameless stereotaxy, image guided surgery and enhanced reality visualization. IEEE Transactions on Medical Imaging, 15(2):129–140, April 1996.CrossRefGoogle Scholar
  5. 5.
    D. Vandermeulen. Methods for registration, interpolation and Interpretation and of Threedimensional medical image data for use in 3D-display, 3D-modelling and therapy planning. PhD thesis, KUL, 1991.Google Scholar
  6. 6.
    J.P. Tarel and A. Gagalowicz. Calibration de camera ä base d’ellipses. In 9érne congrés Reconnaissance des Formes et Intelligence Artificielle, Paris, France, 1994. AFCET.Google Scholar
  7. 7.
    R.Y. Tsai. An efficient and accurate camera calibration technique for 3D machine vision. In CVPR86, pages 364-374, 1986.Google Scholar
  8. 8.
    R.Y. Tsai.A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lenses.RA 3(4)323–344, 1987.Google Scholar
  9. 9.
    J. Heikkilä and O. Silvén. A four-step camera calibration procedure with implicit image correction. In CVPR97, pages 1106-1112, 1997.Google Scholar
  10. 10.
    J. Heikkilä and O. Silven. Camera calibration and image correction using circular control points. In SCIA97, 1997.Google Scholar
  11. 11.
    R.G. Willson. Freeware implementation of R. Tsai’s camera calibration algorithm. Scholar
  12. 12.
    R.G. Willson. Modeling and calibration of automated zoom lenses. In CMU-RITR, 1994.Google Scholar
  13. 13.
    Van Gool L. and Proesmans M. An introduction to image processing and analysis. 1998. Course text ESAT KULeuven.Google Scholar
  14. 14.
    Z. Zhang. A flexible technique for camera calibration. Technical Report MSR-TR- 98-71, Microsoft, 1998.Google Scholar
  15. 15.
    R. Horaud and G. Csurka. Self-calibration and euclidean reconstruction using motions of a stereo rig. In ICCV98, pages 96-103, 1998.Google Scholar
  16. 16.
    Verstreken K., VanCleynenbreugel J., K. Martens, G. Marchai, D. vanSteenberghe, and P. Suetens.An image-guided planning system for endosseous oral implants. IEEE Transactions on Medical Imaging, 17(5)842–852, October 1998.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Stijn De Buck
    • 1
  • Johan Van Cleynenbreugel
    • 1
  • Guy Marchal
    • 1
  • Paul Suetens
    • 1
  1. 1.Faculties of Medicine and Engineering, Medical Image Computing (ESAT and Radiology)University Hospital GasthuisbergLeuvenBelgium

Personalised recommendations