Abstract
Some medical interventions require knowing the correspondence between an MRI/CT image and the actual position of the patient. Examples are in neurosurgery or radiotherapy, but also in video surgery (laparoscopy). Recently, computer vision techniques have been proposed to find this correspondence without any artificial markers. Following the pioneering work of [GLPI+94], [CZH+94], [CDT+92], [SHK94] and [STAL94], we propose in this paper an alternative approach.
We propose to trade the laser range finder for two cameras. Hence, we get dense reconstruction of the patient’s surface and this allows us to compute the normals to the surface. We present a new method for rigid registration when surfaces are described by points and normals. It does not depend on the initial positions of the surfaces, deals with occlusion in a strict way and takes advantage of the normal information.
Results are presented on real images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
N. Ayache. Artificial Vision for Mobile Robots — Stereo-Vision and Multisensory Perception. Mit-Press, 1991.
N. Ayache. Analysis of three-dimensional medical images - results and challenges. research report 2050, INRIA, 1993.
Paul Besl and Neil McKay. A method for registration of 3-D shapes. PAMI, 14 (2): 239–256, February 1992.
P. Cinquin, P. Demongeot, J. Troccaz, S. Lavallee, G. Champleboux, L. Brunie, F. Leitner, P. Sautot, B. Mazier, A. Perez M. Djaid, T. Fortin, M. Chenin, and A. Chapel. Igor: Image guided operating robot. methodology, medical applications, results. ITBM, 13: 373–393, 1992.
G. Champleboux, S. Lavallée, R. Szeliski, and L. Brunie. From accurate range imaging sensor calibration to accurate model-based 3-D object localization. In CVPR, Urbana Champaign, June 1992.
Y. Chen and G. Medioni. Object modeling by registration of multiple range images. Image and Vision Computing, 10 (3): 145–155, 1992.
A.C.F. Colchester, J. Zhao, C. Henri, R.L. Evans, P. Roberts, N. Maitland, D.J. Hawkes, D.L.G. Hill, A.J. Strong, D.G. Thomas, M.J. Gleeson, and T.C.S Cox. Craniotomy simulation and guidance using a stereo video based tracking system (vislan). In Visualization in Biomedical Computing, Rochester, Minnesota, October 1994.
F. Devernay and O. D. Faugeras. Computing differential properties of 3d shapes from stereoscopic images without 3d models. In CVPR, Seattle, USA, June 1994.
J. Feldmar, N. Ayache, and F.Betting. 3d-2d projective registration of freeform curves and surfaces. research report 2434, INRIA, 1994. Available via ftp anonymous on zenon.inria.fr, file /pub/rapports/RR-2434.ps and via WWW ftp://zenon.inria.fr/pub/rapports.
W.E.L. Grimson, T. Lozano-Perez, W.M. Wells III, G.J. Ettinger, S.J White, and R. Kikinis. An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization. In CVPR, Seattle, USA, June 1994.
Luc Van Gool, Theo Moons, Eric Pauwels, and André Oosterlinck. Semi-differential invariants. In Joseph L. Mundy and Andrew Zisserman, editors, Geometric Invariance in Computer Vision. Mit-Press, 1992.
T. Kanade. very fast 3d sensing hardware. Internationnal Symposium on Robotic Research, October 1993.
S. Lavallée and P. Cinquin. Computer assisted medical intervention, volume 60. Hohne K.H. et al ed, Imaging in Medicine. Springer Verlag, 1990.
Stéphane Lavallée, Richard Szeliski, and Lionel Brunie. Matching 3-d smooth surfaces with their 2-d projections using 3-d distance maps. In SPIE, Geometric Methods in Computer Vision, San Diego, Ca, July 1991.
D. Simon, M. Hebert, and T. Kanade. Techniques for fast and accurate intra-surgical registration. In First international symposium on medical robotics and computer assisted surgery, Pittsburgh, September 1994.
A. Shweikard, R. Tombropoulos, J. Adler, and J.C. Latombe. Planning for image-guided radiosurgery. In AAAI 1994 Spring Symposium Series. Application of Computer Vision in Medical Image Processing,Stanford University, March 1994. Also in Proc. IEEE Int. Conf. Robotics and Automation.
R. Taylor. An overview of computer assisted surgery research. Internation- nal Symposium on Robotic Research, October 1993.
R.H. Taylor, S. Lavallee, G.C. Burdea, and R.W. Mosge. Computer integrated surgery. Mit-Press, 1994. To appear.
Z. Zhang. Iterative point matching for registration of free-form curves and surfaces. IJCV,13(2):119–152, 1994. Also RR No.1658, INRIA, 1992.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1995 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Betting, F., Feldmar, J., Ayache, N., Devernay, F. (1995). A New Framework for Fusing Stereo Images with Volumetric Medical Images. In: Ayache, N. (eds) Computer Vision, Virtual Reality and Robotics in Medicine. CVRMed 1995. Lecture Notes in Computer Science, vol 905. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-49197-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-49197-2_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-59120-7
Online ISBN: 978-3-540-49197-2
eBook Packages: Springer Book Archive