Abstract
We have initiated studies towards the design and implementation of an ophthalmic augmented reality environment in order to allow for a) more precise laser treatment for ophthalmic diseases, b) teaching, c) telemedicine, and d) real-time image measurement, analysis, and comparison. The proposed system is being designed around a standard slit-lamp biomicroscope. The microscope will be interfaced to a CCD camera, and the image sent to a video capture board. A single computer workstation will coordinate image capture, registration, and display. The captured image is registered with previously stored, montaged photographic and angiographic data, with superposition facilitated by funduslandmark-based fast registration algorithms. The computer then drives a high intensity, VGA resolution video display with adjustable brightness and contrast attached to one of the oculars of the slitlamp biomicroscope. Preliminary studies with a modified binocular operating microscope interfaced to a Sun Ultral Workstation and an IBM-compatible PC demonstrates proof-of-principle. Robust, accurate fundus image montaging is accomplished with Hausdorff-distance-based methods. For photographic and angiographic data where the vessel gray levels vary from light to dark, and intensity-based correlation methods fail, image-preprocessing with smoothing, edge-detection, and thresholding facilitates registration. Non-real-time registration (∼ 0.4–4.0 CPU seconds) is achieved by non-optimized simple template matching (translation only, Matrox Inspector) or Hausdorff-distance-based (translation, rotation, and scale) algorithms performed on edge-detected fundus photographic and angiographic images, and on images of a model eye. Successful registration and image overlay of color, monochromatic, and angiographic images is demonstrated. To our knowledge, these studies represent the first investigation towards design and implementation of an ophthalmic augmented reality environment.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
M. Bajura, H. Fuchs, R. Ohbuchi, “Merging virtual objects with the real world: Seeing ultrasound imagery within the patient”, in Computer Graphics 26:203–210, 1992.
S.F. Barrett, M.R. Jerath, H.G. Rylander, A.J. Welch, “Digital tracking and control of retinal images”, in Optical Engineering, 33:150–159, 1994.
S.F. Barrett, C.H.G. Wright, M.R. Jerath, S. Lewis, B.C. Dillard, H.G. Rylander, A.J. Welch, “Computer-aided retinal photocoagulation system”, in J Biomedical Optics, 1:83–91, 1996.
D.E. Becker, J.N. Turner, H. Tannenbaum, B. Roysam, “Real-time image processing algorithms for an automated retinal laser surgery system”, in Proc IEEE 2nd Int Conf Image Proc, 1995, p 426–429.
J. Bowskill, J. Downie, “Extending the capabilities of the human visual system. An introduction to enhanced reality”, in Computer Graphics, 29:61–65, 1995.
J.F. Canny, “A computational approach to edge detection” in IEEE Trans. Pat. Anal. Mach. Intel., 8:34–43, 1986.
T.P. Caudell, “Introduction to augmented and virtual reality”, in Proc SPIE (Telemanipulator and Telepresence Technologies), 2351:272–281, 1994.
P.J. Edwards, D.L.G. Hill, D.J. Hawkes, R. Spink, A.C.F. Colchester, A. Strong, M. Gleeson, “Neurosurgical guidance using the stereo microscope” in Proc First Int Conf Computer Vision, Virtual Reality and Robotics in Medicine, Nice, France, p 555–564.
S. Feiner, M. Macintyre, D. Seligmann, “Knowledge based augmented reality” in Communications of the ACM, 36:53–61, 1993.
P.L. Gleason, R. Kikinis, D. Altobelli, W. Wells, E. Alexander, P. Black, F. Jolesz, “Video registration virtual reality for nonlinkage stereotactic surgery”, in Sterotactic Funct Neurosurgery, 63:139–143, 1994.
W.E.L. Grimson, G.J. Ettinger, S.J. White, T. Lozano-Pérez, W.M. Wells III, and R. Kikinis, “An Automatic Registration Method for Frameless Stereotaxy, Image Guided Surgery, and Enhanced Reality Visualization”, in IEEE Trans. Medical Imaging, 15:129, 1996.
D.P. Huttenlocher, G.A. Klanderman, W.J. Rucklidge, “Comparing images using the Hausdorff distance” in IEEE Trans Patt Anal Mach Intell, 15:850–863, 1993.
M.S. Markow, H.G. Rylander, A.J. Welch, “Real-time algorithm for retinal tracking”, in IEEE Trans Biomed Engineering, 40:1269–1281, 1993.
Macular Photocoagulation Study Group, “The influence of treatment extent on the visual acuity of eyes treated with krypton laser for juxtafoveal choroidal neovascularization” in Arch Ophthalmol, 113:190–194, 1995.
P. Nagin, B. Schwartz, K. Nanba, “The reproducibility of computerized boundary analysis for measuring optic disc pallor in the normal optic disc” in Ophthalmology, 92:243–251, 1985.
K.A. Neely, “How to be more successful in laser photocoagulation”, in Ophthal Times, 1996, pp 103–108.
R.V. O'Toole, M.K. Blackwell, F.M. Morgan, L. Gregor, D. Shefman, B. Jaramaz, DiGioia, T. Kanade, “Image overlay for surgical enhancement and telemedicine”, in Interactive Technology and the New Paradigm for Healthcare, K. Morgan et al., eds, IOS Press, 1995.
W.J. Rucklidge, “Locating objects using the Hausdorff distance” in Proc IEEE Int Conf Computer Vision, 1995, p 457–464.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Berger, J.W., Leventon, M.E., Hata, N., Wells, W., Kikinis, R. (1997). Design considerations for a computer-vision-enabled ophthalmic augmented reality environment. In: Troccaz, J., Grimson, E., Mösges, R. (eds) CVRMed-MRCAS'97. CVRMed MRCAS 1997 1997. Lecture Notes in Computer Science, vol 1205. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0029261
Download citation
DOI: https://doi.org/10.1007/BFb0029261
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62734-0
Online ISBN: 978-3-540-68499-2
eBook Packages: Springer Book Archive