Abstract
We are developing techniques for guiding ultrasound probes and other clinical tools with respect to the exterior of the patient, using one or more video camera(s) mounted directly on the probe or tool. This paper reports on a new method of matching the real-time video image of the patient’s exterior against a prior high-resolution surface map acquired with a multiple-camera imaging device used in reconstructive surgery. This surface map is rendered from multiple viewpoints in real-time to find the viewpoint that best matches the probe-mounted camera image, thus establishing the camera’s pose relative to the anatomy. For ultrasound, this will permit the compilation of 3D ultrasound data as the probe is moved, as well as the comparison of a real-time ultrasound scan with previous scans from the same anatomical location, all without using external tracking devices. In a broader sense, tools that know where they are by looking at the patient’s exterior could have an important beneficial impact on clinical medicine.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Flaccavento, G., Lawrence, P., Rohling, R.: Patient and probe tracking during freehand ultrasound. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI 2004. LNCS, vol. 3217, pp. 585–593. Springer, Heidelberg (2004)
Rohling, R., Gee, A., Berman, L.: A comparison of freehand three-dimensional ultrasound reconstruction techniques. Medical Image Analysis 3(4) (1999)
Dewi, D., Wilkinson, M., Mengko, T., Purnama, I., van Ooijen, P., Veldhuizen, A., et al.: 3D Ultrasound Reconstruction of Spinal Images using an Improved Olympic Hole-Filling Method. In: ICICI-BME (2009)
Gobbi, D.G., Peters, T.M.: Interactive intra-operative 3D ultrasound reconstruction and visualization. In: Dohi, T., Kikinis, R. (eds.) MICCAI 2002, Part II. LNCS, vol. 2489, p. 156. Springer, Heidelberg (2002)
Rousseau, F., Hellier, P., Barillot, C.: A novel temporal calibration method for 3-D ultrasound. IEEE Transactions on Medical Imaging 25, 1108–1112 (2006)
Chen, T., Thurston, A., Ellis, R., Abolmaesumi, P.: A real-time freehand ultrasound calibration system with automatic accuracy feedback and control. Ultrasound in Medicine & Biology 35, 79–93 (2009)
Lasso, A., Heffter, T., Pinter, C., Ungi, T., Fichtinger, G.: Implementation of the PLUS open-source toolkit for translational research of ultrasound-guided intervention systems. The MIDAS Journal - Systems and Architectures for Computer Assisted Interventions Workshop, MICCAI, 1–12 (2012)
Khamene, A., Sauer, F.: Video-assistance for ultrasound guided needle biopsy. US Patent 6,612,991 (2002)
Chan, C., Lam, F., Rohling, R.: A needle tracking device for ultrasound guided percutaneous procedures. Ultrasound in Medicine & Biology 31(11) (2005)
Rafii-Tari, H., Abolmaesumi, P., Rohling, R.: Panorama ultrasound for guiding epidural anesthesia: A feasibility study. In: Taylor, R.H., Yang, G.-Z. (eds.) IPCAI 2011. LNCS, vol. 6689, pp. 179–189. Springer, Heidelberg (2011)
Sun, S., Anthony, B.: Freehand 3D ultrasound volume imaging using a miniature-mobile 6-DOF camera tracking system. In: 9th IEEE International Symposium (2012)
Sun, S., Gilbertson, M., Anthony, B.: 6-DOF probe tracking via skin mapping for freehand 3D ultrasound. In: 10thIEEE International Symposium (2013)
Wang, J., Horvath, S., Stetten, G., Siegel, M., Galeotti, J.: Real-Time Registration of Video with Ultrasound using Stereo Disparity. In: SPIE Medical Imaging, San Diego, CA (2012)
Fryer, J., Brown, D.: Lens distortion for close-range photogrammetry. Photogrammetric Engineering and Remote Sensing 52(1), 51–58 (1986)
Brown, D.: Decentering Distortion of Lenses. Photometric Engineering 32(3), 444–462 (1966)
Viola, P., Wells III, W.M.: Alignment by maximization of mutual information. International Journal of Computer Vision 24(2), 137–154 (1997)
Li, W.: Mutual information functions versus correlation functions. Journal of Statistical Physics 60(5-6), 823–837 (1990)
Studholme, C., Hill, D., Hawkes, D.: An overlap invariant entropy measure of 3D medical image anlignment. Pattern Recognition (32), 71–86 (1999)
Krupa, A., Fichtinger, G., Hager, G.D.: Real-time tissue tracking with B-mode ultrasound using speckle and visual servoing. In: Ayache, N., Ourselin, S., Maeder, A. (eds.) MICCAI 2007, Part II. LNCS, vol. 4792, pp. 1–8. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, J., Shivaprabhu, V., Galeotti, J., Horvath, S., Gorantla, V., Stetten, G. (2014). Towards Video Guidance for Ultrasound, Using a Prior High-Resolution 3D Surface Map of the External Anatomy. In: Linte, C.A., Yaniv, Z., Fallavollita, P., Abolmaesumi, P., Holmes, D.R. (eds) Augmented Environments for Computer-Assisted Interventions. AE-CAI 2014. Lecture Notes in Computer Science, vol 8678. Springer, Cham. https://doi.org/10.1007/978-3-319-10437-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-10437-9_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10436-2
Online ISBN: 978-3-319-10437-9
eBook Packages: Computer ScienceComputer Science (R0)