Visualization in Image-Guided Interventions

  • David HolmesIII
  • Maryam Rettmann
  • Richard Robb

Visualization is one of the primary interfaces between an interventionalist and his patient. This interface is the final integration of several disparate data streams. To develop an appropriate image-guided interface, it is important to understand several aspects of the data acquisition, data processing, and visualization methodologies in the context of the interventional procedure. This chapter introduces the basics of data acquisition and processing for image guidance, including the benefits of both preoperative and intraoperative data streams. 2D and 3D visualization methodologies are described with examples. Several different systems for visualization are introduced, ranging from low-level hardware to software-only render engines. Several clinical examples of visualization for image guidance are described.


Single Photon Emission Compute Tomography Left Atrium Application Programming Interface Volume Rendering Visualization System 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 3DVIEWNIX. “3DViewnix (∼Vnews/).”
  2. ACS. (2006). “Cancer Facts and Figures 2006.” American Cancer Society, Atlanta.Google Scholar
  3. Aharon S, Cameron B, and Robb RA. (1997). “Computation of efficient patient specific model from 3-D medical images: use in virtual endoscopy and surgery rehearsal.” Springer, Pittsburgh PA.Google Scholar
  4. ANALYZE MC. “Mayo Clinic Analyze(”
  5. Arango MF, Steven DA, and Herrick IA. (2004). “Neurosurgery for the treatment of epilepsy.” Current Opinion in Anaesthesiology, 17, 383-387.CrossRefGoogle Scholar
  6. AVS. “AVS: Advanced Visual Systems (”
  7. Baxendale S. (2002). “The role of functional MRI in the presurgical investigation of temporal lobe epilepsy patients: a clinical perspective and review.” Journal of Clinical & Experimental Neuropsychology: Official Journal of the Interna-tional Neuropsychological Society, 24(5), 664-676.Google Scholar
  8. Blaimer M, Breuer F, Mueller M, Heidemann RM, Griswold MA, and Jakob PM. (2004). “SMASH, SENSE, PILS, GRAPPA: how to choose the optimal method.” Topics in Magnetic Resonance Imaging, 15(4), 223-236.CrossRefGoogle Scholar
  9. Bronskill M, and Sprawls P. (1993). The Physics of MRI: 1992 AAPM Summer School Proceedings, American Institute of Physics, Woodbury.Google Scholar
  10. Budoff MJ, Achenbach S, Blumenthal RS, Carr JJ, Goldin JG, Greenland P, Guerci AD, Lima JA, Rader DJ, Rubin GD, Shaw LJ, Wiegers SE, American Heart Association Committee on Cardiovascular I, Intervention, American Heart Association Council on Cardiovascular R, and American Heart Association Committee on Cardiac Imaging CoCC. (2006). “Assessment of coronary artery disease by cardiac computed tomography: a scientific statement from the American Heart Association Committee on Cardio-vascular Imaging and Intervention, Council on Cardiovascular Radiology and Intervention, and Committee on Cardiac Imaging, Council on Clinical Cardiology.” Circulation, 114 (16), 1761-1791.Google Scholar
  11. Butler WE, Piaggio CM, Constantinou C, Niklason L, Gonzalez RG, Cosgrove GR, and Zervas NT. (1998). “A mobile computed tomographic scanner with intraoperative and intensive care unit applications.” Neurosurgery, 42(6), 1304-1310; discussion 1310-1301.CrossRefGoogle Scholar
  12. Cameron BM, Manduca A, and Robb RA. (1996). “Patient-specific anatomic models. Geometric surface generation from three-dimensional medical images using a specified polygonal budget.” Studies in Health Technology & Infor-matics, 29, 447-460.Google Scholar
  13. Christian P, Bernier D, and Langan J. (2003). Nuclear Medicine and PET: Technology and Techniques, Mosby, St. Louis, MO. Coin3D. “Coin3D (”
  14. Crouch D, and Robb RA. (1997). “A new algorithm for efficient polygon deci-mation for virtual reality applications in medicine.” Proceedings of SPIE, 3031, 514-517.CrossRefGoogle Scholar
  15. Dickfeld T, Calkins H, Zviman M, Kato R, Meininger G, Lickfett L, Berger R, Halperin H, and Solomon SB. (2003). “Anatomic stereotactic catheter ablation on three-dimensional magnetic resonance images in real time.” Circul-ation, 108(19), 2407-2413.CrossRefGoogle Scholar
  16. DICOM. (2006). Digital Imaging and Communications in Medicine (DICOM), National Electrical Manufacturers Association, Virginia.Google Scholar
  17. Eusemann CD, Ritman EL, Bellemann ME, and Robb RA. (2001). “Parametric display of myocardial function.” Computerized Medical Imaging & Graphics, 25 (6), 483-493.CrossRefGoogle Scholar
  18. Eusemann CD, Ritman EL, and Robb RA. (2003). “Parametric visualization methods for the quantitative assessment of myocardial motion.” Academic Radiology, 10(1), 66-76.CrossRefGoogle Scholar
  19. Foley J, van Dam A, Feiner S, and Hughes J. (1990). Computer Graphics: Principles and Practice, Addision-Wesley, Reading, MA.Google Scholar
  20. Gallo TM, Galatola G, Laudi C, and Regge D. (2006). “CT colonography: screening in individuals at high risk for colorectal cancer.” Abdominal Imaging, 31(3), 297-301.CrossRefGoogle Scholar
  21. Gepstein L, Hayam G, and Ben-Haim SA. (1997). “A novel method for non-fluoroscopic catheter-based electroanatomical mapping of the heart. In vitro and in vivo accuracy results.” Circulation, 95(6), 1611-1622.Google Scholar
  22. Gray H. (1918). Anatomy of the Human Body, Lea & Febiger, Philadelphia, PA.Google Scholar
  23. Green B. (2002). “The maze III surgical procedure.” AORN Journal, 76(1), 134-146; quiz 147-150.CrossRefGoogle Scholar
  24. Guillonneau B. (2006). “Can TRUS guidance reduce the incidence of positive margins during laparoscopic radical prostatectomy?” Nature Clinical Practice Urology, 3(10), 518-519.CrossRefGoogle Scholar
  25. Gunneson TJ, Menon KV, Wiesner RH, Daniels JA, Hay JE, Charlton MR, Brandhagen DJ, Rosen CB, and Porayko MK. (2002). “Ultrasound-assisted percutaneous liver biopsy performed by a physician assistant [see comment].” American Journal of Gastroenterology, 97(6), 1472-1475.CrossRefGoogle Scholar
  26. Haider CR, Bartholmai BJ, Holmes DR, Camp JJ, and Robb RA. (2005). “Quantitative characterization of lung disease.” Computerized Medical Imaging & Graphics, 29(7), 555-563.CrossRefGoogle Scholar
  27. Haydel MJ, Preston CA, Mills TJ, Luber S, Blaudeau E, and DeBlieux PM. (2000). “Indications for computed tomography in patients with minor head injury [see comment].” New England Journal of Medicine, 343(2), 100-105.CrossRefGoogle Scholar
  28. Hendee W, and Ritenour R. (1992). Medical Imaging Physics, Mosby, St. Louis, MO.Google Scholar
  29. Holmes DR, 3rd, Davis BJ, Bruce CJ, and Robb RA. (2003). “3D visualization, analysis, and treatment of the prostate using trans-urethral ultrasound.” Compu-terized Medical Imaging & Graphics, 27(5), 339-349.CrossRefGoogle Scholar
  30. Holmes DR, III, Rettmann ME, Cameron BM, Camp JJ, and Robb RA. (2006). “Cardioscopy: Interactive Endocardial Visualization to Guide RF Cardiac Ablation.” Proceedings of SPIE - Medical Imaging 2006, San Diego, CA.Google Scholar
  31. Hounsfield GN. (1973). “Computerized transverse axial scanning (tomography). 1. Description of system.” British Journal of Radiology, 46(552), 1016-1022.CrossRefGoogle Scholar
  32. Hutton BF, Braun M, Thurfjell L, and Lau DY. (2002). “Image registration: an essential tool for nuclear medicine.” European Journal of Nuclear Medicine & Molecular Imaging, 29(4), 559-577.CrossRefGoogle Scholar
  33. Kay PA, Robb RA, and Bostwick DG. (1998). “Prostate cancer microvessels: a novel method for three-dimensional reconstruction and analysis.” Prostate, 37 (4), 270-277.CrossRefGoogle Scholar
  34. Lattanzi R, Baruffaldi F, Zannoni C, and Viceconti M. (2004). “Specialised CT scan protocols for 3-D pre-operative planning of total hip replacement.” Medical Engineering & Physics, 26(3), 237-245.CrossRefGoogle Scholar
  35. Le Bihan D. (2003). “Looking into the functional architecture of the brain with diffusion MRI.” Nature Reviews Neuroscience, 4(6), 469-480.CrossRefGoogle Scholar
  36. Lin D, and Marchlinski FE. (2003). “Advances in ablation therapy for complex arrhythmias: atrial fibrillation and ventricular tachycardia.” Current Cardiology Reports, 5(5), 407-414.CrossRefGoogle Scholar
  37. Lorensen W, and Cline H. (1987). “Marching cubes: a high resolution 3D surface construction algorithm.” Computer Graphics, 21, 163-169.CrossRefGoogle Scholar
  38. Matlab. “Matlab (”
  39. Microsoft. (2006). “DirectX 9.0 (”
  40. Nath R, Anderson LL, Luxton G, Weaver KA, Williamson JF, and Meigooni AS. (1995). “Dosimetry of interstitial brachytherapy sources: recommendations of the AAPM Radiation Therapy Committee Task Group No. 43. American Association of Physicists in Medicine [see comment] [erratum appears inGoogle Scholar
  41. Med Phys 1996 Sep; 23(9), 1579].” Medical Physics, 22(2), 209-234.Google Scholar
  42. Nicholls SJ, Tuzcu EM, Sipahi I, Schoenhagen P, and Nissen SE. (2006). “Intravascular ultrasound in cardiovascular medicine.” Circulation, 114 (4), 55-59.CrossRefGoogle Scholar
  43. NIFTI DFWG. “A (Sort of) New Image Data Format Standard: NIfTI- 1 (”
  44. O’Brien TJ, So EL, Mullan BP, Hauser MF, Brinkmann BH, Bohnen NI, Hanson D, Cascino GD, Jack CR, Jr., and Sharbrough FW. (1998). “Subtraction ictal SPECT co-registered to MRI improves clinical usefulness of SPECT in locali-zing the surgical seizure focus.” Neurology, 50(2), 445-454.Google Scholar
  45. OpenDX. “OpenDX: The Open Source Software Project Based on IBM’s Visualizaiton Data Explorer (”
  46. OpenInventor.“Open Inventor by Mercury Computer Systems (” OpenSceneGraph. “OpenSceneGraph (”
  47. Pakin SK, Cavalcanti C, La Rocca R, Schweitzer ME, and Regatte RR. (2006). “Ultra-high-field MRI of knee joint at 7.0T: preliminary experience.” Academic Radiology, 13(9), 1135-1142.CrossRefGoogle Scholar
  48. Peters NS, Jackman WM, Schilling RJ, Beatty G, and Davies DW. (1997). “Images in cardiovascular medicine. Human left ventricular endocardial activation mapping using a novel noncontact catheter.” Circulation, 95(6), 1658-1660.Google Scholar
  49. Pfister H, Lorensen B, Bajaj C, Kindlmann G, Schroeder W, Avila LS, Raghu KM, Machiraju R, and Lee J. (2001). “The transfer function bake-off.” IEEE Computer Graphics and Applications, 21(3), 16-22.CrossRefGoogle Scholar
  50. Reddy VY, Malchano ZJ, Holmvang G, Schmidt EJ, d’Avila A, Houghtaling C, Chan RC, and Ruskin JN. (2004). “Integration of cardiac magnetic resonance imaging with three-dimensional electroanatomic mapping to guide left ventri-cular catheter manipulation: feasibility in a porcine model of healed myocardial infarction.” Journal of the American College of Cardiology, 44(11), 2202-2213.CrossRefGoogle Scholar
  51. Rettmann ME, Holmes DR, 3rd, Su Y, Cameron BM, Camp JJ, Packer DL, and Robb RA. (2006). “An integrated system for real-time image guided cardiac catheter ablation.” Studies in Health Technology & Informatics, 119, 455-460.Google Scholar
  52. Ritman EL. (2003). “Cardiac computed tomography imaging: a history and some future possibilities.” Cardiology Clinics, 21(4), 491-513.CrossRefGoogle Scholar
  53. Robb RA. (2008a). “Mayo Clinic Analyze 7.5 Format (” Biomedical Imaging Resource, Mayo Clinic.
  54. Robb RA. (2008b). “Mayo Clinic Analyze Coordinate System (Analyze Help Docu-mentation).” Biomedical Imaging Resource, Mayo Clinic.Google Scholar
  55. Robb RA. (2000). “Virtual (Computed) Endoscopy: Development and Evaluation Using the Visible Human Datasets.” Visible Human Project Conference, Bethesda, MD.Google Scholar
  56. Robb RA. (2000). Biomedical Imaging, Visualization, and Analysis, Wiley-Liss, New York, NY.Google Scholar
  57. Satava RM, Robb RA. (1997). “Virtual Endoscopy: Application of 3-D visualization to Medical Diagnosis.” Presence, 6(2), 179-197.Google Scholar
  58. Schenck JF, Jolesz FA, Roemer PB, Cline HE, Lorensen WE, Kikinis R, Silverman SG, Hardy CJ, Barber WD, and Laskaris ET. (1995). “Superconducting open-configuration MR imaging system for image-guided therapy.” Radiology, 195 (3), 805-814.Google Scholar
  59. Segal M, and Akeley K. (2006). “The OpenGL Graphics System: A Specification (Version 2.0) (” Slicer. “3D Slicer (”
  60. Spencer JA. (2001). “Oncological radiology.” Clinical Radiology, 56(7), 521-522.CrossRefGoogle Scholar
  61. Spitz L. (2005). “Conjoined twins.” Prenatal Diagnosis, 25(9), 814-819.CrossRefGoogle Scholar
  62. Spitz L, and Kiely EM. (2003). “Conjoined twins.” JAMA, 289(10), 1307-1310.CrossRefGoogle Scholar
  63. Sra J, Krum D, Hare J, Okerlund D, Thompson H, Vass M, Schweitzer J, Olson E, Foley WD, and Akhtar M. (2005). “Feasibility and validation of registration of three-dimensional left atrial models derived from computed tomography with a noncontact cardiac mapping system.” Heart Rhythm, 2(1), 55-63.CrossRefGoogle Scholar
  64. Su Y, Davis BJ, Herman MG, and Robb RA. (2006). “TRUS-fluoroscopy fusion for intraoperative prostate brachytherapy dosimetry.” Studies in Health Tech-nology & Informatics, 119, 532-537.Google Scholar
  65. Sun Y, Azar FS, Xu C, Hayam G, Preiss A, Rahn N, and Sauer F. (2005). “Regis-tration of high-resolution 3D atrial images with elecroanatomical cardiac mapping: evaluation of registration methodology.” SPIE Medical Imaging, 299-307.Google Scholar
  66. Szabo T. (2004). Diagnostic Ultrasound Imaging: Inside Out, Academic Press, Burlington, MA.Google Scholar
  67. Udupa J, and Odhner D. (1993). “Shell Rendering.” IEEE Computer Graphics and Applications, 13(6), 58-67.CrossRefGoogle Scholar
  68. VTK. “The Visualization Toolkit (” Wiebe S. (2003). “Brain surgery for epilepsy.” Lancet, 362(Suppl), s48-s49.
  69. Zimmerman R, Sirven J, Roarke M, Drazkowski J, Larson S, Dixit S, and Tollefson C. (2004). “SISCOM localization of a seizure focus within a heterotopia.” Neurology, 62(12), 2328.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • David HolmesIII
    • 1
  • Maryam Rettmann
    • 1
  • Richard Robb
    • 1
  1. 1.Mayo Clinic College of MedicineRochesterUSA

Personalised recommendations