Skip to main content

Augmented Reality Image Overlay Projection for Image Guided Open Liver Ablation of Metastatic Liver Cancer

  • Conference paper
Book cover Augmented Environments for Computer-Assisted Interventions (AE-CAI 2011)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7264))

Included in the following conference series:

Abstract

This work presents an evaluation of a novel augmented reality approach for the visualisation of real time guidance of an ablation tool to a tumor in open liver surgery. The approach uses a portable image overlay device, directly integrated into a liver surgical navigation system, to display guidance graphics along with underlying anatomical structures directly on the liver surface. The guidance application generates trajectories from the current ablation needle tip to the centre of the tumor. Needle alignment guidance and depth information are displayed directly on the liver surface, providing intuitive real-time feedback for guiding the ablation tool tip to the targeted tumor. Validation of the guidance visual feedback on porcine liver tissue showed that the system was useful in trajectory planning and tumor targeting. The augmented reality guidance was easily visible, removed the need for sight diversion and was implemented without imposing any timely or procedural overhead when compared to a navigated procedure itself.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pawlik, T., Schulick, R., Choti, M.: Expanding criteria for resectability of colorectal liver metastases. The Oncologist 13(1), 51–64 (2008)

    Article  Google Scholar 

  2. van Duijnhoven, F.H., et al.: Factors influencing the local failure rate of radiofrequency ablation of colorectal liver metastases. Annals of Surgical Oncology 13(5), 651–658 (2006)

    Article  Google Scholar 

  3. Bentrem, D.J., Dematteo, R.P., Blumgart, L.H.: Surgical therapy for metastatic disease to the liver. Annual Review of Medicine 56, 139–156 (2005)

    Article  Google Scholar 

  4. Peterhans, M., et al.: A navigation system for open liver surgery: design, workflow and first clinical applications. The International Journal of Medical Robotics + Computer Assisted Surgery: MRCAS 7(1), 7–16 (2011)

    Article  Google Scholar 

  5. Cash, D.M., et al.: Concepts and preliminary data toward the realization of image-guided liver surgery. Journal of Gastrointestinal Surgery: Official Journal of the Society for Surgery of the Alimentary Tract 11(7), 844–859 (2007)

    Article  Google Scholar 

  6. Hansen, C., Wieferich, J., Ritter, F., Rieder, C., Peitgen, H.-O.: Illustrative visualization of 3D planning models for augmented reality in liver surgery. International Journal of Computer Assisted Radiology and Surgery 5(2), 133–141 (2010)

    Article  Google Scholar 

  7. Sugimoto, M., et al.: Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery. Journal of Hepato-Biliary-Pancreatic Sciences 17(5), 629–636 (2010)

    Article  Google Scholar 

  8. Volonté, F., Pugin, F., Bucher, P., Sugimoto, M., Ratib, O., Morel, P.: Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. Journal of Hepato-Biliary-Pancreatic Sciences (April 2011)

    Google Scholar 

  9. Marescaux, J., Rubino, F., Arenas, M., Mutter, D., Soler, L.: Augmented-Reality-Assisted Laparoscopic Adrenalectomy. JAMA 292(18), 2214–2215 (2004)

    Article  Google Scholar 

  10. Nikou, C., Digioia, A., Blackwell, M., Jaramaz, B., Kanade, T.: Augmented reality imaging technology for orthopaedic surgery. Operative Techniques in Orthopaedics 10(1), 82–86 (2000)

    Article  Google Scholar 

  11. Blackwell, M., Morgan, F., DiGioia, A.M.: Augmented reality and its future in orthopaedics. Clinical Orthopaedics and Related Research (354), 111–122 (1998)

    Article  Google Scholar 

  12. Schwald, B., Seibert, H., Schnaider, M., Wesarg, S., Röddiger, S., Dogan, S.: Implementation and Evaluation of an Augmented Reality System Supporting Minimal Invasive Interventions. In: Workshop AMI-ARCS. Online Proceedings: Augmented Environments for Medical Imaging, pp. 41–48 (2004)

    Google Scholar 

  13. Fuchs, H., et al.: Optimizing a head-tracked stereo display system to guide hepatic tumor ablation. Studies in Health Technology and Informatics 132, 126–131 (2008)

    Google Scholar 

  14. Sauer, F., Khamene, A., Bascle, B., Schinunang, L., Wenzel, F., Vogt, S.: Augmented reality visualization of ultrasound images: system description, calibration, and features. In: Proceedings IEEE and ACM International Symposium on Augmented Reality, pp. 30–39 (2001)

    Google Scholar 

  15. Tardif, J.-P., Roy, S., Meunier, J.: Projector-based augmented reality in surgery without calibration. In: Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 548–551 (2003)

    Google Scholar 

  16. Gavaghan, K.A., Peterhans, M., Oliveira-Santos, T., Weber, S.: A portable image overlay projection device for computer-aided open liver surgery. IEEE Transactions on Bio-medical Engineering 58(6), 1855–1864 (2011)

    Article  Google Scholar 

  17. Schenk, A., et al.: Clinical relevance of model based computer-assisted diagnosis and therapy. In: Progress in Biomedical Optics and Imaging, Proceeding of SPIE Medical Imaging: Computer-Aided Diagnosis, San Diego, USA, vol. 6915, pp. 691502/1–691502/19 (June 2008)

    Google Scholar 

  18. Heizmann, O., et al.: Assessment of intraoperative liver deformation during hepatic resection: prospective clinical study. World Journal of Surgery 34(8), 1887–1893 (2010)

    Article  Google Scholar 

  19. Oliveira-Santos, T., Peterhans, M., Hofmann, S., Weber, S.: Passive Single Marker Tracking for Organ Motion and Deformation Detection in Open Liver Surgery. In: Taylor, R.H., Yang, G.-Z. (eds.) IPCAI 2011. LNCS, vol. 6689, pp. 156–167. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  20. Markert, M., Koschany, A., Lueth, T.: Tracking of the liver for navigation in open surgery. Int. J. CARS 5, 229–235 (2010)

    Article  Google Scholar 

  21. Cash, D.M., Miga, M.I., Sinha, T.K., Galloway, R.L., Chapman, W.C.: Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements. IEEE Transactions on Medical Imaging 24(11), 1479–1491 (2005)

    Article  Google Scholar 

  22. Ojdanić, D., Zidowitz, S., Peitgen, H.O.: Vessel-Based Intraoperative Rigid Registration for Navigated Liver Surgery: First Experiences. Methods and Applications in Automation 30-31, 21–28 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gavaghan, K.A., Anderegg, S., Peterhans, M., Oliveira-Santos, T., Weber, S. (2012). Augmented Reality Image Overlay Projection for Image Guided Open Liver Ablation of Metastatic Liver Cancer. In: Linte, C.A., Moore, J.T., Chen, E.C.S., Holmes, D.R. (eds) Augmented Environments for Computer-Assisted Interventions. AE-CAI 2011. Lecture Notes in Computer Science, vol 7264. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32630-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32630-1_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32629-5

  • Online ISBN: 978-3-642-32630-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics