Advertisement

Endoscopic Image Overlay for the Targeting of Hidden Anatomy in Laparoscopic Visceral Surgery

  • Matteo Fusaglia
  • Kate Gavaghan
  • Guido Beldi
  • Francesco Volonté
  • François Pugin
  • Matthias Peterhans
  • Nicolas Buchs
  • Stefan Weber
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7815)

Abstract

Limitations associated with the visual information provided to surgeons during laparoscopic surgery increases the difficulty of procedures and thus, reduces clinical indications and increases training time. This work presents a novel augmented reality visualization approach that aims to improve visual data supplied for the targeting of non visible anatomical structures in laparoscopic visceral surgery. The approach aims to facilitate the localisation of hidden structures with minimal damage to surrounding structures and with minimal training requirements. The proposed augmented reality visualization approach incorporates endoscopic images overlaid with virtual 3D models of underlying critical structures in addition to targeting and depth information pertaining to targeted structures. Image overlay was achieved through the implementation of camera calibration techniques and integration of the optically tracked endoscope into an existing image guidance system for liver surgery. The approach was validated in accuracy, clinical integration and targeting experiments. Accuracy of the overlay was found to have a mean value of 3.5 mm ± 1.9 mm and 92.7% of targets within a liver phantom were successfully located laparoscopically by non trained subjects using the approach.

Keywords

Augmented reality Laparoscopic surgery Endoscopic image overlay 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Veldkamp, R., Kuhry, E., Hop, W., Jeekel, J., Kazemier, G., Bonjer, H.J., Haglind, E., Påhlman, L., Cuesta, M., Msika, S., Morino, M., Lacy, A.: Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial. The Lancet Oncology 6(7), 477–484 (2005)CrossRefGoogle Scholar
  2. 2.
    Buell, J., Cherqui, D., Geller, D., O’Rourke, N., Iannitti, D., Dagher, I., et al.: The International Position on Laparoscopic Liver Surgery. Annals of Surgery 250(5), 825–830 (2009)CrossRefGoogle Scholar
  3. 3.
    Marescaux, J., Rubino, F., Arenas, M., Mutter, D., Soler, L.: Augmented-Reality-Assisted Laparoscopic Adrenalectomy. JAMA 292(18), 2214–2215 (2004)CrossRefGoogle Scholar
  4. 4.
    Nicolau, S., Pennec, X., Soler, L., Buy, X., Gangi, A., Ayache, N., Marescaux, J.: An augmented reality system for liver thermal ablation: design and evaluation on clinical cases. Medical Image Analysis 13(3), 494–506 (2009)CrossRefGoogle Scholar
  5. 5.
    Soler, L., Nicolau, S., Hostettler, A., Fasquel, J., Agnus, V., Charnoz, A.: Computer Assisted Digestive Surgery, Computational Surgery and Dual Training, 2010th edn., pp. 139–153. Springer, US (2010)Google Scholar
  6. 6.
    Hong, J., Sungmin, K., Hashizume, M., Cho, H.: Endoscopic image overlay surgical navigation using augmented and virtual reality technologies. In: Proceedings of 2011 8th Asian Control Conference (ASCC), May 15, pp. 574–578 (2011)Google Scholar
  7. 7.
    Winne, C., Khan, M., Stopp, F., Jank, E., Keeve, E.: Overlay visualization in endoscopic ENT surgery. International Journal of Computer Assisted Radiology and Surgery 6(3), 401–406 (2010)CrossRefGoogle Scholar
  8. 8.
    Nicolau, S., Soler, L., Mutter, D., Marescaux, J.: Augmented reality in laparoscopic surgical oncology. Surgical Oncology 20(3), 189–201 (2011)CrossRefGoogle Scholar
  9. 9.
    Peterhans, M., vom Berg, A., Dagon, B., Inderbitzin, D., Baur, C., Candinas, D., Weber: A navigation system for open liver surgery: design, workflow and first clinical applications. The International Journal of Medical Robotics + Computer Assisted Surgery: MRCAS 7(1), 7–16 (2011)CrossRefGoogle Scholar
  10. 10.
    Schenk, A., Zidowitz, S., Bourquain, H., Hindennach, M., Hansen, C., Hahn, H., Peitgen, H.O.: Clinical relevance of model based computer-assisted diagnosis and therapy. In: Proceedings of SPIE, vol. 6915(6), pp. 691502\1–691502\19 (June 2008)Google Scholar
  11. 11.
    Gavaghan, K.A., Peterhans, M., Oliveira-Santos, T., Weber, S.: A portable image overlay projection device for computer-aided open liver surgery. IEEE Transactions on Biomedical Engineering 58(6), 1855–1864 (2011)CrossRefGoogle Scholar
  12. 12.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  13. 13.
    Li, S., Zhang, G., Wei, Z.: The determination of the intrinsic and extrinsic parameters of virtual camera based on OpenGL. In: Proceedings of SPIE, vol. 6358, pp. 63581C–63581C-6 (2006) Google Scholar
  14. 14.
    Gavaghan, K.A., Anderegg, S., Peterhans, M., Oliveira-Santos, T., Weber, S.: Augmented Reality Image Overlay Projection for Image Guided Open Liver Ablation of Metastatic Liver Cancer. In: Linte, C.A., Moore, J.T., Chen, E.C.S., Holmes III, D.R. (eds.) AE-CAI 2011. LNCS, vol. 7264, pp. 36–46. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  15. 15.
    Glossop, N.D.: Advantages of optical compared with electromagnetic tracking. The Journal of Bone and Joint Surgery 91(suppl. 1), 23–28 (2009)Google Scholar
  16. 16.
    Yaniv, Z., Wilson, E., Lindisch, D., Cleary, K.: Electromagnetic tracking in the clinical environment. Medical Physics 36(3), 876 (2009)CrossRefGoogle Scholar
  17. 17.
    Heizmann, O., Zidowitz, S., Bourquain, H., Potthast, S., Peitgen, H.O., Oertli, D., Kettelhack, C.: Assessment of intraoperative liver deformation during hepatic resection: prospective clinical study. World Journal of Surgery 34(8), 1887–1893 (2010)CrossRefGoogle Scholar
  18. 18.
    Ribes, D., Peterhans, M., Wallach, D., Banz, V., Stavrou, G., Weber, S.: US/CT registration framework for higher instrument guidance accuracy in open liver surgery. In: CURAC 2012, Düsseldorf (2012) Google Scholar
  19. 19.
    Hansen, C., Wieferich, J., Ritter, F., Rieder, C., Peitgen, H.-O.: Illustrative visualization of 3D planning models for augmented reality in liver surgery. International Journal of Computer Assisted Radiology and Surgery 5(2), 133–141 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Matteo Fusaglia
    • 1
  • Kate Gavaghan
    • 1
  • Guido Beldi
    • 2
  • Francesco Volonté
    • 3
  • François Pugin
    • 3
  • Matthias Peterhans
    • 1
  • Nicolas Buchs
    • 3
  • Stefan Weber
    • 1
  1. 1.ARTORG Centre for Biomedical Engineering ResearchUniversity of BernBernSwitzerland
  2. 2.Department for Visceral Surgery and MedicineBern University HospitalBernSwitzerland
  3. 3.Visceral and Transplantation Surgery, Department of SurgeryUniversity Hospitals of GenevaGeneva 14Switzerland

Personalised recommendations