Skip to main content
SpringerLink
Log in

Towards Live Monocular 3D Laparoscopy Using Shading and Specularity Information

  • Conference paper
Information Processing in Computer-Assisted Interventions (IPCAI 2012)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7330))

Abstract

We present steps toward the first real-time system for computing and visualising 3D surfaces viewed in live monocular laparoscopy video. Our method is based on estimating 3D shape using shading and specularity information, and seeks to push current Shape from Shading (SfS) boundaries towards practical, reliable reconstruction. We present an accurate method to model any laparoscope’s light source, and a highly-parallelised SfS algorithm that outperforms the fastest current method. We give details of its GPU implementation that facilitates realtime performance of an average frame-rate of 23fps. Our system also incorporates live 3D visualisation with virtual stereoscopic synthesis. We have evaluated using real laparoscopic data with ground-truth, and we present the successful in-vivo reconstruction of the human uterus. We however draw the conclusion that the shading cue alone is insufficient to reliably handle arbitrary laparoscopic images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ackerman, J. D., Keller, K., Fuchs, H. Surface reconstruction of abdominal organs using laparoscopic structured light for augmented reality. 3DICA (2002)

    Google Scholar 

  2. Barron, J.T., Malik, J.: High-frequency shape and albedo from shading. In: CVPR, pp. 2521–2528 (2011)

    Google Scholar 

  3. Hu, M., Penney, G., Edwards, P., Figl, M., Hawkes, D.: 3D Reconstruction of Internal Organ Surfaces for Minimal Invasive Surgery. In: Ayache, N., Ourselin, S., Maeder, A. (eds.) MICCAI 2007, Part I. LNCS, vol. 4791, pp. 68–77. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  4. Lau, W.W., Ramey, N.A., Corso, J.J., Thakor, N.V., Hager, G.D.: Stereo-Based Endoscopic Tracking of Cardiac Surface Deformation. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI 2004. LNCS, vol. 3217, pp. 494–501. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  5. Lepetit, V., Moreno-Noguer, F., Fua, P.: EPnP: An Accurate O(n) Solution to the PnP Problem. IJCV 81, 155–166 (2008)

    Article  Google Scholar 

  6. Malti, A., Bartoli, A., Collins, T.: Template-Based Conformal Shape-from-Motion from Registered Laparoscopic Images. In: MIUA (2011)

    Google Scholar 

  7. Mountney, P., Yang, G.-Z.: Motion Compensated SLAM for Image Guided Surgery. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010. LNCS, vol. 6362, pp. 496–504. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  8. Mueller-Richter, U.D.A., Limberger, A., Weber, P., Ruprecht, K.W., Spitzer, W., Schilling, M.: Possibilities and limitations of current stereo-endoscopy. Surgical Endoscopy 18, 942–947 (2004)

    Article  Google Scholar 

  9. Okatani, T., Deguchi, K.: Shape reconstruction from an endoscope image by shape from shading technique for a point light source at the projection center. CVIU 66, 119–131 (1997)

    Google Scholar 

  10. Prados, E., Faugeras, O.: Perspective Shape from Shading and Viscosity Solutions. In: ICCV, pp. 826–831 (2003)

    Google Scholar 

  11. Prados, E., Faugeras, O.: Shape from Shading: a well-posed problem? In: CVPR, pp. 870–877 (2005)

    Google Scholar 

  12. Penne, J., Höller, K., Stürmer, M., Schrauder, T., Schneider, A., Engelbrecht, R., Feußner, H., Schmauss, B., Hornegger, J.: Time-of-Flight 3-D Endoscopy. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009. LNCS, vol. 5761, pp. 467–474. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  13. Quartucci, C.H., Tozzi, C.L.: Towards 3D Reconstruction of Endoscope Images using Shape from Shading. In: SIBGRAPI, pp. 90–96 (2000)

    Google Scholar 

  14. Stoyanov, D., Darzi, A., Yang, G.Z.: Dense 3D Depth Recovery for Soft Tissue Deformation During Robotically Assisted Laparoscopic Surgery. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI 2004. LNCS, vol. 3217, pp. 41–48. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  15. Tankus, A., Sochen, N., Yeshurun, Y.: Perspective SfS by fast marching. In: CVPR, pp. 43–49 (2004)

    Google Scholar 

  16. Tankus, A., Sochen, N., Yeshurun, Y.: Shape-from-Shading Under Perspective Projection. IJCV 63, 21–43 (2007)

    Article  Google Scholar 

  17. Tsai, P., Shah, M.: Shape From Shading Using Linear Approximation. Image and Vision Computing 12, 487–498 (1994)

    Article  Google Scholar 

  18. Wu, C., Narasimhan, S.G., Jaramaz, B.: Shape-from-Shading under Near Point Lighting and Partial views for Orthopedic Endoscopy. In: PACV (2007)

    Google Scholar 

  19. Yeung, S.Y., Tsui, H.T., Yim, A.: Global Shape from Shading for an Endoscope Image. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 318–327. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ALCoV-ISIT, Université d’Auvergne, Clermont-Ferrand, France

    Toby Collins & Adrien Bartoli

Authors
  1. Toby Collins
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adrien Bartoli
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Electrical and Computer Engineering, The University of British Columbia, V6T 1Z4, Vancouver, BC, Canada

    Purang Abolmaesumi

  2. School of Engineering and Computer Science,ELSC, The Hebrew University of Jerusalem, Givat Ram, 91904, Jerusalem, Israel

    Leo Joskowicz

  3. Technische Universität München, Boltzmannstr. 3, 85748, Garching, Germany

    Nassir Navab

  4. Facult’e de Médecine, Universit’e de Rennes 1, UMR 1099 LTSI, 2 Avenue de Pr. L’eon Bernard, CS 34317, 35043, Rennes Cedex, France

    Pierre Jannin

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Collins, T., Bartoli, A. (2012). Towards Live Monocular 3D Laparoscopy Using Shading and Specularity Information. In: Abolmaesumi, P., Joskowicz, L., Navab, N., Jannin, P. (eds) Information Processing in Computer-Assisted Interventions. IPCAI 2012. Lecture Notes in Computer Science, vol 7330. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30618-1_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30618-1_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30617-4

  • Online ISBN: 978-3-642-30618-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation