Skip to main content

3D Surface Reconstruction from Endoscopic Videos

  • Conference paper
Visualization in Medicine and Life Sciences

Part of the book series: Mathematics and Visualization ((MATHVISUAL))

Endoscopy is a popular procedure which helps surgeons investigate the interior of a patient’s organ and find abnormalities (e.g., polyps). However, it requires a great expertise using only a stream of 2D images of the interior, and there is a possibility that the physician will miss some polyps. Instead, a 3D reconstruction of the interior surface of the organ will be very helpful. It turns the stream of 2D images into a meaningful 3D model. The physicians could then spend more time scrutinizing the interior surface. In addition, the 3D reconstruction result will provides more details about the patient’s organ (e.g., concavity/convexity, a coordinate system and 3D measurements), and could be saved for later uses. In a related work, Helferty et al. [HZMH01, HH02] have used a CT-based virtual endoscopic registration technique to guide the bronchoscopic needle biopsy. Winter et al. [WSRW05] also proposed a reconstruction scheme enhanced by a data-driven filtering and a knowledge driven extension.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. IEEE Conference on Computer Vision and Pattern Recognition, 690-696 (2000)

    Google Scholar 

  2. Bitter, I., Kaufman, A.E., Sato, M.: Penalized-distance volumetric skeleton algorithm. IEEE Transactions on Visualization and Computer Graphics, 7, 195–206 (2001)

    Article  Google Scholar 

  3. Barles, B., Souganidis, P.: Convergence of approximation schemes for fully nonlinear second order equations. Journal of Asymptotic Analysis, 4, 271–283 (1991)

    MATH  MathSciNet  Google Scholar 

  4. Christy, S., Horaud, R.: Euclidean shape and motion from multiple perspective views by affine iterations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18, 1098–1104 (1996)

    Article  Google Scholar 

  5. Helferty, J.P., Higgins, W.E.: Combined endoscopic video tracking and virtual 3d ct registration for surgical guidance. IEEE International Conference on Image Processing, II: 961–964 (2002)

    Google Scholar 

  6. Hong, L., Muraki, S., Kaufman, A., Bartz, D., He, T.: Virtual Voyage: interactive navigation in the human colon. SIGGRAPH, 27-34 (1997)

    Google Scholar 

  7. Helferty, J.P., Zhang, C., McLennan, G., Higgins, W.E.: Videoendo-scopic distortion correction and its application to virtual guidance of endoscopy. IEEE Transactions on Medical Imaging, 20, 605–617 (2001)

    Article  Google Scholar 

  8. Kaufman, A., Lakare, S., Kreeger, K., Bitter, I.: Virtual colonoscopy. Communications of the ACM, 48, 37–41 (2005)

    Article  Google Scholar 

  9. Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. SIGGRAPH, 163-170 (1987)

    Google Scholar 

  10. Mahamud, S., Hebert, M., Omori, Y., Ponce, J.: Provably-convergent iterative methods for projective structure from motion. IEEE Conference on Computer Vision and Pattern Recognition, 1018-1025 (2001)

    Google Scholar 

  11. Poelman, C.J., Kanade, T.: A paraperspective facttorization method for shape and motion recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 206–218 (1997)

    Article  Google Scholar 

  12. Prados, E.: Application of the theory of the viscosity solutions to the shape from shading problem. Ph.D thesis, University of Nice SophiaAntipolis, France (1996)

    Google Scholar 

  13. Prados, E., Faugeras, O.: Shape from shading: a well-posed problem?. IEEE Conference on Computer Vision and Pattern Recognition, 870-877 (2005)

    Google Scholar 

  14. Rusinkiewicz, S., Hall-Holt, O., Levoy, M.: Real-time 3D model acquisition. SIGGRAPH, 438-446 (2002)

    Google Scholar 

  15. Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. SIGGRAPH, 835-846 (2006)

    Google Scholar 

  16. Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision, 9, 137–154 (1992)

    Article  Google Scholar 

  17. Winter, C., Scholz, I., Rupp, S., Wittenberg, T.: Reconstruction of tubes from monocular fiberscopic images - application and first results. Vision, Modeling, and Visualization, 20 57–64 (2005)

    Google Scholar 

  18. Zhang, R., Tsai, P., Cryer, J.E., Shah, M.: Shape from shading: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 690–706 (1999)

    Article  Google Scholar 

  19. Zhang, R.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1330–1334 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer

About this paper

Cite this paper

Kaufman, A., Wang, J. (2008). 3D Surface Reconstruction from Endoscopic Videos. In: Linsen, L., Hagen, H., Hamann, B. (eds) Visualization in Medicine and Life Sciences. Mathematics and Visualization. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72630-2_4

Download citation

Publish with us

Policies and ethics