Abstract
An endoscope is a medical instrument that acquires images inside the human body. Sometimes, diagnosis requires assessment of the 3-D shape of observed tissue. For example, the pathology of a polyp often is related its geometrical shape. This chapter proposes a new approach for the 3-D shape recovery under the conditions of both point light illumination and perspective projection. The purpose of the proposed approach is to recover the direct shape of an object from an endoscope image using shape-from-shading approach. Observation model is assumed under the condition that both of a camera view point and a point light source are located at the origin and the goal is to recover the (X,Y,Z) coordinates at each point on the object. The previous approaches recover the shape based on Fast Marching Method (FMM) under the condition of parallel light source and orthographic projection, while proposed approach uses optimization technique based on the constraints of image irradiance equation and geometrical constraint. Photometric constraints are derived from the relation of observed image intensity and the surface gradient parameters and the depth parameter at each point, while the geometrical constraints use the geometrical relation between the depth at a point and the surface gradient parameters at the neighboring points. Optimization is used to determine the unique depth parameter at any point using both constraints from an initial point at the local brightest point. Proposed approach is evaluated via simulation and demonstrated through experiment. It is confirmed that the recovered shape improves the better performance than that by the previous approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Nakatani, H., Abe, K., Miyakawa, A., Terakawa, S.: Three-dimensional measurement endoscope system with virtual rulers. Journal of Biomedical Optics 12(5), 051803-05–051803-06 (2007)
Mourgues, F.: Devernay, F.: 3d reconstruction of the operating field for image overlay in 3d-endoscopic surgery. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR), pp. 191–192. IEEE and ACM (2001)
Thormaehlen, T., Broszio, H.: Threedimensional endoscopy. In: Falk Symposium, Falk, pp. 199–212 (2001)
Horn, B.K.: Obtaining shape from shading information. In: Psychology of Computer Vision, Winston, pp. 115–155. McGraw-Hill (1975)
Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19(1), 139–144 (1980)
Kimmel, R., Sethian, J.A.: Optimal algorithm for shape from shading and path planning. Journal of Mathematical Imaging and Vision (JMIV) 14(3), 237–244 (2001)
Sethian, J.A.: A fast marching level set method for monotonically advancing fronts. Proceedings of the National Academy of Sciences of the United States of America (PNAS U.S.) 93(4), 1591–1593 (1996)
Yuen, S.Y., Tsui, Y.Y., Chow, C.K.: A fast marching formulation of perspective shape from shading under frontal illumination. Pattern Recognition Letters 28(7), 806–824 (2007)
Iwahori, Y., Sugie, H.: Extending fast marching method under point light source illumination and perspective projection. In: Proceedings of ICPR 2010, IAPR, pp. 1650–1653 (2010)
Coleman, T., Li, Y.: An interior, trust region approach for nonlinear minimization subject to bounds. SIAM Journal on Optimization 6, 418–455 (1996)
Iwahori, Y.: Hidezumi, S.: Reconstructing shape from shading images under point light source illumination. In: Proceedings of IEEE 10th International Conference on Pattern Recognition (ICPR 1990), pp. 83–87. IEEE (1990)
Shimasaki, Y., Iwahori, Y., Neog, D.R., Woodham, R.J., Bhuyan, M.K.: Generating lambertian image with uniform reflectance for endoscope image. In: International Workshop on Advanced Image Technology(IWAIT2013), 1C-2 (Computer Vision 1), pp. 1–6 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Iwahori, Y., Tatematsu, K., Nakamura, T., Fukui, S., Woodham, R.J., Kasugai, K. (2015). 3D Shape Recovery from Endoscope Image Based on Both Photometric and Geometric Constraints. In: Tweedale, J., Jain, L., Watada, J., Howlett, R. (eds) Knowledge-Based Information Systems in Practice. Smart Innovation, Systems and Technologies, vol 30. Springer, Cham. https://doi.org/10.1007/978-3-319-13545-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-13545-8_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13544-1
Online ISBN: 978-3-319-13545-8
eBook Packages: EngineeringEngineering (R0)