Abstract
We propose a new primal-dual framework for representation, capture, processing, and display of piecewise smooth surfaces, where the dual space is the space of oriented 3D lines, or rays, as opposed to the traditional dual space of planes. An image capture process detects points on a depth discontinuity sweep from a camera moving with respect to an object, or from a static camera and a moving object. A depth discontinuity sweep is a surface in dual space composed of the time-dependent family of depth discontinuity curves span as the camera pose describes a curved path in 3D space. Only part of this surface, which includes silhouettes, is visible and measurable from the camera. Locally convex points deep inside concavities can be estimated from the visible non-silhouette depth discontinuity points. Locally concave point laying at the bottom of concavities, which do not correspond to visible depth discontinuities, cannot be estimated, resulting in holes in the reconstructed surface. A first variational approach to fill the holes, based on fitting an implicit function to a reconstructed oriented point cloud, produces watertight models. We describe a first complete end-to-end system for acquiring models of shape and appearance. We use a single multi-flash camera and turntable for the data acquisition and represent the scanned objects as point clouds, with each point being described by a 3-D location, a surface normal, and a Phong appearance model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Crispell, D., Lanman, D., Sibley, P., Zhao, Y., Taubin, G.: Beyond Silhouettes: Surface Reconstruction using Multi-Flash Photography. In: 3rd International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT 2006), UNC, Chapel Hill, USA (June 2006)
Lanman, D., Crispell, D., Sibley, P., Zhao, Y., Taubin, G.: Multi-flash 3d photography: Capturing shape and appearance. In: Siggraph 2006, Poster session, Boston, MA (July 2006)
Sibley, P.G., Taubin, G.: Vectorfield Isosurface-based Reconstruction from Oriented points. In: Siggraph 2005, Sketch (2005)
Chen, F., Brown, G.M., Song, M.: Overview of three-dimensional shape measurement using optical methods. Optical Engineering 39(1), 10–22 (2000)
Mada, S., Smith, M., Smith, L., Midha, S.: An overview of passive and active vision techniques for hand-held 3d data acquisition. In: Opto Ireland 2003: Optical Metrology, Imaging, and Machine Vision (2003)
Wu, H., Chen, Y., Wu, M., Guan, C., Yu, X.: 3d measurement technology by structured light using stripe-edge-based gray code. In: International Symposium on Instrumentation Science and Technology. Journal of Physics: Conference Series, vol. 48, pp. 537–541 (2006)
Zhang, L., Curless, B., Seitz, S.M.: Spacetime stereo: Shape recovery for dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 367–374 (June 2003)
Levoy, M.: Light Field Rendering. In: Siggraph 1996, Conference Proceedings, pp. 31–42 (1996)
Gortler, S., Grzeszczuk, R., Szeliski, R., Cohen, M.: The Lumigraph. In: Siggraph 1996, Conference Proceedings, pp. 43–54 (1996)
Lanman, D., Crispell, D., Wachs, M., Taubin, G.: Spherical Catadioptric Arrays: Construction, Geometry, and Calibration. In: 3rd International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT 2006), UNC, Chapel Hill, USA (June 2006)
Lanman, M., Wachs, D., Taubin, G., Cukierman, F.: Reconstructing a 3D Line from a Single Catadioptric Image. In: 3rd International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT 2006), UNC, Chapel Hill, USA (June 2006)
Kang, K., Tarel, J.-P., Fishman, R., Cooper, D.: A linear dual-space approach to 3d surface reconstruction from occluding contours using algebraic surfaces. In: IEEE International Conference on Computer Vision (ICCV 2001), vol. I, pp. 198–204 (2001)
Liang, C., Wong, K.-Y.K.: Complex 3d shape recovery using a dual-space approach. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2005) (2005)
Raskar, R., Tan, K.-H., Feris, R., Yu, J., Turk, M.: Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. ACM Trans. Graph. 23(3), 679–688 (2004)
Annotated computer vision bibliography on surface and shape from contours or silhouettes, http://www.visionbib.com/bibliography/shapefrom408.html
Matusik, W., Buehler, C., Raskar, R., Gortler, S., McMillan, L.: Image-based visual hulls. In: SIGGRAPH 2000 (2000)
Cipolla, R., Giblin, P.: Visual Motion of Curves and Surfaces. Cambridge University Press, Cambridge (2000)
Cross, G., Zisserman, A.: Quadric surface reconstruction from dual-space geometry. In: IEEE International Conference on Computer Vision (1998)
Liang, C., Wong, K.-Y.K.: Complex 3d shape recovery using a dual-space approach. In: IEEE Conference on Computer Vision and Pattern Recognition (2005)
Seitz, S., Curless, B., Diebel, J., Scarstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: IEEE Conference on Computer Vision and Pattern Recognition (2006)
Esteban, C.H., Schmitt, F.: Silhouette and stereo fusion for 3d object modeling. Comput. Vis. Image Underst. 96(3), 367–392 (2004)
Furukawa, Y., Ponce, J.: Carved visual hulls for image-based modeling. In: European Conference on Computer vision 2006 (2006)
Goesele, M., Seitz, S., Curless, B.: Multi-view stereo revisited. In: IEEE Conference on Computer Vision and Pattern Recognition (2006)
Lensch, H.P.A., Kautz, J., Goesele, M., Heidrich, W., Seidel, H.-P.: Image-based reconstruction of spatially varying materials. In: Proceedings of Eurographics Rendering Workshop (2001)
Sadlo, F., Weyrich, T., Peikert, R., Gross, M.: A practical structured light acquisition system for point-based geometry and texture. In: Eurographics Symposium on Point-Based Graphics, pp. 89–98 (June 2005)
Bouguet, J.-Y.: Complete camera calibration toolbox for matlab, http://www.vision.caltech.edu/bouguetj/calib_doc
Giblin, P.J., Weiss, R.S.: Epipolar curves on surfaces. Image and Vision Computing 13(1), 33–34 (1995)
Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Levin, D., Silva, C.T.: Computing and rendering point set surfaces. IEEE Trans. on Visualization and Computer Graphics 9(1), 3–15 (2003)
Davis, J., Marschner, S., Garr, M., Levoy, M.: Filling holes in complex surfaces using volumetric diffusion. In: 3DPVT 2002 (2002)
Park, S., Guo, X., Shin, H., Qin, H.: Shape and appearance repair for incomplete point surfaces. In: IEEE International Conference on Computer Vision, vol. 2 (2005)
Sibley, P.G., Taubin, G.: Vectorfield Isosurface-based Reconstruction from Oriented Points. In: SIGGRAPH 2005, Sketch (2005)
Feris, R., Raskar, R., Tan, K.-H., Turk, M.: Specular reflection reduction with multi-flash imaging. In: 17th Brazilian Symposium on Computer Graphics and Image Processing (October 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Taubin, G., Crispell, D., Lanman, D., Sibley, P., Zhao, Y. (2009). Shape from Depth Discontinuities. In: Nielsen, F. (eds) Emerging Trends in Visual Computing. ETVC 2008. Lecture Notes in Computer Science, vol 5416. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00826-9_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-00826-9_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00825-2
Online ISBN: 978-3-642-00826-9
eBook Packages: Computer ScienceComputer Science (R0)