Abstract
Illumination defocus and global illumination effects are major challenges for active illumination scene recovery algorithms. Illumination defocus limits the working volume of projector-camera systems and global illumination can induce large errors in shape estimates. In this paper, we develop an algorithm for scene recovery in the presence of both defocus and global light transport effects such as interreflections and sub-surface scattering. Our method extends the working volume by using structured light patterns at multiple projector focus settings. A careful characterization of projector blur allows us to decode even partially out-of-focus patterns. This enables our algorithm to recover scene shape and the direct and global illumination components over a large depth of field while still using a relatively small number of images (typically 25-30). We demonstrate the effectiveness of our approach by recovering high quality depth maps of scenes containing objects made of optically challenging materials such as wax, marble, soap, colored glass and translucent plastic.
Chapter PDF
Similar content being viewed by others
References
Achar, S., Nuske, S.T., Narasimhan, S.G.: Compensating for Motion During Direct-Global Separation. In: International Conference on Computer Vision (2013)
Chen, T., Seidel, H.P., Lensch, H.P.: Modulated phase-shifting for 3D scanning. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (June 2008)
Couture, V., Martin, N., Roy, S.: Unstructured light scanning to overcome interreflections. In: International Conference on Computer Vision (2011)
Goldman, D.B., Curless, B., Hertzmann, A., Seitz, S.M.: Shape and spatially-varying BRDFs from photometric stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(6), 1060–1071 (2010)
Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.G.: Structured light 3D scanning in the presence of global illumination. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 713–720 (June 2011)
Gupta, M., Nayar, S.K.: Micro Phase Shifting. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)
Gupta, M., Tian, Y., Narasimhan, S.G., Zhang, L.: A Combined Theory of Defocused Illumination and Global Light Transport. International Journal of Computer Vision 98(2), 146–167 (2011)
Hermans, C., Francken, Y., Cuypers, T., Bekaert, P.: Depth from sliding projections. In: IEEE Conference on Computer Vision and Pattern Recognition (2009)
Hern, C., Gabriel, V., Bjorn, J.B., Roberto, S.: Non-rigid Photometric Stereo with Colored Lights. In: International Conference on Computer Vision (October 2007)
Inokuchi, S., Sato, K., Matsuda, F.: Range imaging system for 3-d object recognition. In: International Conference on Pattern Recognition (1984)
Lei, S., Zhang, S.: Digital sinusoidal fringe pattern generation: Defocusing binary patterns VS focusing sinusoidal patterns. Optics and Lasers in Engineering 48(5), 561–569 (2010)
Nayar, S.K., Krishnan, G., Grossberg, M.D., Raskar, R.: Fast separation of direct and global components of a scene using high frequency illumination. ACM Transactions on Graphics 25(3), 935 (2006)
O’Toole, M., Raskar, R., Kutulakos, K.N.: Primal-dual coding to probe light transport. ACM Transactions on Graphics 31(4), 1–11 (2012)
Reddy, D., Ramamoorthi, R., Curless, B.: Frequency-Space Decomposition and Acquisition of Light Transport under Spatially Varying Illumination. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 596–610. Springer, Heidelberg (2012)
Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: IEEE Conference on Computer Vision and Pattern Recognition (2003)
Schechner, Y., Kiryati, N.: Depth from defocus vs. stereo: How different really are they? International Journal of Computer Vision 39(2), 141–162 (2000)
Tao, M., Hadap, S., Malik, J., Ramamoorthi, R.: Depth from Combining Defocus and Correspondence Using Light-Field Cameras. In: International Conference on Computer Vision (2013)
Yuan, T., Subbarao, M.: Integration of Multiple-Baseline Color Stereo Vision with Focus and Defocus Analysis for 3-D. In: Proceedings of SPIE, No. i, pp. 44–51 (November 1998)
Zhang, L., Nayar, S.: Projection defocus analysis for scene capture and image display. ACM Transactions on Graphics (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Achar, S., Narasimhan, S.G. (2014). Multi Focus Structured Light for Recovering Scene Shape and Global Illumination. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8689. Springer, Cham. https://doi.org/10.1007/978-3-319-10590-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-10590-1_14
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10589-5
Online ISBN: 978-3-319-10590-1
eBook Packages: Computer ScienceComputer Science (R0)