Abstract
The invention of light field camera provides an approach of extracting depth from a collection of refocused photos. However, current depth from focus methods are suffering from the problem of inaccuracy, especially in the regions of object boundaries. In this paper, we propose a novel method to extract an accurate depth map from several refocused images. We first render a collection of images by uniformly changing the focal length. Then we deduce a rough depth map according to the amount of blur, which is measured by a multi-scale gradient operator. Finally, we apply a weighted median filter for refinement, which suppresses depth noise and supplies a well recovery of object boundaries and fine structures. The experimental results show that our method outperforms the built-in method from Lytro light field camera.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Grossmann, P.: Depth from focus. Pattern Recogn. Lett. 5(1), 63–69 (1987)
Shum, H.-Y., Chan, S.-C., Kang, S.B.: Image-Based Rendering. Springer, Heidelberg (2008)
Oh, B.M., Chen, M., Dorsey, J., Durand, F.: Image-based modeling and photo editing. In: Annual Conference on Computer Graphics and Interactive Techniques, pp. 433–442. ACM (2001)
Ziou, D., Deschenes, F.: Depth from defocus estimation in spatial domain. Comput. Vis. Image Underst. 81(2), 143–165 (2001)
Namboodiri, V.P., Chaudhuri, S.: On defocus, diffusion and depth estimation. Pattern Recogn. Lett. 28(3), 311–319 (2007)
Ng, R., Levoy, M., Brdif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Comput. Sci. Tech. Rep. CSTR 2(11), 1–11 (2005)
Zhang, X., Wang, Y., Zhang, J., Liangmei, H., Wang, M.: Light field saliency vs. 2D saliency: a comparative study. Neurocomputing 166, 389–396 (2015)
Zhang, J., Wang, M., Gao, J., Wang, Y., Zhang, X., Wu, X.: Saliency detection with a deeper investigation of light field. In: International Joint Conference on Artificial Intelligence, pp. 2212–2218 (2015)
Zhou, C., Lin, S., Nayar, S.K.: Coded aperture pairs for depth from defocus and defocus deblurring. Int. J. Comput. Vis. 93(1), 53–72 (2011)
Tao, M., Hadap, S., Malik, J., Ramamoorthi, R.: Depth from combining defocus and correspondence using light-field cameras. In: IEEE International Conference on Computer Vision, pp. 673–680 (2013)
Ma, Z., He, K., Wei, Y., Sun, J., Wu, E.: Constant time weighted median filtering for stereo matching and beyond. In: IEEE International Conference on Computer Vision, pp. 49–56 (2013)
Lytro Desktop. https://illum.lytro.com
He, K., Sun, J., Tang, X.: Guided image filtering. In: European Conference on Computer Vision, pp. 1–14 (2010)
Pentland, A.P.: A new sense for depth of field. IEEE Trans. Pattern Anal. Mach. Intell. 4, 523–531 (1987)
Nayar, S.K., Watanabe, M., Noguchi, M.: Real-time focus range sensor. IEEE Trans. Pattern Anal. Mach. Intell. 18(12), 1186–1198 (1996)
Chaudhuri, S., Rajagopalan, A.N.: Depth from Defocus: A Real Aperture Imaging Approach. Springer, New York (2012)
Watanabe, M., Nayar, S.K.: Rational filters for passive depth from defocus. Int. J. Comput. Vis. 27(3), 203–225 (1998)
Lewis, J.P.: Fast template matching. Vis. Interface 95(120123), 15–19 (1995)
Acknowledgments
This work is supported by National Science Foundation of China (61321491) and Collaborative Innovation Center of Novel Software Technology and Industrialization.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Sun, C., Wu, G. (2016). Depth Extraction from a Light Field Camera Using Weighted Median Filtering. In: Chen, E., Gong, Y., Tie, Y. (eds) Advances in Multimedia Information Processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science(), vol 9917. Springer, Cham. https://doi.org/10.1007/978-3-319-48896-7_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-48896-7_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48895-0
Online ISBN: 978-3-319-48896-7
eBook Packages: Computer ScienceComputer Science (R0)