Abstract
This paper describes the construction of a layered scene-model, based on a single hazy image of an outdoor scene. A depth map and radiance image are estimated by standard dehazing methods. The radiance image is then segmented into a small number of clusters, and a corresponding scene-plane is estimated for each. This provides the basic structure of a 2.5-D scene model, without the need for multiple views, or image correspondences. We show that problems of gap-filling and depth blending can be addressed systematically, with respect to the layered depth-structure. The final models, which resemble cardboard ‘pop-ups’, are visually convincing. An HTML5/WebGL implementation is described, and subjective depth-preferences are tested in a psychophysical experiment.
Chapter PDF
Similar content being viewed by others
References
He, K., Sun, J., Tang, X.: Single Image Haze Removal Using Dark Channel Prior. IEEE Trans. PAMI 33(12), 2341–2353 (2011)
Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photagraphs: a hybrid geometry and image-based approach. In: Proc. ACM SIGGRAPH, pp. 11–20 (1996)
Cipolla, R., Robertson, D., Boyer, E.: Photobuilder - 3D models of architectural scenes form uncalibrated images. In: Proc. IEEE Conference on Multimedia Computing and Systems, pp. 25–31 (1999)
Hoiem, D., Efros, A., Hebert, M.: Automatic photo pop-up. In: Proc. ACM SIGGRAPH, pp. 577–584 (2005)
Hoiem, D., Efros, A., Hebert, M.: Putting objects in perspective. In: Proc. CVPR, pp. 3–15 (2006)
Saxena, A., Chuang, S.H., Ng, A.Y.: Learning depth from single monocular images. In: Proc. NIPS, vol. 18, pp. 1161–1168 (2005)
Saxena, A., Chuang, S.H., Ng, A.Y.: 3D depth reconstruction from a single still image. In: Proc. IJCAI, pp. 53–69 (2007)
Saxena, A., Sun, M., Ng, A.Y.: Learning 3D scene structure from a single still image. In: Proc. ICCV, pp. 1–8 (2007)
Criminisi, A.: Objecte removal by exemplar-based inpainting. In: Proc. CVPR (2003)
Fischler, M., Bolles, R.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM 24, 381–395 (1981)
Schnabel, R., Wahl, R., Klein, R.: Efficient RANSAC for Point-cloud Shape Detection. Computer Graphics Forum 26(2), 214–226 (2007)
Yingyang, M., Förstner, W.: Plane Detection in Point Cloud Data. Technical report, Institute of Geodesy and Geoinformation, University of Bonn (2010)
Criminisi, A., Reid, I., Zisserman, A.: Single View Metrology. Int. Journal of Computer Vision 40(2), 123–148 (2000)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004)
Horry, Y., Anjyo, K.I., Arai, K.: Tour into the picture: using a spidery mesh interface to make animation from a single image. In: Proc. ACM SIGGRAPH, pp. 225–232 (1997)
Liebowitz, D., Criminisi, A., Zisserman, A.: Creating architectural models from images. In: Proc. Eurographics, vol. 18, pp. 39–50 (1999)
Zhang, L., Dugas-Phocion, G., Samson, J., Seitz, S.: Single view modeling of free-form scenes. In: Proc. CVPR, pp. 990–997 (2001)
Rother, C., Kolmogorov, V., Blake, A.: Grab-Cut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Computer Graphics 23(3), 309–314 (2004)
Wang, J.Y.A., Adelson, E.H.: Representing Moving Images with Layers. IEEE Trans. Image Processing 3(5), 625–638 (1994)
Swirski, L., Richardt, C., Dodgson, N.A.: Layered Photo Pop-Up. SIGGRAPH Posters (2011)
Szeliski, R., Golland, P.: Stereo matching with transparency and matting. In: Proc. ICCV, pp. 517–524 (1998)
Three JavaScript Library. http://threejs.org/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhao, L., Hansard, M., Cavallaro, A. (2015). Pop-up Modelling of Hazy Scenes. In: Murino, V., Puppo, E. (eds) Image Analysis and Processing — ICIAP 2015. ICIAP 2015. Lecture Notes in Computer Science(), vol 9279. Springer, Cham. https://doi.org/10.1007/978-3-319-23231-7_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-23231-7_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23230-0
Online ISBN: 978-3-319-23231-7
eBook Packages: Computer ScienceComputer Science (R0)