Abstract
In this paper we present a novel two-stage framework for extracting what we define as a quasi-regular structure in facade images. A quasi-regular structure is an irregular rectangular grid representing the placements of repetitive structural architecture objects, e.g., windows, in a facade. Such a structure generalizes a perfect lattice structure generated by the 2D symmetry groups, studied by the previous work. First, we propose to formulate the quasi-regular structure detection in an object-oriented Marked Point Process framework by treating the architectural elements as objects. This leads to an initial quasi-regular structure map which serves as an indicator map of potential object locations. Then, we propose a regularization scheme to recover the complete quasi-regular structures from the initial incomplete structure. This stage takes advantage of the intrinsic low rank constraint of the quasi-regular structure representing a regularized facade. By applying such a regularization, the complete quasi-regular facade structure is obtained. We have extensively tested our method on a large variety of facade images, and demonstrated both the effectiveness and the robustness of our two-stage framework.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Korah, T., Rasmussen, C.: 2D lattice extraction from structured environments. In: ICIP 2007. Image Processing, vol. 2, pp. 61–64 (2007)
Tyleček, R., Šára, R.: A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part I. LNCS, vol. 6492, pp. 450–463. Springer, Heidelberg (2011)
Teboul, O., Kokkinos, I., Simon, L., Koutsourakis, P., Paragios, N.: Shape grammar parsing via Reinforcement Learning. In: Shape grammar parsing via Reinforcement Learning. Computer Vision and Pattern Recognition, CVPR 2011, pp. 2273–2280 (2011)
Alegre, F., Dellaert, F.: A Probabilistic Approach to the Semantic Interpretation of Building Facades. In: International Workshop on Vision Techniques Applied to the Rehabilitation of City Centres (2004)
Ortner, M., Descombes, X., Zerubia, J.: Building extraction from digital elevation models. In: Acoustics, Speech, and Signal Processing, ICASSP 2003, vol. 3, pp. III-337–III-340 (2003)
Park, M., Brocklehurst, K., Collins, R., Liu, Y.: Translation-Symmetry-Based Perceptual Grouping with Applications to Urban Scenes. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part III. LNCS, vol. 6494, pp. 329–342. Springer, Heidelberg (2011)
Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., Quan, L.: Image-based façade modeling. ACM Transactions on Graphics, TOG 27, 161 (2008)
Zhao, P., Quan, L.: Translation symmetry detection in a fronto-parallel view. In: Computer Vision and Pattern Recognition, CVPR 2011, pp. 1009–1016 (2011)
Zhang, Z., Liang, X., Ganesh, A., Ma, Y.: TILT: Transform Invariant Low-Rank Textures. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part III. LNCS, vol. 6494, pp. 314–328. Springer, Heidelberg (2011)
Lin, Z., Chen, M., Ma, Y.: The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. UIUC Technical Report (2009)
Bertsekas, D.P.: Constrained optimization and Lagrange multiplier methods. Computer Science and Applied Mathematics 1 (1982)
Shi, J., Malik, J.: Normalized cuts and image segmentation. Pattern Analysis and Machine Intelligence, PAMI 22(8), 888–905 (2000)
Schindler, G., Krishnamurthy, P., Lublinerman, R., Liu, Y., Dellaert, F.: Detecting and matching repeated patterns for automatic geo-tagging in urban environments. In: Computer Vision and Pattern Recognition, CVPR, pp. 1–7 (2008)
Rosten, E., Porter, R., Drummond, T.: Faster and better: a machine learning approach to corner detection. Pattern Analysis and Machine Intelligence, PAMI 32(1), 105–119 (2010)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International journal of computer vision 60(2), 91–110 (2004)
Müller, P., Zeng, G., Wonka, P., Van Gool, L.: Image-based procedural modeling of facades. ACM Transactions on Graphics 26(3), 85 (2007)
Shi, J., Tomasi, C.: Good features to track. In: Computer Vision and Pattern Recognition, CVPR 1994, pp. 593–600 (1994)
Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image and Vision Computing 22(10), 761–767 (2004)
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Ripperda, N.: Grammar based facade reconstruction using rjMCMC. Photogrammetrie Fernerkundung Geoinformation 2, 83 (2008)
Cai, J.-F., Candès, E.J., Shen, Z.: A Singular Value Thresholding Algorithm for Matrix Completion. SIAM J. on Optimization 20(4), 1956–1982 (2010)
Yang, C., Han, T., Quan, L., Tai, C.L.: Parsing Façade with Rank-One Approximation. In: Conference on Computer Vision and Pattern Recognition, pp. 1720–1727 (2012)
Chun, L., Gagalowicz, A.: Image-based Modeling of Haussmannian Facades. The International Journal of Virtual Reality, 13–18 (2010)
Riemenschneider, H., Krispel, U., Thaller, W., Donoser, M., Havemann, S., Fellner, D., Bischof, H.: Irregular lattices for complex shape grammar facade parsing. In: Conference on Computer Vision and Pattern Recognition (2012)
Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics, TOG 23(3), 309–314 (2004)
Descombes, X.: Stochastic Geometry for Image Analysis. Wiley (2011) ISBN 978-1-84821-240-4
Liu, Y., Hel-Or, H., Kaplan, C.S.: Computational symmetry in computer vision and computer graphics, vol. 1. Now Publishers (2010)
Teboul, O., Simon, L., Koutsourakis, P., Paragios, N.: Segmentation of building facades using procedural shape priors. In: Computer Vision and Pattern Recognition, CVPR 2010, pp. 3105–3112 (2010)
Ortner, M., Descombes, X., Zerubia, J.: Building outline extraction from digital elevation models using marked point processes. International Journal of Computer Vision 72(2), 107–132 (2007)
Tyleček, R., Šára, R.: Modeling symmetries for stochastic structural recognition. In: Computer Vision Workshops (ICCV Workshops), pp. 632–639 (2011)
Bokeloh, M., Berner, A., Wand, M., Seidel, H.P., Schilling, A.: Symmetry detection using feature lines. Computer Graphics Forum 28(2), 697–706 (2009)
Fitzgibbon, A.W., Pilu, M., Fisher, R.B.: Direct Least Squares Fitting of Ellipses. IEEE Trans. PAMI 21, 476–480 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Han, T., Liu, C., Tai, C.L., Quan, L. (2013). Quasi-regular Facade Structure Extraction. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7727. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37447-0_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-37447-0_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37446-3
Online ISBN: 978-3-642-37447-0
eBook Packages: Computer ScienceComputer Science (R0)