Abstract
We introduce a novel approach for separating and segmenting individual facades from streetside images. Our algorithm incorporates prior knowledge about arbitrarily shaped repetitive regions which are detected using intensity profile descriptors and a voting–based matcher. In the experiments we compare our approach to extended state–of–the–art matching approaches using more than 600 challenging streetside images, including different building styles and various occlusions. Our algorithm outperforms these approaches and allows to correctly separate 94% of the facades. Pixel–wise comparison to our ground–truth yields a segmentation accuracy of 85%. According to these results our work is an important contribution to fully automatic building reconstruction.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Zebedin, L., Klaus, A., Gruber-Geymayer, B., Karner, K.: Towards 3d map generation from digital aerial images. Journal of Photogrammetry and Remote Sensing 60(6), 413–427 (2006)
Mueller, P., Zeng, G., Wonka, P., Gool, L.V.: Image-based procedural modeling of facades. ACM Transactions on Graphics 26(3) (2007)
Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling. ACM Transactions on Graphics 28(5) (2009)
Lowe, D.G.: Distinctive image features from Scale-Invariant keypoints. International Journal of Computer Vision (IJCV) 60(2), 91–110 (2004)
Shechtman, E., Irani, M.: Matching local Self-Similarities across images and videos. In: Proceedings of CVPR (2007)
Tell, D., Carlsson, S.: Wide baseline point matching using affine invariants computed from intensity profiles. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1842, pp. 814–828. Springer, Heidelberg (2000)
Tell, D., Carlsson, S.: Combining appearance and topology for wide baseline matching. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 68–81. Springer, Heidelberg (2002)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of the Alvey Vision Conference, vol. 15, p. 50 (1988)
Friedman, J.H., Bentley, J.L., Finkel, R.A.: An algorithm for finding best matches in logarithmic expected time. ACM Transactions on Mathematical Software 3(3), 209–226 (1977)
Hernandez, J., Marcotegui, B.: Morphological segmentation of building facade images. In: Proceedings of ICIP, p. 4030 (2009)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient Graph-Based image segmentation. International Journal of Computer Vision (IJCV) 59(2) (2004)
Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 22(8), 888–905 (2000)
Korah, T., Rasmussen, C.: Analysis of building textures for reconstructing partially occluded facades. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 359–372. Springer, Heidelberg (2008)
Barber, C.B., Dobkin, D.P., Huhdanpaa, H.: The quickhull algorithm for convex hulls. ACM Transactions on Mathematical Software 22(4), 469–483 (1996)
Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. International Journal of Computer Vision (IJCV) 74(1), 59–73 (2007)
Rijsbergen, C.J.V.: Information retrieval. Butterworth-Heinemann Newton, MA (1979)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wendel, A., Donoser, M., Bischof, H. (2010). Unsupervised Facade Segmentation Using Repetitive Patterns. In: Goesele, M., Roth, S., Kuijper, A., Schiele, B., Schindler, K. (eds) Pattern Recognition. DAGM 2010. Lecture Notes in Computer Science, vol 6376. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15986-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-15986-2_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15985-5
Online ISBN: 978-3-642-15986-2
eBook Packages: Computer ScienceComputer Science (R0)