Abstract
This paper presents a novel robust and efficient framework to analyze large repetitive structures in urban scenes. A particular contribution of the proposed approach is that it finds the salient boundaries of the repeating elements even when the repetition exists along only one direction. A perspective image is rectified based on vanishing points computed jointly from edges and repeated features detected in the original image by maximizing its overall symmetry. Then a feature-based method is used to extract hypotheses of repetition and symmetry from the rectified image, and initial repetition regions are obtained from the supporting features of each repetition interval. To maximize the local symmetry of each element, their boundaries along the repetition direction are determined from the repetition of local symmetry axes. For any image patch, we define its repetition quality for each repetition interval conditionally with a suppression of integer multiples of repetition intervals. We determine the boundary along the non-repeating direction by finding strong decreases of the repetition quality. Experiments demonstrate the robustness and repeatability of our repetition detection.
Chapter PDF
Similar content being viewed by others
Keywords
- Scale Invariant Feature Transform
- Boundary Detection
- Repetition Interval
- Matching Distance
- Scale Invariant Feature Transform Feature
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: Exploring photo collections in 3d. ACM Transactions on Graphics (SIGGRAPH Proceedings) (2006)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 91–110 (2004)
Ripperda, N., Brenner, C.: Application of a formal grammar to facade reconstruction in semiautomatic and automatic environments. In: Proc. of the 12th AGILE Conference on GIScience (2009)
Wonka, P., Wimmer, M., Sillion, F., Ribarsky, W.: Instant architecture. In: SIGGRAPH 2003 (2003)
Mueller, P., Wonka, P., Haegler, S., Ulmer, A., Gool, L.V.: Procedural modeling of buildings. In: SIGGRAPH 2006 (2006)
Leung, T., Malik, J.: Detecting, localizing and grouping repeated scene elements from an image. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1064, pp. 546–555. Springer, Heidelberg (1996)
Schindler, G., Krishnamurthy, P., Lublinerman, R., Liu, Y., Dellaert, F.: Detecting and matching repeated patterns for automatic geo-tagging in urban environments. In: CVPR. IEEE Computer Society Press, Los Alamitos (2008)
Loy, G., Eklundh, J.O.: Detecting symmetry and symmetric constellations of features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 213–225. Springer, Heidelberg (2006)
Wenzel, S., Drauschke, M., Förstner, W.: Detection of repeated structures in facade images. Pattern Recognition and Image Analysis 18, 406–411 (2008)
Schaffalitzky, F., Zisserman, A.: Geometric grouping of repeated elements within images. In: BMVC 1999 (1999)
Park, M., Collins, R., Liu, Y.: Deformed lattice discovery via efficient mean-shift belief propagation. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 474–485. Springer, Heidelberg (2008)
Liu, Y., Collins, R.T., Tsin, Y.: A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Transactions on PAMI 26, 354–371 (2004)
Korah, T., Rasmussen, C.: 2D lattice extraction from structured environments. In: ICIP 2007, vol. II, pp. 61–64 (2007)
Turina, A., Tuytelaars, T., Van Gool, L.: Efficient grouping under perspective skew. In: CVPR 2001, vol.1, pp. I-247–I-254 (2001)
Mueller, P., Zeng, G., Wonka, P., Gool, L.V.: Image-based procedural modeling of facades. In: Proceedings of ACM SIGGRAPH 2007/ACM Transactions on Graphics, vol. 26. ACM Press, New York (2007)
Tuytelaars, T., Van Gool, L., Proesmans, M., Moons, T.: The cascaded hough transform as an aid in aerial image interpretation. In: Proc. ICCV, pp. 67–72 (1998)
Liu, Y., Collins, R.: Skewed symmetry groups. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 872–879 (2001)
Bay, H., Tuytelaars, T., Van Gool, L.: Surf: Speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Wu, C.: SiftGPU: A GPU implementation of scale invariant feature transform (SIFT) (2007), http://cs.unc.edu/~ccwu/siftgpu
Shao, H., Svoboda, T., Gool, L.V.: ZuBuD — Zürich buildings database for image based recognition. Technical Report 260, Computer Vision Laboratory, Swiss Federal Institute of Technology (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wu, C., Frahm, JM., Pollefeys, M. (2010). Detecting Large Repetitive Structures with Salient Boundaries. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6312. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15552-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-15552-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15551-2
Online ISBN: 978-3-642-15552-9
eBook Packages: Computer ScienceComputer Science (R0)