Correcting for Duplicate Scene Structure in Sparse 3D Reconstruction

  • Jared Heinly
  • Enrique Dunn
  • Jan-Michael Frahm
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8692)


Structure from motion (SfM) is a common technique to recover 3D geometry and camera poses from sets of images of a common scene. In many urban environments, however, there are symmetric, repetitive, or duplicate structures that pose challenges for SfM pipelines. The result of these ambiguous structures is incorrectly placed cameras and points within the reconstruction. In this paper, we present a post-processing method that can not only detect these errors, but successfully resolve them. Our novel approach proposes the strong and informative measure of conflicting observations, and we demonstrate that it is robust to a large variety of scenes.


Structure from motion duplicate structure disambiguation 


  1. 1.
    Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC Superpixels Compared to State-of-the-Art Superpixel Methods. TPAMI 34(11) (2012)Google Scholar
  2. 2.
    Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S., Szeliski, R.: Building Rome in a Day. Comm. ACM (2011)Google Scholar
  3. 3.
    Bansal, M., Daniilidis, K., Sawhney, H.: Ultra-wide baseline facade matching for geo-localization. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part I. LNCS, vol. 7583, pp. 175–186. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  4. 4.
    Cao, S., Snavely, N.: Graph-based discriminative learning for location recognition. In: CVPR (2013)Google Scholar
  5. 5.
    Cho, M., Lee, K.M.: Bilateral Symmetry Detection via Symmetry-Growing. In: BMVC (2009)Google Scholar
  6. 6.
    Cho, M., Shin, Y.M., Lee, K.M.: Unsupervised Detection and Segmentation of Identical Objects. In: CVPR (2010)Google Scholar
  7. 7.
    Chum, O., Mikulík, A., Perdoch, M., Matas, J.: Total recall II: Query expansion revisited. In: CVPR (2011)Google Scholar
  8. 8.
    Cohen, A., Zach, C., Sinha, S.N., Pollefeys, M.: Discovering and Exploiting 3D Symmetries in Structure from Motion. In: CVPR (2012)Google Scholar
  9. 9.
    Crandall, D., Owens, A., Snavely, N., Huttenlocher, D.: Discrete-Continuous Optimization for Large-Scale Structure from Motion. In: CVPR (2011)Google Scholar
  10. 10.
    Dellaert, F., Seitz, S., Thorpe, C., Thrun, S.: Structure from Motion without Correspondence. In: CVPR (2000)Google Scholar
  11. 11.
    Frahm, J.-M., et al.: Building rome on a cloudless day. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 368–381. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  12. 12.
    Jiang, N., Tan, P., Cheong, L.F.: Seeing Double Without Confusion: Structure-from-Motion in Highly Ambiguous Scenes. In: CVPR (2012)Google Scholar
  13. 13.
    Jiang, N., Tan, P., Cheong, L.: Multi-view Repetitive Structure Detection. In: ICCV (2011)Google Scholar
  14. 14.
    Köser, K., Zach, C., Pollefeys, M.: Dense 3D Reconstruction of Symmetric Scenes from a Single Image. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 266–275. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  15. 15.
    Lee, S., Liu, Y.: Curved Glide-Reflection Symmetry Detection. TPAMI 34(2) (2012)Google Scholar
  16. 16.
    Liu, J., Liu, Y.: GRASP Recurring Patterns from a Single View. In: CVPR (2013)Google Scholar
  17. 17.
    Liu, Y., Hel-Or, H., Kaplan, C.S., Gool, L.V.: Computational Symmetry in Computer Vision and Computer Graphics. Foundations and Trends in Computer Graphics and Vision 5(1-2) (2010)Google Scholar
  18. 18.
    Lou, Y., Snavely, N., Gehrke, J.: Matchminer: Efficiently mining spanning structures in large image collections. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 45–58. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  19. 19.
    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. TPAMI 27(10) (2005)Google Scholar
  20. 20.
    Raguram, R., Tighe, J., Frahm, J.: Improved geometric verification for large scale landmark image collections. In: BMVC (2012)Google Scholar
  21. 21.
    Roberts, R., Sinha, S.N., Szeliski, R., Steedly, D.: Structure from motion for scenes with large duplicate structures. In: CVPR (2011)Google Scholar
  22. 22.
    Schindler, G., Krishnamurthy, P., Lublinerman, R., Liu, Y., Dellaert, F.: Detecting and Matching Repeated Patterns for Automatic Geo-tagging in Urban Environments. In: CVPR (2008)Google Scholar
  23. 23.
    Sinha, S.N., Ramnath, K., Szeliski, R.: Detecting and Reconstructing 3D Mirror Symmetric Objects. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 586–600. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  24. 24.
    Snavely, N., Seitz, S., Szeliski, R.: Photo Tourism: Exploring image collections in 3D. In: SIGGRAPH (2006)Google Scholar
  25. 25.
    Torii, A., Sivic, J., Pajdla, T., Okutomi, M.: Visual Place Recognition with Repetitive Structures. In: CVPR (2013)Google Scholar
  26. 26.
    Wilson, K., Snavely, N.: Network principles for sfm: Disambiguating repeated structures with local context. In: ICCV (2013)Google Scholar
  27. 27.
    Wu, C.: VisualSFM: A Visual Structure from Motion System (2011),
  28. 28.
    Wu, C., Frahm, J., Pollefeys, M.: Repetition-based Dense Single-View Reconstruction. In: CVPR (2011)Google Scholar
  29. 29.
    Zach, C., Irschara, A., Bischof, H.: What Can Missing Correspondences Tell Us About 3D Structure and Motion. In: CVPR (2008)Google Scholar
  30. 30.
    Zach, C., Klopschitz, M., Pollefeys, M.: Disambiguating Visual Relations Using Loop Constraints. In: CVPR (2010)Google Scholar
  31. 31.
    Zhao, P., Quan, L.: Translation Symmetry Detection in a Fronto-Parallel View. In: CVPR (2011)Google Scholar
  32. 32.
    Zhao, P., Yang, L., Zhang, H., Quan, L.: Per-Pixel Translational Symmetry Detection, Optimization, and Segmentation. In: CVPR (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Jared Heinly
    • 1
  • Enrique Dunn
    • 1
  • Jan-Michael Frahm
    • 1
  1. 1.The University of North Carolina at Chapel HillUSA

Personalised recommendations