Advertisement

TGV-Fusion

  • Thomas Pock
  • Lukas Zebedin
  • Horst Bischof
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6570)

Abstract

Location awareness on the Internet and 3D models of our habitat (as produced by Microsoft (Bing) or Google (Google Earth)) are a major driving force for creating 3D models from image data. A key factor for these models are highly accurate and fully automated stereo matching pipelines producing highly accurate 3D point clouds that are possible due to the fact that we can produce images with high redundancy (i.e., a single point is projected in many images). Especially this high redundancy makes fully automatic processing pipelines possible. Highly overlapping images yield also highly redundant range images. This paper proposes a novel method to fuse these range images. The proposed method is based on the recently introduced total generalized variation method (TGV). The second order variant of this functional is ideally suited for piece-wise affine surfaces and therefore an ideal case for buildings which can be well approximated by piece-wise planar surfaces. In this paper we first present the functional consisting of a robust data term based on the Huber-L 1 norm and the TGV regularization term. We derive a numerical algorithm based on a primal dual formulation that can be efficiently implemented on the GPU. We present experimental results on synthetic data as well as on a city scale data set, where we compare the method to other methods.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Leberl, F., Bischof, H., Pock, T., Irschara, A., Kluckner, S.: Aerial computer vision for a 3d virtual habitat. Computer 43, 24–31 (2010)CrossRefGoogle Scholar
  2. 2.
    Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., Szeliski, R.: Building rome in a day. In: International Conference on Computer Vision, ICCV (2009)Google Scholar
  3. 3.
    Zach, C., Pock, T., Bischof, H.: A globally optimal algorithm for robust TV-L 1 range image integration. In: Proceedings of the 11th International Conference Computer Vision, Rio de Janeiro, Brazil, pp. 1–8 (2007)Google Scholar
  4. 4.
    Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: Proceedings of SIGGRAPH 1996, pp. 303–312 (1996)Google Scholar
  5. 5.
    Tikhonov, A.N.: On the stability of inverse problems. Dokl. Akad. Nauk SSSR 5, 195–198 (1943)Google Scholar
  6. 6.
    Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Nikolova, M.: A variational approach to remove outliers and impulse noise. J. Math. Imaging and Vision 20, 99–120 (2004)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Bredies, K., Kunisch, K., Pock, T.: Total generalized variation. Technical report, Institute for Computer Graphics and Vision (2010)Google Scholar
  9. 9.
    Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Aujol, J.F., Gilboa, G., Chan, T., Osher, S.: Structure-texture image decomposition–modeling, algorithms, and parameter selection. Int. J. Comp. Vision 67, 111–136 (2006)CrossRefzbMATHGoogle Scholar
  11. 11.
    Chan, T., Esedoglu, S.: Aspects of total variation regularized L 1 function approximation. SIAM J. Appl. Math. 65, 1817–1837 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Chan, T., Esedoglu, S., Park, F., Yip, A.: Total Variation Image Restoration: Overview and Recent Developments. In: Mathematical Models in Computer Vision. Springer, Heidelberg (2005)Google Scholar
  13. 13.
    Huber, P.: Robust Statistics. Wiley, New York (1981)CrossRefzbMATHGoogle Scholar
  14. 14.
    Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging (2010), http://hal.archives-ouvertes.fr/hal-00490826
  15. 15.
    Hirschmüller, H.: Stereo vision in structured environments by consistent semi-global matching. In: Conference on Computer Vision and Pattern Recognition, pp. 328–341 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Thomas Pock
    • 1
  • Lukas Zebedin
    • 2
  • Horst Bischof
    • 1
  1. 1.Inst. for Computer Graphics and VisionGraz University of TechnologyAustria
  2. 2.Microsoft PhotogrammetryAustria

Personalised recommendations