Depth Map Based Facade Abstraction from Noisy Multi-View Stereo Point Clouds

  • Andreas LeyEmail author
  • Olaf Hellwich
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9796)


Multi-View Stereo offers an affordable and flexible method for the acquisition of 3D point clouds. However, these point clouds are prone to errors and missing regions. In addition, an abstraction in the form of a simple mesh capturing the essence of the surface is usually preferred over the raw point cloud measurement. We present a fully automatic pipeline that computes such a mesh from the noisy point cloud of a building facade. We leverage prior work on casting the computation of a 2.5D depth map as a labeling problem and show that this formulation has great potential as an intermediate representation in the context of building facade reconstruction.


Point Cloud Input Image Markov Random Field Shape Grammar Smoothness Term 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This paper was supported by a grant (HE 2459/21-1) from the Deutsche Forschungsgemeinschaft (DFG).

Supplementary material

419026_1_En_13_MOESM1_ESM.pdf (1.1 mb)
Supplementary material 1 (pdf 1141 KB)


  1. 1.
  2. 2.
    Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)CrossRefGoogle Scholar
  3. 3.
    Chauve, A.L., Labatut, P., Pons, J.P.: Robust piecewise-planar 3D reconstruction and completion from large-scale unstructured point data. In: Proceedings of CVPR, pp. 1261–1268 (2010)Google Scholar
  4. 4.
    Cohen-Steiner, D., Alliez, P., Desbrun, M.: Variational shape approximation. In: Proceedings of ACM SIGGRAPH 2004 Papers, pp. 905–914 (2004)Google Scholar
  5. 5.
    Cornelis, N., Leibe, B., Cornelis, K., Gool, L.: 3D urban scene modeling integrating recognition and reconstruction. Int. J. Comput. Vis. 78(2), 121–141 (2007)Google Scholar
  6. 6.
    Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Manhattan-world stereo. In: Proceedings of CVPR, pp. 1422–1429 (2009)Google Scholar
  7. 7.
    Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Reconstructing building interiors from images. In: Proceedings of ICCV, pp. 80–87 (2009)Google Scholar
  8. 8.
    Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2010)CrossRefGoogle Scholar
  9. 9.
    von Gioi, R.G., Jakubowicz, J., Morel, J.M., Randall, G.: LSD: a Line Segment Detector. Image Process. On Line 2, 35–55 (2012)CrossRefGoogle Scholar
  10. 10.
    Ikehata, S., Yang, H., Furukawa, Y.: Structured indoor modeling. In: Proceedings of ICCV, pp. 1323–1331 (2015)Google Scholar
  11. 11.
    Isack, H., Boykov, Y.: Energy-based geometric multi-model fitting. Int. J. Comput. Vis. 97, 123–147 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Krähenbühl, P., Koltun, V.: Efficient inference in fully connected CRFS with Gaussian edge potentials. In: Shawe-Taylor, J., Zemel, R.S., Bartlett, P.L., Pereira, F., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 24, pp. 109–117. Curran Associates Inc. (2011)Google Scholar
  13. 13.
    Martinovic, A., Knopp, J., Riemenschneider, H., Van Gool, L.: 3D all the way: semantic segmentation of urban scenes from start to end in 3D. In: Proceedings of CVPR, pp. 4456–4465 (2015)Google Scholar
  14. 14.
    Sinha, S.N., Steedly, D., Szeliski, R.: Piecewise planar stereo for image-based rendering. In: Proceedings of ICCV, pp. 1881–1888 (2009)Google Scholar
  15. 15.
    Strecha, C., von Hansen, W., Gool, L.J.V., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: Proceedings of CVPR (2008)Google Scholar
  16. 16.
    Teboul, O., Kokkinos, I., Simon, L., Koutsourakis, P., Paragios, N.: Parsing facades with shape grammars and reinforcement learning. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1744–1756 (2013)CrossRefGoogle Scholar
  17. 17.
    Waechter, M., Moehrle, N., Goesele, M.: Let there be color! Large-scale texturing of 3D reconstructions. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part V. LNCS, vol. 8693, pp. 836–850. Springer, Heidelberg (2014)Google Scholar
  18. 18.
    Werner, T., Zisserman, A.: Model selection for automated architectural reconstruction from multiple views. In: Proceedings of the British Machine Vision Conference, pp. 53–62 (2002)Google Scholar
  19. 19.
    Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling. In: ACM SIGGRAPH Asia 2009 Papers, pp. 114:1–114:12 (2009)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Computer Vision and Remote Sensing GroupTU BerlinBerlinGermany

Personalised recommendations