Real–Time 3-D Surface Reconstruction from Multiple Cameras

  • Yongchun LiuEmail author
  • Huajun Gong
  • Zhaoxing Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9475)


Recently, by means of the cheap GPUs and appropriate parallel algorithms, it is possible to perform real-time 3-D reconstruction. In this paper, a real-time 3-D surface reconstruction system has been set up to achieve dense geometry reconstruction from multiple cameras. Pose of the cameras are accurately estimated with the help of a self-calibration system. The depth map of the recorded scene is computed by means of a dense multi-view stereo algorithm. Matching cost aggregation and global optimization method are used to obtain the accurate depth values. We merge our works into the Meshlab, where the depth information is used for generating the surface model. High-quality results are finally presented to prove the feasibility of our system and reconstruction algorithms.


Reconstruction Parallel algorithms Depth map Real-time 3-D 



This work is supported by the National High Technology Research and Development Program of China under Grant No. 2012AA011903, and by Postgraduate Research Innovation Projects of Jiangsu Province of China under Grant No. CXLX 13_158.


  1. 1.
    Dellaert, F., et al.: Structure from motion without correspondence. Proc. Comput. Vis. Pattern Recogn. 2, 557–564 (2000)Google Scholar
  2. 2.
    Pollefeys, M., et al.: Detailed real-time urban 3D reconstruction from video. Int. J. Comp. Vision 78(2), 143–167 (2008)CrossRefGoogle Scholar
  3. 3.
    Durrant-Whyte, H., Bailey, T.: Simultaneous localisation and mapping (slam): Part I the essential algorithms. IEEE Rob. Autom. Mag. 13(2), 99–110 (2006)CrossRefGoogle Scholar
  4. 4.
    Klein, G., Murray, D.W.: Parallel tracking and mapping for small AR workspaces. In: Proceedings the International Symposium on Mixed and Augmented Reality (ISMAR), pp. 225–234. IEEE, Nara, Japan (2007)Google Scholar
  5. 5.
    Izadi, S., et al.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings ACM Symposium on User Interface Software and Technology, pp. 559–568. ACM, New York (2011)Google Scholar
  6. 6.
    Stuckler, J., Behnke, S.: Robust real-time registration of RGB-D images using multi-resolution surfel representations. In: Proceedings of the German Conference on Robotics (ROBOTIK), pp. 1–4. VDE, Munich, Germany (2012)Google Scholar
  7. 7.
    Newcombe, R.A., Davison, A.J.: Live dense reconstruction with a single moving camera. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1498–1505. IEEE, San Francisco (2010)Google Scholar
  8. 8.
    Stuehmer, H., Gumhold, S., Cremers D.: Real-time dense geometry from a handheld camera. In: Proceedings of the DAGM Symposium on Pattern Recognition, pp. 11–20. Springer, Heidelberg (2010)Google Scholar
  9. 9.
    Pradeep, V., et al.: MonoFusion: Real-time 3D reconstruction of small scenes with a single web camera. In: Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR), pp. 83–88. IEEE, Adelaide, SA (2013)Google Scholar
  10. 10.
    Zhengyou, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  11. 11.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)CrossRefMathSciNetGoogle Scholar
  12. 12.
    Changchang, W.: Towards linear-time incremental structure from motion. In: Proceedings of the 2013 International Conference on 3D Vision, pp. 127–134 (2013)Google Scholar
  13. 13.
    Cornells, N., Van Gool, L.: Real-time connectivity constrained depth map computation using programmable graphics hardware. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1099–1104 (2005)Google Scholar
  14. 14.
    Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 341–382 (2008)CrossRefGoogle Scholar
  15. 15.
    Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press, New York (2003)Google Scholar
  16. 16.
    Zabin, R., Woodfill, J.: Non-parametric local transforms for computing visual correspondence. In: Proceedings of European Conference on Computer Vision, pp. 151–158 (1994)Google Scholar
  17. 17.
    Richard, A., et at.: DTAM: Dense tracking and mapping in real-time. In: Proceedings of the 2011 International Conference on Computer Vision (ICCV), pp. 2320–2327. IEEE Computer Society, Washington, DC, USA (2011)Google Scholar
  18. 18.
    Chambolle, A., Pock, T.: A first-order primal dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40(1), 120–145 (2011)zbMATHCrossRefMathSciNetGoogle Scholar
  19. 19.
  20. 20.
  21. 21.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.College of Automation EngineeringNanjing University of Aeronautics and AstronauticsNanjingChina
  2. 2.Key Laboratory of Complex System and Intelligence Science, CAS, Institute of AutomationChinese Academy of SciencesBeijingChina

Personalised recommendations