Abstract
In this paper we present a method for dense 3D reconstruction from videos where object silhouettes are hard to retrieve. We introduce a close coupling between sparse bundle adjustment and dense multi-view reconstruction, which includes surface constraints by the sparse point cloud and an implicit loop closing via the dense surface. The surface is computed in a volumetric framework and guarantees a dense surface without holes. We demonstrate the flexibility of the approach on indoor and outdoor scenes recorded with a commodity hand-held camera.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aubry, M., Kolev, K., Goldluecke, B., Cremers, D.: Decoupling photometry and geometry in dense variational camera calibration. In: Proc. ICCV (2011)
Bresson, X., Esedoglu, S., Vandergheynst, P., Thiran, J.P., Osher, S.: Fast global minimization of the active Contour/Snake model. Journal of Mathematical Imaging and Vision 28(2), 151–167 (2007)
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High Accuracy Optical Flow Estimation Based on a Theory for Warping. In: Pajdla, T., Matas, J. (eds.) ECCV 2004, Part IV. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)
Frahm, J.-M., Fite-Georgel, P., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.-H., Dunn, E., Clipp, B., Lazebnik, S., Pollefeys, M.: Building Rome on a Cloudless Day. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 368–381. Springer, Heidelberg (2010)
Furukawa, Y., Ponce, J.: Accurate camera calibration from multi-view stereo and bundle adjustment. In: Proc. CVPR (2008)
Goesele, M., Snavely, N., Curless, B., Hoppe, H., Seitz, S.M.: Multi-View stereo for community photo collections. In: Proc. ICCV, pp. 1–8 (2007)
Graber, G., Pock, T., Bischof, H.: Online 3d reconstruction using convex optimization. In: Computer Vision Workshops (ICCV Workshops). IEEE (2011)
Hernández, C., Schmitt, F.: Silhouette and stereo fusion for 3d object modeling. Computer Vision and Image Understanding 96(3), 367–392 (2004)
Hiep, V.H., Keriven, R., Labatut, P., Pons, J.P.: Towards high-resolution large-scale multi-view stereo. In: Proc. CVPR (2009)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Symposium on Geometry Processing. Eurographics Association (2006)
Kolev, K., Klodt, M., Brox, T., Cremers, D.: Continuous global optimization in multiview 3d reconstruction. Int. Journal of Computer Vision 84(1), 80–96 (2009)
Lempitsky, V., Boykov, Y.: Global optimization for shape fitting. In: Proc. CVPR (2007)
Lu, C.P., Hager, G.D., Mjolsness, E.: Fast and globally convergent pose estimation from video images. IEEE Trans. Pattern Anal. Mach. Intell. 22(6), 610–622 (2000)
Newcombe, R., Lovegrove, S., Davison, A.: DTAM: Dense tracking and mapping in Real-Time. In: Proc. ICCV (2011)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of Multi-View stereo reconstruction algorithms. In: Proc. CVPR (2006)
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. ACM Transactions on Graphics (TOG) 25, 835–846 (2006)
Steinbruecker, F., Pock, T., Cremers, D.: Large displacement optical flow computation without warping. In: Proc. ICCV (2009)
Sundaram, N., Brox, T., Keutzer, K.: Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 438–451. Springer, Heidelberg (2010)
Weickert, J.: Anisotropic diffusion in image processing. B.G. Teubner (1998)
Wu, C., Agarwal, S., Curless, B., Seitz, S.: Multicore bundle adjustment. In: Proc. CVPR (2011)
Yezzi, A.J., Soatto, S.: Structure from motion for scenes without features. In: Proc. CVPR (2003)
Zach, C., Pock, T., Bischof, H.: A Duality Based Approach for Realtime TV-L 1 Optical Flow. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 214–223. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ummenhofer, B., Brox, T. (2012). Dense 3D Reconstruction with a Hand-Held Camera. In: Pinz, A., Pock, T., Bischof, H., Leberl, F. (eds) Pattern Recognition. DAGM/OAGM 2012. Lecture Notes in Computer Science, vol 7476. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32717-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-32717-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32716-2
Online ISBN: 978-3-642-32717-9
eBook Packages: Computer ScienceComputer Science (R0)