Abstract
We propose a framework to automatically build 3D models for scenes containing structures not amenable for photo-consistency based reconstruction due to having dynamic appearance. We analyze the dynamic appearance elements of a given scene by leveraging the imagery contained in Internet image photo-collections and online video sharing websites. Our approach combines large scale crowd sourced SfM techniques with image content segmentation and shape from silhouette techniques to build an iterative framework for 3D shape estimation. The developed system not only enables more complete and robust 3D modeling, but it also enables more realistic visualizations through the identification of dynamic scene elements amenable to dynamic texture mapping. Experiments on crowd sourced image and video datasets illustrate the effectiveness of our automated data-driven approach.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Ballan, L., Brostow, G., Puwein, J., Pollefeys, M.: Unstructured video-based rendering: Interactive exploration of casually captured videos. ACM Transactions on Graphics (2010)
Baumgart, B.: Geometric modeling for computer vision. Ph. D. Thesis (Tech. Report AIM-249), Stanford University (1974)
Bonet, J.S.D., Viola, P.A.: Roxels: Responsibility weighted 3D volume reconstruction. In: Proceedings of ICCV, vol. 1, p. 418 (1999)
Fitzgibbon, A.W.: Stochastic rigidity: Image registration for nowhere-static scenes. In: Proceedings of ICCV, p. 662 (2001)
Franco, J.-S., Boyer, E.: Fusion of multi-view silhouette cues using a space occupancy grid. In: Proceedings of ICCV, vol. 2, p. 1747 (2005)
Furukawa, Y., Ponce, J.: Carved visual hulls for image-based modeling. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 564–577. Springer, Heidelberg (2006)
Furukawa, Y., Ponce, J.: Towards internet-scale multi-view stereo. In: Proceedings of CVPR, p. 1434 (2010)
Guan, L., Franco, J.S., Pollefey, M.: Multi-object shape estimation and tracking from silhouette cues. In: Proceedings of CVPR (2008)
Hasler, N., Rosenhahn, B., Thormahlen, T., Wand, M., Gall, J., Seidel, H.: Markerless motion capture with unsynchronized moving cameras. In: Proceedings of CVPR, p. 224 (2009)
Jancosek, M., Pajdla, T.: Multi-view reconstruction preserving weakly-supported surfaces. In: Proceedings of CVPR, p. 3121 (2011)
Jiang, H., Liu, H., Tan, P., Zhang, G., Bao, H.: 3D reconstruction of dynamic scenes with multiple handheld cameras. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 601–615. Springer, Heidelberg (2012)
Kim, H., Sarim, M., Takai, T., Guillemaut, J., Hilton, A.: Dynamic 3D scene reconstruction in outdoor environments. In: Proceedings of 3DPVT (2010)
Labatut, P., Pons, J., Keriven, R.: Efficient multi-view reconstruction of large-scale scenes using interest points, delaunay triangulation and graph cuts. In: Proceedings of ICCV, p. 1 (2007)
Labatut, P., Pons, J., Keriven, R.: Robust and efficient surface reconstruction from range data. Computer Graphics Forum 28, 2275 (2009)
Laurentini, A.: The visual hull concept for silhouette-based image understanding. IEEE Trans. on Pattern Analysis and Machine Intelligence 16(2), 150 (1994)
Nelson, R., Polana, R.: Qualitative recognition of motion using temporal texture. CVGIP: Image Understanding 56, 78 (1992)
Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Sys., Man., Cyber. 9(1), 62 (1979)
Rother, C., Kolmogorov, V., Blake, A.: Grabcut – interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics 23(3), 309 (2004)
Sinha, S.N., Pollefeys, M.: Multi-view reconstruction using photo-consistency and exact silhouette constraints: A maximum-flow formulation. In: Proceedings of ICCV (2005)
Soatto, S., Doretto, G., Wu, Y.N.: Dynamic textures. In: Proceedings of ICCV, p. 439 (2001)
Taneja, A., Ballan, L., Pollefeys, M.: Modeling dynamic scenes recorded with freely moving cameras. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part III. LNCS, vol. 6494, pp. 613–626. Springer, Heidelberg (2011)
Vidal, R., Ravich, A.: Optical flow estimation and segmentation of multiple moving dynamic textures. In: Proceedings of CVPR, p. 516 (2005)
Vu, H., Keriven, R., Labatut, P., Pons, J.P.: Towards highresolution large-scale multi-view stereo. In: Proceedings of CVPR, p. 1430 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ji, D., Dunn, E., Frahm, JM. (2014). 3D Reconstruction of Dynamic Textures in Crowd Sourced Data. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8689. Springer, Cham. https://doi.org/10.1007/978-3-319-10590-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-10590-1_10
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10589-5
Online ISBN: 978-3-319-10590-1
eBook Packages: Computer ScienceComputer Science (R0)