Abstract
Entire shape reconstruction of dynamic objects is an important research subject with applications on film production, virtual reality, modeling and engineering. Typically, entire shape reconstruction of real objects is achieved by combining the outcome of objects scanned from multiple directions. However, due to limitations on the number of 3D sensors enclosing the scene, occlusions inevitably occur, causing holes to appear on the reconstructed surfaces. These issues are intensified if dynamic, moving objects are considered. Volumetric and polygonal approaches exist to address these problems. Most notably, exemplar-based polygonal methods have gained momentum due to their overall improved visual quality. In this paper we propose an extension to the plain exemplar-based technique that allows for multiple dynamic objects. With our method, adequate hole-filling candidates are sampled from spatial and temporal domains and then used to synthesize likely plausible surfaces with smooth boundaries for the hole regions.
Chapter PDF
Similar content being viewed by others
References
Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points. In: ACM SIGGRAPH, pp. 71–78. ACM Press (1992)
Whitaker, R.T.: A level-set approach to 3d reconstruction from range data. IJCV 29(3), 203–231 (1998)
Turk, G., Levoy, M.: Zippered polygon meshes from range images. In: SIGGRAPH 1994, pp. 311–318. ACM Press (1994)
Curless, B., Levoy, M.: A volumetric method for building complex models from range images. Computer Graphics 30(Annual Conference Series), 303–312 (1996)
Masuda, T.: Registration and integration of multiple range images by matching signed distance fields for object shape modeling. CVIU 87(1-3), 51–65 (2002)
Sagawa, R., Nishino, K., Ikeuchi, K.: Adaptively merging large-scale range data with reflectance properties. IEEE Trans. on PAMI 27(3), 392–405 (2005)
Furukawa, R., Itano, T., Morisaka, A., Kawasaki, H.: Shape-merging and interpolation using class estimation for unseen voxels with a gpu-based efficient implementation. In: IEEE The 6th International Conference on 3-D Digital Imaging and Modeling, pp. 289–296 (2007)
Furukawa, R., Itano, T., Morisaka, A., Kawasaki, H.: Improved space carving method for merging and interpolating multiple range images using information of light sources of active stereo. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part II. LNCS, vol. 4844, pp. 206–216. Springer, Heidelberg (2007)
Lorensen, W.E., Cline, H.E.: Marching cubes: A high resolution 3d surface construction algorithm. In: SIGGRAPH 1987, pp. 163–169. ACM Press, New York (1987)
Bolitho, M., Kazhdan, M., Burns, R., Hoppe, H.: Parallel poisson surface reconstruction. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Kuno, Y., Wang, J., Wang, J.-X., Wang, J., Pajarola, R., Lindstrom, P., Hinkenjann, A., Encarnação, M.L., Silva, C.T., Coming, D. (eds.) ISVC 2009, Part I. LNCS, vol. 5875, pp. 678–689. Springer, Heidelberg (2009)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, SGP 2006, pp. 61–70. Eurographics Association, Aire-la-Ville (2006)
Kawai, N., Sato, T., Yokoya, N.: Efficient surface completion using principal curvature and its evaluation. In: ICIP, pp. 521–524 (2009)
Kawai, N., Sato, T., Yokoya, N.: Surface completion by minimizing energy based on similarity of shape. In: ICIP, pp. 1532–1535 (2008)
Kawai, N., Zakhor, A., Sato, T., Yokoya, N.: Surface completion of shape and texture based on energy minimization. In: ICIP, pp. 897–900 (2011)
Zhao, K.H., Osher, S., Fedkiw, R.: Fast surface reconstruction using the level set method. In: First IEEE Workshop on Variational and Level Set Methods, pp. 194–202 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pagliardini, M., Akagi, Y., Slomp, M., Furukawa, R., Sagawa, R., Kawasaki, H. (2014). Exemplar-Based Hole-Filling Technique for Multiple Dynamic Objects. In: Klette, R., Rivera, M., Satoh, S. (eds) Image and Video Technology. PSIVT 2013. Lecture Notes in Computer Science, vol 8333. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-53842-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-53842-1_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-53841-4
Online ISBN: 978-3-642-53842-1
eBook Packages: Computer ScienceComputer Science (R0)