Abstract
We describe a novel approach to view interpolation from image sequences based on probabilistic depth carving. This builds a multivalued representation of depth for novel views consisting of likelihoods of depth samples corresponding to either opaque or free space points. The likelihoods are obtained from iterative probabilistic combination of local disparity estimates about a subset of reference frames. This avoids the difficult problem of correspondence matching across distant views and leads to an explicit representation of occlusion. Novel views are generated by combining pixel values from the reference frames based on estimates of surface points within the likelihood representation. Efficient implementation is achieved using a multiresolution framework. Results of experiments on real image sequences show that the technique is effective.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Agrawal, M., Davis, L.S.: A probabilistic framework for surface reconstruction from multiple images. In: Proc. Conf. on Computer Vision and Pattern Recognition (2001)
Avidan, S., Shashua, A.: Novel view synthesis in tensor space. In: Proc. Conf. on Computer Vision and Pattern Recognition (1997)
Azarbayejani, A., Pentland, A.P.: Recursive estimation of motion, structure and focal length. IEEE Trans. on Pattern Analysis and Machine Intelligence 17(6), 562–575 (1995)
Berger, J.O.: Statistical Decision Theory and Bayesian Analysis. Springer, New York (1985)
Bonet, J.S., Viola, P.: Roxels: Responsibility weighted 3d volume reconstruction. In: Proc. Int. Conf. on Computer Vision (1999)
Broadhurst, A., Drummond, T.W., Cipolla, R.: A probabilistic framework for space carving. In: Proc. Int. Conf. on Computer Vision (2001)
Burt, P.J., Adelson, E.H.: The laplacian pyramid as a compact image code. IEEE Transactions on Communications 31(4), 532–540 (1983)
Chang, N.L., Zakhor, A.: Constructing a multivalued representation for view synthesis. Int. Journal of Computer Vision 2(45), 157–190 (2001)
Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proc. ACM SIGGRAPH (1996)
Fitzgibbon, A., Wexler, Y., Zisserman, A.: Image-based rendering using imagebased priors. In: Proc. Int. Conf. on Computer Vision (2003)
Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The lumigraph. In: Proc. ACM SIGGRAPH (1996)
Koch, R., Pollefeys, M., Van Gool, L.: Multi viewpoint stereo from uncalibrated video sequences. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, p. 55. Springer, Heidelberg (1998)
Kutulakos, K.N., Seitz, S.M.: A theory of shape by space carving. Int. Journal of Computer Vision 3(38), 199–218 (2000)
Narayanan, P.J., Rander, P.W., Kanade, T.: Constructing virtual worlds using dense stereo. In: Proc. Int. Conf. on Computer Vision (1998)
Seitz, S., Dyer, C.R.: Physically-valid view synthesis by image interpolation. In: Proc. IEEE Workshop on Representation of Visual Scenes (1995)
Shi, J., Tomasi, C.: Good features to track. In: Proc. Conf. on Computer Vision and Pattern Recognition (1994)
Szeliski, R., Golland, P.: Stereo matching with transparency amd matting. Int. Journal of Computer Vision 32(1), 45–61 (1999)
Yao, A., Calway, A.: Dense 3-d structure from image sequences using probabilistic depth carving. In: Proc. British Machine Vision Conference, pp. 211–220 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yao, A., Calway, A. (2004). Interpolating Novel Views from Image Sequences by Probabilistic Depth Carving. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24671-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-24671-8_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21983-5
Online ISBN: 978-3-540-24671-8
eBook Packages: Springer Book Archive