Generating Video Textures by PPCA and Gaussian Process Dynamical Model

  • Wentao Fan
  • Nizar Bouguila
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5856)


Video texture is a new type of medium which can provide a continuous, infinitely varying stream of video images from a recorded video clip. It can be synthesized by rearranging the order of frames based on the similarities between all pairs of frames. In this paper, we propose a new method for generating video textures by implementing probabilistic principal components analysis (PPCA) and Gaussian Process Dynamical model (GPDM). Compared to the original video texture technique, video texture synthesized by PPCA and GPDM has the following advantages: it might generate new video frames that have never existed in the input video clip before; the problem of “dead-end” is totally avoided; it could also provide video textures that are more robust to noise.


Video texture computer graphics computer vision dimensionality reduction autoregressive process Gaussian process PPCA 


  1. 1.
    Schödl, A., Szeliski, R., Salesin, D., Essa, I.: Video textures. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pp. 489–498. ACM Press/Addison-Wesley Publishing Co., New York (2000)CrossRefGoogle Scholar
  2. 2.
    Schödl, A., Essa, I.: Machine learning for video-based rendering. Advances in Neural Information Processing Systems 13, 1002–1008 (2001)Google Scholar
  3. 3.
    Schödl, A., Essa, I.: Controlled animation of video sprites. In: ACM SIGGRAPH Symposium on Computer Animation, pp. 121–128 (2002)Google Scholar
  4. 4.
    Dong, J.Y., Zhang, C.X., Wang, Y.J., Zhou, H.Y.: A video texture synthesis method based on wavelet transform. In: Wavelet Analysis and Pattern Recognition, ICWAPR 2007. International Conference, Beijing, pp. 1177–1181 (2007)Google Scholar
  5. 5.
    Fitzgibbon, A.W.: Stochastic rigidity: image registration for nowhere-static scenes. In: Proceedings of International Conference on Computer Vision (ICCV) 2001, vol. 1, pp. 662–669 (2001)Google Scholar
  6. 6.
    Campbell, N., Dalton, C., Gibson, D., Thomas, B.: Practical generation of video textures using the auto-regressive process. Image and Vision Computing 22, 819–827 (2004)CrossRefGoogle Scholar
  7. 7.
    Rasmussen, C., Williams, C.: Gaussian Processes for Machine Learning. The MIT Press, Cambridge (2006)zbMATHGoogle Scholar
  8. 8.
    MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms. Cambridge University Press, Cambridge (2003)zbMATHGoogle Scholar
  9. 9.
    MacKay, D.J.C.: Introduction to Gaussian processes. Neural Networks and Machine Learning 168, 133–165 (1998)Google Scholar
  10. 10.
    Wang, J.M., Fleet, D.J., Hertzmann, A.: Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 283–298 (2008)Google Scholar
  11. 11.
    Wang, J.M., Fleet, D.J., Hertzmann, A.: Gaussian process dynamical models. In: Advances in Neural Information Processing Systems 18, pp. 1441–1448. MIT Press, Cambridge (2006)Google Scholar
  12. 12.
    Lawrence, N.: Probabilistic non-linear principal component analysis with Gaussian process latent variable models. The Journal of Machine Learning Research 6, 1783–1816 (2005)MathSciNetGoogle Scholar
  13. 13.
    Fan, W., Bouguila, N.: On Video Textures Generation: A comparison Between Different Dimensionality Reduction Techniques. In: IEEE International Conference on System, Man, and Cybernetics (2009)Google Scholar
  14. 14.
    Bishop, C.M.: Probabilistic principal component analysis. Journal of the Royal Statistical Society, Series B 61, 611–622 (1999)zbMATHCrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Wentao Fan
    • 1
  • Nizar Bouguila
    • 1
  1. 1.Institute for Information Systems EngineeringUniversity of ConcordiaMontrealCanada

Personalised recommendations