Streaming-Data Selection for Gaussian-Process Modelling
- 1.3k Downloads
The Gaussian-process (GP) model is an example of a probabilistic, non-parametric model with uncertainty predictions. It can be used for the modelling of complex, non-linear systems and also for the identification of dynamic systems. The output of the GP model is a normal distribution, expressed in terms of the mean and the variance. One of the noticeable drawbacks of a system identification with GP models is the computation time necessary for the modelling. The modelling procedure involves the inverse of the covariance matrix, which has the dimension as large as the length of the input samples vector. The computation time for this inverse, regardless of the use of an efficient algorithm, is increasing with the third power of the number of input data. In this chapter we propose a method for the sequential selection of streaming data so that the size of the active set remains constrained. Furthermore, for better adjustment of the model to the system the hyperparameter values are optimised as well. The viability of the proposed method is tested on data obtained from two, nonlinear, dynamic systems.
KeywordsCovariance Function Gaussian Process Real Output Streaming Data Relevance Vector Machine
Unable to display preview. Download preview PDF.
- 3.Quiñonero Candela, J., Rasmussen, C.E., Williams, C.K.I.: Approximation Methods for Gaussian Process Regression. Tech. rep., Microsoft Research (2007)Google Scholar
- 5.Deisenroth, M.P.: Efficient Reinforcement Learning using Gaussian Processes. PhD thesis, Karlsruhe Institute of Technology (2010)Google Scholar
- 6.Kocijan, J.: Gaussian process models for systems identification. In: Proc. 9th Int. PhD Workshop on Systems and Control: Young Generation Viewpoint, Izola, Slovenia (2008)Google Scholar
- 11.Rassmusen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press (2006)Google Scholar
- 12.Seeger, M., Williams, C.K.I., Lawrence, N.D.: Fast Forward Selection to Speed Up Sparse Gaussian Process Regression. In: 9th Int. Workshop on Artificial Intelligence and Statistics. Society for Artificial Intelligence and Statistics (2003)Google Scholar