Abstract
Bayesian Gaussian processes are known as ‘smoothing devices’ and in the case of n data points they require O(n 2)... O(n 3) number of multiplications in order to perform a regression analysis. In this work we consider one-dimensional regression with Wiener-Lévy (Brownian motion) covariance functions. We indicate that they require only O(n) number of multiplications and show how one can utilize input deformations in order to define a much broader class of efficient covariance functions suitable for discontinuity-preserving filtering. An example of the selective smoothing is presented which shows that regression with Brownian motion filters outperforms or improves nonlinear diffusion filtering especially when observations are contaminated with noise of larger variance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D’Almeida, F.: Nonlinear diffusion toolbox. MATLAB Central
Fang, Q., Tsuchiya, T., Yamamoto, T.: Finite difference, finite element and finite volume methods applied to two-point boundary value problems. Journal of Computational and Applied Mathematics 139, 9–19 (2002)
Gelfand, I.M., Fomin, S.V.: Calculus of Variations. Prentice-Hall, Englewood Cliffs (1963)
Gibbs, M.N.: Bayesian Gaussian Processes for Regression and Classification. Ph.d. thesis, Cambridge University (1997)
Kac, M.: Random walk and the theory of Brownian motion. The American Mathematical Monthly 54(7), 369–391 (1947)
De Nicolao, G., Ferrari-Trecate, G.: Regularization networks: Fast weight calculation via Kalman filtering. IEEE Trans. on Neural Networks Vol. 12(2), 228–235 (2001)
Rasmussen, C.E.: Evaluation of Gaussian Processes and Other Methods for Non-linear Regression. Ph.d. thesis, The University of Toronto (1996)
Shreve, S.E.: Stochastic Calculus for Finance II: Continuous Time Models. Springer, Heidelberg (2000)
Skilling, J.: Bayesian numerical analysis. In: Physics and Probability, pp. 207–221. Cambridge University Press, Cambridge (1993)
Weickert, J., ter Haar Romeny, B.M., Viergever, M.A.: Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans. on Image Processing 7(3), 398–410 (1998)
Yamamoto, T.: Inversion formulas for tridiagonal matrices with applications to boundary value problems. Numer. Funct. Anal. and Optimiz. 22(3 and 4), 357–385 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Girdziušas, R., Laaksonen, J. (2005). Use of Input Deformations with Brownian Motion Filters for Discontinuous Regression. In: Singh, S., Singh, M., Apte, C., Perner, P. (eds) Pattern Recognition and Data Mining. ICAPR 2005. Lecture Notes in Computer Science, vol 3686. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11551188_24
Download citation
DOI: https://doi.org/10.1007/11551188_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28757-5
Online ISBN: 978-3-540-28758-2
eBook Packages: Computer ScienceComputer Science (R0)