Penalized Splines, Mixed Models and Bayesian Ideas
The paper describes the link between penalized spline smoothing and Linear Mixed Models and how these two models form a practical and theoretically interesting partnership. As offspring of this partnership one can not only estimate the smoothing parameter in a Maximum Likelihood framework but also utilize the Mixed Model technology to derive numerically handy solutions to more general questions and problems. Two particular examples are discussed in this paper. The first contribution demonstrates penalized splines and Linear Mixed Models in a classification context. Secondly, an even broader framework is pursued, mirroring the Bayesian paradigm combined with simple approximate numerical solutions for model selection.
KeywordsBayesian Information Criterion Bayesian Idea Generalize Additive Model Marginal Likelihood Laplace Approximation
Unable to display preview. Download preview PDF.
- Claeskens, G., Krivobokova, T. & Opsomer, J. (2009). Asymptotic properties of penalized spline estimators. Biometrika, to appear.Google Scholar
- Kauermann, G. & Opsomer, J. (2009). Data-driven selection of the spline dimension in penalized spline regression. Technical Report. Google Scholar
- Kauermann, G., Ormerod, J. & Wand, M. (2009). Parsimonious classification via generalized linear mixed models. Journal of Classification, to appear.Google Scholar
- Li, Y. & Ruppert, D. (2008). On the asymptotics of penalized splines. Biometrika, to appear.Google Scholar
- Ngo, L. & Wand, M. P. (2004). Smoothing with mixed model software. Journal of Statistical Software 9: 1–54.Google Scholar
- Ruppert, D., Wand, M. & Carroll, R. (2009). Semiparametric regression during 2003–2007. Technical Report. Google Scholar
- Zellner, A. (1986). On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti, (eds. P. K. Goel & A. Zellner), pp. 233–243. North-Holland/Elsevier.Google Scholar