CV-NP Bayesianism by MCMC

Cross Validated Non Parametric Bayesianism by Markov Chain Monte Carlo
  • Carlos C. Rodriguez
Conference paper
Part of the Fundamental Theories of Physics book series (FTPH, volume 98)


Completely automatic and adaptive non-parametric inference is a pie in the sky. The frequentist approach, best exemplified by the kernel estimators, has excellent asymptotic characteristics but it is very sensitive to the choice of smoothness parameters. On the other hand the Bayesian approach, best exemplified by the mixture of gaussians models, is optimal given the observed data but it is very sensitive to the choice of prior. In 1984 the author proposed to use the Cross-Validated gaussian kernel as the likelihood for the smoothness scale parameter h, and obtained a closed formula for the posterior mean of h based on JefFreys’s rule as the prior. The practical operational characteristics of this bayes’ rule for the smoothness parameter remained unknown for all these years due to the combinatorial complexity of the formula. It is shown in this paper that a version of the metropolis algorithm can be used to approximate the value of h producing remarkably good completely automatic and adaptive kernel estimators. A close study of the form of the cross validated likelihood suggests a modification and a new approach to Bayesian Non-parametrics in general.

Key words

Cross validation Density estimation Bayes method Kernel estimator 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    C. C. Rodriguez, “On the estimation of the bandwidth parameter using a non informative prior,” in Proceedings of the 45th session of the ISI, No. 1, pp. 207–208, International Statistical Institute, August 1985.Google Scholar
  2. 2.
    B. W. Silverman, Density Estimation: for statistics and data analysis, Monographs on Statists and Applied Probability, Chapman and Hall, 1986.zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 1998

Authors and Affiliations

  • Carlos C. Rodriguez
    • 1
  1. 1.Department of Mathematics and StatisticsUniversity at Albany, SUNYAlbanyUSA

Personalised recommendations