A bayesian approach to the probability density estimation

  • Makio Ishiguro
  • Yosiyuki Sakamoto


A Bayesian procedure for the probability density estimation is proposed. The procedure is based on the multinomial logit transformations of the parameters of a finely segmented histogram model. The smoothness of the estimated density is guaranteed by the introduction of a prior distribution of the parameters. The estimates of the parameters are defined as the mode of the posterior distribution. The prior distribution has several adjustable parameters (hyper-parameters), whose values are chosen so that ABIC (Akaike's Bayesian Information Criterion) is minimized.

The basic procedure is developed under the assumption that the density is defined on a bounded interval. The handling of the general case where the support of the density function is not necessarily bounded is also discussed. The practical usefulness of the procedure is demonstrated by numerical examples.


BAYESIAN Approach Entropy Maximization Principle Bayesian Procedure Probability Density Estimation Maximum Likelihood Principle 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Ahrens, L. H. (1965). Observations of the Fe−Si−Mg relationship in chondrites,Geochimica et Cosmochimica Acta,29, 801–806.CrossRefGoogle Scholar
  2. [2]
    Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle,2nd International Symposium on Information Theory, (eds. B. N. Petrov and F. Csaki), Akademiai Kiado, Budapest, 267–281.zbMATHGoogle Scholar
  3. [3]
    Akaike, H. (1977). On entropy maximization principle,Applications of Statistics, (ed. Krishnaiah, P. R.), North-Holland, Amsterdam 27–41.zbMATHGoogle Scholar
  4. [4]
    Akaike, H. and Arahata, E. (1978). GALTHY, A probability density estimation,Computer Science Monographs, No. 9, The Institute of Statistical Mathematics, Tokyo.Google Scholar
  5. [5]
    Akaike, H. (1980). Likelihood and Bayes procedure,Bayesian Statistics, (eds. J. M. Bernardo, M. H. De Groot, D. U. Lindley and A. F. M. Smith), University Press, Valencia, Spain.zbMATHGoogle Scholar
  6. [6]
    Boneva, L. I., Kendall, D. G. and Stefanov, I. (1971). Spline transformations: three new diagnostic aids for the statistical data-analyst,J. R. Statist. Soc., B,33, 1–71.MathSciNetzbMATHGoogle Scholar
  7. [7]
    Burch, C. R. and Parsons, I. T. (1976). Squeeze significance tests,Applied Statistics,25, 287–291.CrossRefGoogle Scholar
  8. [8]
    Good, I. J. and Gaskins, R. A. (1971). Nonparametric roughness penalties for probability densities,Biometrika,58, 255–277.MathSciNetCrossRefGoogle Scholar
  9. [9]
    Good, I. J. and Gaskins, R. A. (1980). Density estimation and bump-hunting by the penalized likelihood method exemplified by scattering and meteorite data,J. Amer. Statist. Ass.,75, 42–56.MathSciNetCrossRefGoogle Scholar
  10. [10]
    Ishiguro, M. and Sakamoto, Y. (1983). A Bayesian approach to binary response curve estimation,Ann. Inst. Statist. Math., B,35, 115–137.CrossRefGoogle Scholar
  11. [11]
    Leonard, Tom (1978). Density estimation, stochastic processes, and prior information,J. R. Statist. Soc., B,40, 113–146.MathSciNetzbMATHGoogle Scholar
  12. [12]
    Maguire, B. A., Pearson, E. S. and Wynn, A. H. A. (1952). The time intervals between industrials accidents,Biometrika,39, 168–180.CrossRefGoogle Scholar
  13. [13]
    Parzen, E. (1962). On estimation of a probability density and mode,Ann. Math. Statist.,33, 1065–1076.MathSciNetCrossRefGoogle Scholar
  14. [14]
    Rosenblatt, M. (1956). Remarks on some non-parametric estimates of a density function,Ann. Math. Statist.,27, 832–837.MathSciNetCrossRefGoogle Scholar
  15. [15]
    Whittle, P. (1958). On the smoothing of probability density functions,J. R. Statist. Soc., B,20, 334–343.MathSciNetzbMATHGoogle Scholar

Copyright information

© The Institute of Statistical Mathematics, Tokyo 1984

Authors and Affiliations

  • Makio Ishiguro
  • Yosiyuki Sakamoto

There are no affiliations available

Personalised recommendations