Abstract
Bayesian models involving Dirichlet process mixtures are at the heart of the modern nonparametric Bayesian movement. Much of the rapid development of these models in the last decade has been a direct result of advances in simulation-based computational methods. Some of the very early work in this area, circa 1988-1991, focused on the use of such nonparametric ideas and models in applications of otherwise standard hierarchical models. This chapter provides some historical review and perspective on these developments, with a prime focus on the use and integration of such nonparametric ideas in hierarchical models. We illustrate the ease with which the strict parametric assumptions common to most standard Bayesian hierarchical models can be relaxed to incorporate uncertainties about functional forms using Dirichlet process components, partly enabled by the approach to computation using MCMC methods. The resulting methodology is illustrated with two examples taken from an unpublished 1992 report on the topic.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Andrews, D.F. and Mallows, C.L. (1974), “Scale mixtures of normal distributions,”Journal of the Royal Statistical Society Series B36, 99–102.
Antoniak, C.E. (1974), “Mixtures of Dirichlet processes with applications to nonparametric problems,”The Annals of Statistics2, 1152–1174.
Blackwell, D., and MacQueen, J.B. (1973), “Ferguson Distribution via Polya Urn Schemes,”The Annals of Statistics1, 353–355.
Brunner, L.J. (1995), “ Bayesian linear regression with error terms that have symmetric unimodal densities,”Journal of Nonparametric Statistics4, 335–348.
Bush, C.A. and MacEachern, S.N. (1996), “A semi-parametric Bayesian model for randomized block designs,”Biometrika83, 275–285.
Carlin, B.P., and Poison, N.G. (1991), “An expected utility approach to influence diagnostics,”Journal OftheAmericanStatisticalAssociation, 86, 1013–1021.
Doss, H. (1994), `Bayesian nonparametric estimation for incomplete data via successive substitution sampling,“The Annals of Statistics22, 1763–1786.
Erkanli, A., Stangl, D., and Müller, P. (1993), “Analysis of ordinal data by the mixture of probit links,”Discussion Paper #93-A01ISDS, Duke University.
Escobar, M.D. (1988), Estimating the means of several normal populations by nonparametric estimation of the distribution of the means, Unpublished dissertation, Yale University.
Escobar, M.D. (1992), Invited comment of “Bayesian analysis of mixtures: sonne results on exact estimability and identification,” by Florens, Mouchart, and Rolin.Bayesian Statistics 4(eds: J.M. Bernardo, J.O. Berger, A.P. Dawid and A.F.M. Smith). Oxford: University press, 142–144.
Escobar, M.D. (1994), “Estimating normal means with a Dirichlet process prior,”Journal of the American Statistical Association89, 268–277.
Escobar, M.D., (1995), “Nonparametrics Bayesian Methods in Hierarchical Models,”The Journal of Statistical Inference and Planning43, 97106.
Escobar, M.D. (1998), “The effect of the prior on nonparametric Bayesian methods,” (in preparation).
Escobar, M.D. and West, M. (1995), “Bayesian density estimation and inference using mixtures,”Journal of the American Statistical Association90, 577–588.
Evans, M. and Swartz, T. (1995) “Methods for approximating integrals in statistics with special emphasis on Bayesian integration problems - with discussion,”Statistical Science10, 254–272.
Ferguson, T.S. (1973), “A Bayesian analysis of some nonparametric problems,”The Annals of Statistics 1209–230.
Ferguson, T.S. (1974), “Prior distributions on spaces of probability measures,”The Annals of Statistics2, 615–629.
Freedman, D. (1963), “On the asymptotic behavior of Bayes estimates in the discrete case,”Annals of Mathematical Statistics34, 1386–1403.
Gelfand, A.E., Hills, S.E., Racine-Poon, A., and Smith, A.F.M. (1990), “Illustration of Bayesian inference in normal data models using Gibbs sampling.”Journal Of the American Statistical Association85, 972–985.
George, E.I., Makov, U.E., and Smith, A.F.M. (1994), “Fully Bayesian hierarchical analysis for exponential families via Monte Carlo computation,”Aspects of Uncertainty: A Tribute to D.V. Lindley (eds: AFM Smith and PR Freeman), London: John Wiley and Sons, 181–199.
Gilks, W.R., Richardson, S., and Spiegelhalter, D.J., eds. (1996)Markov Chain Monte Carlo in PracticeLondon: Chapman and Hall.
Kuo, L. and Mallick, B. (1998), “Bayesian semiparametric inference for the accelerated failure,”Canadian Journal of Statisticsto appear.
Liu, J.S. (1996), “Nonparametric hierarchical Bayes via sequential imputations,”The Annals of Statistics24, 911–930.
MacEachern, S.N. (1988), Sequential Bayesian bioassay design. Unpublished dissertation. University of Minnesota.
MacEachern, S.N. (1994), “Estimating normal means with a conjugate style Dirichlet process prior,”Communications in Statistics: Simulationand Computation, 23, 727–741.
MacEachern, S.N. and Müller, P. (1998), “Estimating mixture of Dirichlet process models,”Journal of Computational and GraphicalStatistics, to appear.
Mukhopadhyay, S. and Gelfand, A.E. (1997), “Dirichlet process mixed generalized linear models,”Journal Of the American Statistical Association92, 633–639.
Müller, P., Erkanli, A., and West, M. (1996), “Bayesian curve fitting using multivariate normal mixtures,”Biometrika83, 67–79.
Müller, P., West, M., and MacEachern, S.N. (1997), “Bayesian models for non-linear auto-regressions,”Journal of Time Series Analysis(in press).
Naylor, J.C. and Smith, A.F.M. (1982), “Applications of a method for the efficient computation of posterior distributions,”AppliedStatistics, 31, 214–235.
Pauler, D.K., Escobar, M.D., Sweeney, J.A., and Greenhouse, J. (1996), “Mixture Models for Eye-Tracking Data: A Case Study”Statistics in Medicine15, 1365–1376.
Roeder, K., Escobar, M., Kadane, J., and Balazs, I., (1998), “Measuring Heterogeneity in Forensic Databases”Biometrikato appear.
Sweeney, J.A., Clementz, B.A., Escobar, M.D., Li, S., Pauler, D.K., and Haas, G.L. (1993), “Mixture analysis of pursuit eye tracking dysfunction in schizophrenia,”Biological Psychiatry34, 331–340.
Tanner, M.A. and Wong, W.H. (1987), “The calculation of posterior distributions by data augmentation (with discussion),”Journal of the American Statistical Association82, 528–550.
Tomlinson, G. (1998), Analysis of densities with Dirichlet process priors. Unpublished dissertation. University of Toronto.
Turner, D.A., and West, M. (1993), “Statistical analysis of mixtures applied to postsynpotential fluctuations,”Journal of Neuroscience Methods47, 1–23.
West, M. (1987), “On scale mixtures of normal distributions,”Biometrika74, 646–648.
West, M. (1990), “Bayesian kernel density estimation,”ISDS Discussion Paper #90-A 02Duke University.
West, M. (1992), “Hyperparameter estimation in Dirichlet process mixture models,”ISDS Discussion Paper #92-A03Duke University.
West, M. (1997), “Hierarchical mixture models in neurological transmission analysis,”Journal Of the American Statistical Association92, 587–608.
West, M., and Cao, G. (1993), “Assessing mechanisms of neural synaptic activity,” InBayesian Statistics in Science and Technology: Case Studies(eds: C.A. Gatsonis, J.S. Hodges, R.E. Kass, and N.D. Singpur-walla), New York: Springer-Verlag.
West, M., Müller, P., and Escobar, M.D. (1994), “Hierarchial Priors and Mixture Models, with Applications in Regression and Density Estimation,”Aspects of Uncertainty: A Tribute to D. V. Lindley(eds: AFM Smith and PR Freeman), London: John Wiley and Sons, 363–386.
West, M., and Turner, D.A. (1994), “Deconvolution of mixtures in analysis of neural synaptic transmission,”The Statistician43, 31–43.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer Science+Business Media New York
About this chapter
Cite this chapter
Escobar, M.D., West, M. (1998). Computing Nonparametric Hierarchical Models. In: Dey, D., Müller, P., Sinha, D. (eds) Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statistics, vol 133. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-1732-9_1
Download citation
DOI: https://doi.org/10.1007/978-1-4612-1732-9_1
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-387-98517-6
Online ISBN: 978-1-4612-1732-9
eBook Packages: Springer Book Archive