Relabelling in Bayesian mixture models by pivotal units
Label switching is a well-known and fundamental problem in Bayesian estimation of finite mixture models. It arises when exploring complex posterior distributions by Markov Chain Monte Carlo (MCMC) algorithms, because the likelihood of the model is invariant to the relabelling of mixture components. If the MCMC sampler randomly switches labels, then it is unsuitable for exploring the posterior distributions for component-related parameters. In this paper, a new procedure based on the post-MCMC relabelling of the chains is proposed. The main idea of the method is to perform a clustering technique on the similarity matrix, obtained through the MCMC sample, whose elements are the probabilities that any two units in the observed sample are drawn from the same component. Although it cannot be generalized to any situation, it may be handy in many applications because of its simplicity and very low computational burden.
KeywordsLabel switching Complex posterior distributions MCMC Finite mixture model
- Egidi, L., Pappadà, R., Pauli, F., Torelli, N.: Maxima units search (MUS) algorithm: methodology and applications (2016). ArXiv e-prints arXiv:1611.01069
- Grün, B.: Bayesmix: bayesian mixture models with JAGS. R package version 0.7-2. http://CRAN.R-project.org/package=bayesmix (2011)
- Jasra, A.: Bayesian inference for mixture models via Monte Carlo computation. Ph.D. thesis, Imperial College London (University of London) (2006)Google Scholar
- Papastamoulis, P., Iliopoulos, G.: An artificial allocations based solution to the label switching problem in Bayesian analysis of mixtures of distributions. J. Comput. Graph. Stat. 19(2), 313–331 (2010)Google Scholar
- Puolamäki, K., Kaski, S.: Bayesian solutions to the label switching problem. In: Adams, N.M., Robardet, C., Siebes, A., Boulicaut, J.-F. (Eds.) Advances in Intelligent Data Analysis VIII 8th International Symposium on Intelligent Data Analysis, IDA 2009, Lyon, France, pp. 381–392. Springer, Berlin (2009). http://www.springer.com/gp/book/9783642039140