Abstract
In the Bayesian approach to model selection and prediction, the posterior probability of each model under consideration must be computed. In the presence of weak prior information we need using default or automatic priors, that are typically improper, for the parameters of the models. However this leads to ill-defined posterior probabilities.
Several methods have recently been proposed to overcome this difficulty. Of particular interest are the intrinsic and fractional methodologies introduced by Berger and Pericchi (1996) and O’Hagan (1995), respectively. In the specific case of comparing nested models, a significant feature of these methods is that they allow to derive proper priors to be used in the analysis.
Unfortunately, the above methods do not apply to nonnested models: either the priors derived depend on the label we assign to models under comparison, and this may give two possible values to the posterior probability of each model, or they depends on the form of “encompassing”.
We first consider a particular nonnested model selection problem: the one-sided testing problem. The encompassing approach for converting the non-nested problem into a nested one is discussed, and an alternative solution is proposed. Its behavior is illustrated on exponential distributions.
For more general nonnested model selection problems we argue that an accessible piece of prior information on the observable random variable helps to find the posterior probability of the models. The way to deal with such a prior information is developed and illustrated on the comparison of separate normal and double exponential families of distributions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Berger, J.O. and Bernardo, J.M. (1992). On the development of the reference prior method. In Bayesian Statistics 4, (J.M. Bernardo et al. eds.), London: Oxford University Press, pp. 35–60.
Berger, J. O. and Mortera, J. (1995). Discussion of O’Hagan. Journal of the Royal Statistical Society, B, 57, pp. 99–138.
Berger, J.O. and Pericchi, L.R. (1996). The intrinsic Bayes factor for model selection and prediction. Journal of the American Statistical Association, 91, pp. 109–122.
Berger, J.O. and Pericchi, L.R. (1998). On Criticism and Comparison of Default Bayes Factors for Model Selection and Hypothesis Testing. In Proceedings of the Workshop on Model Selection, (Ed. W. Racugno), Pitagora Ed., Bologna, pp. 1–50.
Bernardo, J.M. and Smith, A.F.M. (1994). Bayesian Theory. N.Y.: Wiley.
Bertolino, F. and Racugno, W. (1996), Is the intrinsic Bayes factor intrinsic?, Metron, 1, pp. 5–15.
Bertolino, F., Moreno, E., and Racugno, W. (1999). Bayesian Model Selection Approach to Analysis of Variance under Heteroscedasticity. Technical Report. University of Granada.
Cox, D.R. (1961). Test of separate families of hypothesis. In Proceedings of the Fouth Berkeley Symposium,1, pp. 105–123.
De Santis, F. and Spezzaferri, F. (1999). Methods for Default and Robust Bayesian Model Comparison: the Fractional Bayes Factor Approach. International Statistical Review. 67, pp. 26–286.
Dmochowski, J. (1996). Intrinsic Bayes factor via Kullback-Leibler geometry. In Bayesian Statistics 5, (Eds. J.M. Bernardo et al.), London: Oxford University Press.
Kadane, J.B. and Wolfson, L.J. (1998). Experiences in Elicitation. The Statistician, 47, pp. 3–19.
Moreno, E. (1997). Bayes Factor for Intrinsic and Fractional Priors in Nested Models: Bayesian Robustness, in L 1 -Statistical Procedures and Related Topics, (Ed. D. Yadolah), Hayward, CA: IMS, 29, pp. 257–270.
Moreno, E., Bertolino, F. and Racugno, W. (1998a). Default approaches to compare means of normal populations (with discussion). In Proceedings of the Workshop On Model Selection, (Ed. W. Racugno), Pitagora Ed., Bologna, pp. 133–155.
Moreno, E., Bertolino, F. and Racugno, W. (1998b). An Intrinsic Limiting Procedure for Model Selection and Hypotheses Testing. Journal of the American Statistical Association,93, pp. 1451–1460.
Moreno, E., Bertolino, F. and Racugno, W. (1999a). Default Bayesian Analysis of the Behrens-Fisher Problem. Journal of Statistical Planning and Inference, 81, pp. 323–333.
Moreno, E., Bertolino, F. and Racugno, W. (1999b). Inference under partial information on observable random variables. Technical Report. University of Granada.
Moreno, E. and Liseo, B. (1999). Default priors for testing the number of components of a mixture. Technical Report. University of Granada.
O’Hagan, A. (1995). Fractional Bayes Factor for Model Comparison (with discussion). Journal of the Royal Statistical Society, B, 57, pp. 99–138.
O’Hagan, A. (1997). Properties of Intrinsic and Fractional Bayes Factors. Test, 6, pp. 101–118.
O’Hagan, A. (1998). Eliciting Expert Beliefs in Substantial Practical Applications. The Statistician, 47, pp. 21–35.
San Martini, A. and Spezzaferri, F. (1984). A predictive model selection criterion. Journal of the Royal Statistical Society, B, 46, pp. 296–303.
Sansó, B., Pericchi, L.R. and Moreno, E. (1995). On the robustness of the intrinsic Bayes factor for nested models (with discussion). In Bayesian Robustness, (Eds. J.O. Berger et al.), Hayward CA: IMS, 29, pp. 157–176.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bertolino, F., Moreno, E., Racugno, W. (2000). Bayesian model selection methods for nonnested models. In: Bethlehem, J.G., van der Heijden, P.G.M. (eds) COMPSTAT. Physica, Heidelberg. https://doi.org/10.1007/978-3-642-57678-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-57678-2_3
Publisher Name: Physica, Heidelberg
Print ISBN: 978-3-7908-1326-5
Online ISBN: 978-3-642-57678-2
eBook Packages: Springer Book Archive