Skip to main content

Bayesian Model Averaging

  • Chapter
  • First Online:
Macroeconomic Forecasting in the Era of Big Data

Part of the book series: Advanced Studies in Theoretical and Applied Econometrics ((ASTA,volume 52))

Abstract

Bayesian model averaging (BMA) is a statistical method to rigorously take model uncertainty into account. This chapter gives a coherent overview on the statistical foundations and methods of BMA and its usefulness for forecasting, but also for the identification of robust determinants. The focus is given on economic applications. We describe the BMA framework in the context of linear models. Different model and parameter priors are discussed in detail and suitable inference methods and posterior analysis tools are presented. We illustrate the use of the presented BMA framework to study potential drivers of box office revenues and to forecast these revenues. The available data set does not only contain traditional variables such as budget or genre categorization, but also variables derived from social media content which capture sentiment and volume of Twitter messages. We discuss the impact of different model specifications and describe how results are obtained using the open-source package BMS available for the R environment for statistical computing and graphics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This working paper was published in a slightly different version as Doppelhofer and Weeks (2009a).

  2. 2.

    In the context of economic growth, this is in line with the model formulation in Durlauf, Kourtellos, and Tan (2008) where competing groups of explanatory variables emerging from different theories are assumed to be relevant.

  3. 3.

    Following Lehrer and Xie (2017), this sample selection criterion was proposed by IHS film consulting and accounts for 41.4% of released movies.

References

  • Acemoglu, D., Johnson, S., & Robinson, J. (2001). The colonial origins of comparative development: An empirical investigation. American Economic Review, 91(5), 1369–1401.

    Article  Google Scholar 

  • Arias, M., Arratia, A., & Xuriguera, R. (2013). Forecasting with Twitter data. ACM Transactions on Intelligent Systems and Technology, 5(1), 8.

    Article  Google Scholar 

  • Arin, K. P., & Braunfels, E. (2018). The resource curse revisited: A Bayesian model averaging approach. Energy Economics, 70(100), 170–178.

    Article  Google Scholar 

  • Asur, S., & Huberman, B. A. (2010). Predicting the future with social media. In Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (Vol. 1, pp. 492–499). Piscataway: IEEE Computer Society.

    Google Scholar 

  • Barnard, G. A. (1963). New methods of quality control. Journal of the Royal Statistical Society, Series A, 126, 255–258.

    Article  Google Scholar 

  • Bates, J. M., & Granger, C. W. J. (1969). The combination of forecasts. Operational Research Quarterly, 20, 451–468.

    Article  Google Scholar 

  • Brock, W., & Durlauf, S. (2001). Growth empirics and reality. World Bank Economic Review, 15, 229–272.

    Article  Google Scholar 

  • Chipman, H. (1996). Bayesian variable selection with related predictors. Canadian Journal of Statistics, 24, 17–36.

    Article  Google Scholar 

  • Crespo Cuaresma, J. (2011). How different is Africa? A comment on Masanjala and Papageorgiou. Journal of Applied Econometrics, 26, 1041–1047.

    Article  Google Scholar 

  • Crespo Cuaresma, J., GrĂ¼n, B., Hofmarcher, P., Humer, S., & Moser, M. (2016). Unveiling covariate inclusion structures in economic growth regressions using latent class analysis. European Economic Review, 81, 189–202.

    Article  Google Scholar 

  • Danquah, M., Moral-Benito, E., & Ouattara, B. (2014). TFP growth and its determinants: A model averaging approach. Empirical Economics, 47(1), 227–251.

    Article  Google Scholar 

  • Delgado, M. S., Henderson, D. J., & Parmeter. C. F. (2014). Does education matter for economic growth? Oxford Bulletin of Economics and Statistics, 76(3), 334–359.

    Article  Google Scholar 

  • Doppelhofer, G., & Weeks, M. (2005). Jointness of growth determinants. Cambridge: University of Cambridge.

    Google Scholar 

  • Doppelhofer, G., & Weeks, M. (2009a). Jointness of growth determinants. Journal of Applied Econometrics, 24(2), 209–244.

    Article  Google Scholar 

  • Doppelhofer, G., & Weeks, M. (2009b). Jointness of growth determinants: Reply to comments by Rodney Strachan, Eduardo Ley and Mark FJ Steel. Journal of Applied Econometrics, 24(2), 252–256.

    Article  Google Scholar 

  • Durlauf, S. N., Kourtellos, A., & Tan, C. M. (2008). Are any growth theories robust? The Economic Journal, 118(527), 329–346.

    Article  Google Scholar 

  • Eicher, T. S., Henn, C., & Papageorgiou, C. (2012). Trade creation and diversion revisited: Accounting for model uncertainty and natural trading partner effects. Journal of Applied Econometrics, 27(2), 296–321.

    Article  Google Scholar 

  • Eicher, T. S., & Newiak, M. (2013). Intellectual property rights as development determinants. Canadian Journal of Economics, 46(1), 4–22.

    Article  Google Scholar 

  • Eicher, T. S., Papageorgiou, C., & Raftery, A. E. (2011). Default priors and predictive performance in Bayesian model averaging, with application to growth determinants. Journal of Applied Econometrics, 26(1), 30–55.

    Article  Google Scholar 

  • Feldkircher, M., Horvath, R., & Rusnak, M. (2014). Exchange market pressures during the financial crisis: A Bayesian model averaging evidence. Journal of International Money and Finance, 40, 21–41.

    Article  Google Scholar 

  • FernĂ¡ndez, C., Ley, E., & Steel, M. F. J. (2001). Model uncertainty in cross-country growth regressions. Journal of Applied Econometrics, 16(5), 563–576.

    Article  Google Scholar 

  • George, E. I. (2010). Dilution priors: Compensating for model space redundancy. IMS Collections Borrowing Strength: Theory Powering Applications – A Festschrift for Lawrence D. Brown, 6, 158–165.

    Google Scholar 

  • Glass, D. H. (2013). Confirmation measures of association rule interestingness. Knowledge-Based Systems, 44, 65–77.

    Article  Google Scholar 

  • GrĂ¼n, B., & Hofmarcher, P. (2018). Identifying groups of determinants in Bayesian model averaging using Dirichlet process clustering model priors. Salzburg: University of Salzburg.

    Google Scholar 

  • Hannak, A., Anderson, E., Barrett, L. F., Lehmann, S., Mislove, A., & Riedewald, M. (2012). Tweetin’ in the rain: Exploring societal-scale effects of weather on mood. In Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media (pp. 479–482).

    Google Scholar 

  • Henderson, D. J., Papageorgiou, C., & Parmeter, C. F. (2011). Growth empirics without parameters. The Economic Journal, 122(559), 125–154.

    Article  Google Scholar 

  • Henderson, D. J., & Parmeter, C. F. (2016). Model averaging over nonparametric estimators. In G. GonzĂ¡lez-Rivera, R. C. Hill, & T.-H. Lee (Eds.), Essays in honor of Aman Ullah. Advances in Econometrics (Vol. 36, pp. 539–560). Bingley: Emerald Group Publishing Limited.

    Google Scholar 

  • Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999). Bayesian model averaging: A tutorial. Statistical Science, 14(4), 382–417.

    Article  Google Scholar 

  • Hofmarcher, P., Crespo Cuaresma, J., GrĂ¼n, B., Humer, S., & Moser, M. (2018). Bivariate jointness measures in Bayesian model averaging: Solving the conundrum. Journal of Macroeconomics, 57, 150–165.

    Article  Google Scholar 

  • Hofmarcher, P., Kerbl, S., GrĂ¼n, B., Sigmund, M., & Hornik, K. (2014). Model uncertainty and aggregated default probabilities: New evidence from Austria. Applied Economics, 46(8), 871–879.

    Article  Google Scholar 

  • Jetter, M., & Parmeter, C. F. (2018). Sorting through global corruption determinants: Institutions and education matter – Not culture. World Development, 109(100), 279–294.

    Article  Google Scholar 

  • Koop, G. (2017). Bayesian methods for empirical macroeconomics with big data. Review of Economic Analysis, 9, 33–56.

    Google Scholar 

  • Koop, G., & Korobilis, D. (2012). Forecasting inflation using dynamic model averaging. International Economic Review, 53(3), 867–886.

    Article  Google Scholar 

  • Koop, G., & Tobias, J. L. (2006). Semiparametric Bayesian inference in smooth coefficient models. Journal of Econometrics, 134(1), 283–315.

    Article  Google Scholar 

  • Leamer, E. E. (1978). Specification searches. New York: John Wiley and Sons.

    Google Scholar 

  • Lehrer, S., & Xie, T. (2017). Box office buzz: Does social media data steal the show from model uncertainty when forecasting for Hollywood? The Review of Economics and Statistics, 99(5), 749–755.

    Article  Google Scholar 

  • Lenkoski, A., Eicher, T., & Raftery, A. (2014). Two-stage Bayesian model averaging in endogenous variable models. Econometric Reviews, 33, 122–151.

    Article  Google Scholar 

  • Ley, E., & Steel, M. F. J. (2007). Jointness in Bayesian variable selection with applications to growth regression. Journal of Macroeconomics, 29(3), 476–493.

    Article  Google Scholar 

  • Ley, E., & Steel, M. F. J. (2009). On the effect of prior assumptions in Bayesian model averaging with applications to growth regression. Journal of Applied Econometrics, 24(4), 651–674.

    Article  Google Scholar 

  • Ley, E., & Steel, M. F. J. (2012). Mixtures of g-priors for Bayesian model averaging with economic applications. Journal of Econometrics, 171(2), 251–266.

    Article  Google Scholar 

  • Madigan, D., & Raftery, A. E. (1994). Model selection and accounting for model uncertainty in graphical models using Occam’s window. Journal of the American Statistical Association, 89(428), 1535–1546.

    Article  Google Scholar 

  • Madigan, D., & York, J. (1995). Bayesian graphical models for discrete data. International Statistical Review, 63(2), 215–232.

    Article  Google Scholar 

  • Malsiner-Walli, G., Hofmarcher, P., & GrĂ¼n, B. (2019). Semi-parametric regression under model uncertainty: Economic applications. Oxford Bulletin of Economics and Statistics, 81(5), 1117–1143.

    Article  Google Scholar 

  • Masanjala, W. H., & Papageorgiou, C. (2008). Rough and lonely road to prosperity: A reexamination of the sources of growth in Africa using Bayesian model averaging. Journal of Applied Econometrics, 23, 671–682.

    Article  Google Scholar 

  • Moral-Benito, E. (2012). Determinants of economic growth: A Bayesian panel data approach. Review of Economics and Statistics, 94(2), 566–579.

    Article  Google Scholar 

  • Moral-Benito, E. (2015). Model averaging in economics: An overview. Journal of Economic Surveys, 29(1), 46–75.

    Article  Google Scholar 

  • Moser, M., & Hofmarcher, P. (2013). Model priors revisited: Interaction terms in BMA growth applications. Journal of Applied Econometrics, 29(2), 344–347.

    Article  Google Scholar 

  • R Core Team. (2019). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/.

    Google Scholar 

  • Raftery, A., Karny, M., & Ettler, P. (2010). Online prediction under model uncertainty via dynamic model averaging: Application to a cold rolling mill. Technometrics, 52, 52–66.

    Article  Google Scholar 

  • Sala-i-Martin, X., Doppelhofer, G., & Miller, R. I. (2004). Determinants of long-term growth: A Bayesian averaging of classical estimates (BACE) approach. The American Economic Review, 94(4), 813–835.

    Article  Google Scholar 

  • Scheipl, F. (2011). spikeSlabGAM: Bayesian variable selection, model choice and regularization for generalized additive mixed models in R. Journal of Statistical Software, 43(14), 1–24.

    Article  Google Scholar 

  • Scheipl, F., Fahrmeir, L., & Kneib, T. (2012). Spike-and-slab priors for function selection in structured additive regression models. Journal of the American Statistical Association, 107(500), 1518–1532.

    Article  Google Scholar 

  • Smith, M., & Kohn, R. (1996). Nonparametric regression using Bayesian variable selection. Journal of Econometrics, 75(2), 317–343.

    Article  Google Scholar 

  • Steel, M. F. J. (2018). Bayesian model averaging and its use in economics. arXiv:1709.08221 [stat.AP]. Retrieved from http://arxiv.org/abs/1709.08221.

  • Strachan, R. W. (2009). Comment on ‘Jointness of growth determinants’ by Gernot Doppelhofer and Melvyn Weeks. Journal of Applied Econometrics, 24(2), 245–247.

    Article  Google Scholar 

  • Tobias, J. L., & Li, M. (2004). Returns to schooling and Bayesian model averaging: A union of two literatures. Journal of Economic Surveys, 18(2), 153–180.

    Article  Google Scholar 

  • Wright, J. H. (2008). Bayesian model averaging and exchange rate forecasts. Journal of Econometrics, 146(2), 329–341.

    Article  Google Scholar 

  • Wu, T., Chen, Y., & Han, J. (2010). Re-examination of interestingness measures in pattern mining: A unified framework. Data Mining and Knowledge Discovery, 21(3), 371–397.

    Article  Google Scholar 

  • Zellner, A. (1986). On assessing prior distributions and Bayesian regression analysis with g prior distributions. In P. Goel & A. Zellner (Eds.), Bayesian inference and decision techniques: Essays in honor of Bruno de Finetti (Vol. 6, pp. 233–243). New York: Elsevier.

    Google Scholar 

  • Zeugner, S., & Feldkircher, M. (2015). Bayesian model averaging employing fixed and flexible priors: The BMS package for R. Journal of Statistical Software, 68(4), 1–37.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paul Hofmarcher .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hofmarcher, P., GrĂ¼n, B. (2020). Bayesian Model Averaging. In: Fuleky, P. (eds) Macroeconomic Forecasting in the Era of Big Data. Advanced Studies in Theoretical and Applied Econometrics, vol 52. Springer, Cham. https://doi.org/10.1007/978-3-030-31150-6_12

Download citation

Publish with us

Policies and ethics