Skip to main content
SpringerLink
Log in

Model Selection

  • Reference work entry
  • First Online:
The New Palgrave Dictionary of Economics

  • 26 Accesses

Abstract

The problem of statistical model selection in econometrics and statistics is reviewed. Model selection is interpreted as a decision problem through which a statistical model is selected in order to perform statistical analysis, such as estimation, testing, confidence set construction, forecasting, simulation, policy analysis, and so on. Broad approaches to model selection are described: (1) hypothesis testing procedures, including specification and diagnostic tests; (2) penalized goodness-of-fit methods, such as information criteria; (3) Bayesian approaches; (4) forecast evaluation methods. The effect of model selection on subsequent statistical inference is also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 6,499.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 8,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Bibliography

  • Akaike, H. 1969. Fitting autoregressive models for prediction. Annals of the Institute of Statistical Mathematics 21: 243–247.

    Article  Google Scholar 

  • Akaike, H. 1970. Statistical predictor identification. Annals of the Institute of Statistical Mathematics 22: 203–217.

    Article  Google Scholar 

  • Akaike, H. 1973. Information theory and an extension of the maximum likelihood principle. In Second international symposium on information theory, ed. B.N. Petrov and F. Csaki. Budapest: Akademiai Kiado.

    Google Scholar 

  • Akaike, H. 1974. A new look at the statistical model identification. IEEE Transactions on Automatic Control AC-19: 716–723.

    Article  Google Scholar 

  • Allen, D.M. 1971. Mean square error prediction as a criterion for selecting variables. Technometrics 13: 469–475.

    Article  Google Scholar 

  • Amemiya, T. 1980. Selection of regressors. International Economic Review 21: 331–354.

    Article  Google Scholar 

  • Bhatti, M.I., H. Al-Shanfari, and M.Z. Hossain. 2006. Econometric analysis of model selection and model testing. Aldershot: Ashgate.

    Google Scholar 

  • Box, G.E.P., and G.M. Jenkins. 1976. Time series analysis: Forecasting and control. 2nd ed. San Francisco: Holden-Day.

    Google Scholar 

  • Box, G.E.P., and G.C. Tiao. 1976. Comparison of forecast and actuality. Applied Statistics 64: 195–200.

    Article  Google Scholar 

  • Burnham, K.P., and D.R. Anderson. 2002. Model selection and multi-model inference: A practical information theoretic approach. New York: Springer.

    Google Scholar 

  • Cartwright, N. 1983. How the laws of physics lie. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Charemza, W.W., and D.F. Deadman. 1997. New directions in econometric practice: General to specific modelling, cointegration and vector autoregression. 2nd ed. Aldershot: Edward Elgar.

    Google Scholar 

  • Choi, B. 1992. ARMA model identification. New York: Springer.

    Book  Google Scholar 

  • Chow, G.C. 1960. Tests of equality between sets of coefficients in two linear regressions. Econometrica 28: 591–605.

    Article  Google Scholar 

  • Clements, M.P., and D.F. Hendry. 1998. Forecasting economic time series. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Clements, M.P., and D.F. Hendry, ed. 2002. A companion to economic forecasting. Oxford: Blackwell.

    Google Scholar 

  • Danilov, D., and J.R. Magnus. 2004. On the harm that ignoring pretesting can cause. Journal of Econometrics 122: 27–46.

    Article  Google Scholar 

  • Davidson, J.E.H., D.F. Hendry, F. Srba, and S. Yeo. 1978. Econometric modelling of the aggregate time-series relationship between consumers’ expenditure and income in the United Kingdom. Economic Journal 88: 661–692.

    Article  Google Scholar 

  • Davidson, R., and J.G. MacKinnon. 1993. Estimation and inference in econometrics. New York: Oxford University Press.

    Google Scholar 

  • Diebold, F.X. 2004. Elements of forecasting. 3rd ed. Mason, OH: Thomson South-Western.

    Google Scholar 

  • Diebold, F.X., and R.S. Mariano. 1995. Comparing predictive accuracy. Journal of Business and Economic Statistics 13: 253–263.

    Google Scholar 

  • Draper, N.R., and H. Smith, ed. 1981. Applied regression analysis. rev ed. New York: Wiley.

    Google Scholar 

  • Dufour, J.-M. 1980. Dummy variables and predictive tests for structural change. Economics Letters 6: 241–247.

    Article  Google Scholar 

  • Dufour, J.-M. 1997. Some impossibility theorems in econometrics, with applications to structural and dynamic models. Econometrica 65: 1365–1389.

    Article  Google Scholar 

  • Dufour, J.-M. 2003. Identification, weak instruments and statistical inference in econometrics. Canadian Journal of Economics 36: 767–808.

    Article  Google Scholar 

  • Dufour, J.-M. and Ghysels, E. 1996. Recent developments in the econometrics of structural change. Journal of Econometrics 70(1).

    Google Scholar 

  • Dufour, J.-M., E. Ghysels, and A. Hall. 1994. Generalized predictive tests and structural change analysis in econometrics. International Economic Review 35: 199–229.

    Article  Google Scholar 

  • Gelman, A., J.B. Carlin, H.S. Stern, and D.B. Rubin. 2003. Bayesian data analysis. 2nd ed. London: Chapman and Hall/CRC.

    Google Scholar 

  • Godfrey, L.G. 1988. Misspecification tests in econometrics: The lagrange multiplier principle and other approaches. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Gouriéroux, C., and A. Monfort. 1995. Statistics and econometric models. Vol. 1 and 2. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Grasa, A.A. 1989. Econometric model selection: A new approach. Dordrecht: Kluwer.

    Book  Google Scholar 

  • Hannan, E.J., and B. Quinn. 1979. The determination of the order of an autoregression. Journal of the Royal Statistical Society B 41: 190–191.

    Google Scholar 

  • Harvey, D.I., S.J. Leybourne, and P. Newbold. 1997. Testing the equality of prediction mean squared errors. International Journal of Forecasting 13: 281–291.

    Article  Google Scholar 

  • Hocking, R.R. 1976. The analysis and selection of variables in linear regression. Biometrika 32: 1–49.

    Article  Google Scholar 

  • Hurvitch, C.M., and C.-L. Tsai. 1989. Regression and time series model selection in small samples. Biometrika 76: 297–307.

    Article  Google Scholar 

  • Judge, G.G., and M.E. Bock. 1978. The statistical implications of pre-test and stein-rule estimators in econometrics. Amsterdam: North-Holland.

    Google Scholar 

  • Judge, G.G., W.E. Griffiths, R. Carter Hill, H. Lütkepohl, and T.-C. Lee. 1985. The theory and practice of econometrics. 2nd ed. New York: Wiley.

    Google Scholar 

  • Keuzenkamp, H.A. 2000. Probability, econometrics and truth: The methodology of econometrics. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Krishnaiah, P.R., and L.N. Kanal. 1982. Handbook of statistics 2: Classification, pattern recognition and reduction of dimensionality. Amsterdam: North-Holland.

    Google Scholar 

  • Lancaster, T. 2004. An introduction to modern Bayesian econometrics. Oxford: Blackwell.

    Google Scholar 

  • Le Cam, L. 1953. On some asymptotic properties of maximum likelihood estimates and related Bayes estimates. University of California Publications in Statistics 1: 277–330.

    Google Scholar 

  • Leamer, E. 1978. Specification searches: ad hoc inferences with nonexperimental data. New York: Wiley.

    Google Scholar 

  • Leamer, E.E. 1983. Model choice. In Handbook of econometrics, ed. Z. Griliches and M.D. Intriligator, Vol. 1. Amsterdam: North-Holland.

    Google Scholar 

  • Leeb, H., and B. Pötscher. 2005. Model selection and inference: Facts and fiction. Econometric Theory 21: 29–59.

    Article  Google Scholar 

  • Lehmann, E.L. 1986. Testing statistical hypotheses. 2nd ed. New York: Wiley.

    Book  Google Scholar 

  • MacKinnon, J.G. 1992. Model specification tests and artificial regressions. Journal of Economic Literature 30: 102–146.

    Google Scholar 

  • Mallows, C.L. 1973. Some comments on Cp. Technometrics 15: 661–675.

    Google Scholar 

  • Mariano, R.S. 2002. Testing forecast accuracy. In Clements and Hendry (2002).

    Google Scholar 

  • McCracken, M.W. and West, K.D. 2002. Inference about predictive ability. In Clements and Hendry (2002).

    Google Scholar 

  • McQuarrie, A.D.R., and C.-L. Tsai. 1998. Regression and time series model selection. Singapore: World Scientific.

    Book  Google Scholar 

  • Meese, R.A., and K. Rogoff. 1988. Was it real? The exchange rate-interest differential relation over the modern floating-rate period. Journal of Finance 43: 933–948.

    Article  Google Scholar 

  • Miller, A. 2002. Subset selection in regression. 2nd ed. Boca Raton, FL: Chapman & Hall/CRC.

    Book  Google Scholar 

  • Morgan, M.S., and M. Morrison. 1999. Models as Mediators: Perspectives on Natural and Social Science. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Parzen, E. 1977. Multiple time series: Determining the order of approximating autoregressive schemes. In Multivariate analysis IV: Proceedings of the fourth international symposium on multivariate analysis, ed. P.R. Krishnaiah. Amsterdam: North-Holland/Elsevier.

    Google Scholar 

  • Pesaran, M.H., R.P. Smith, and J.S. Yeo. 1985. Testing for structural stability and predictive failure: a review. Manchester School 3: 280–295.

    Article  Google Scholar 

  • Poirier, D.J. 1994. The methodology of econometrics. Vol. 2. Aldershot: Edward Elgar.

    Google Scholar 

  • Popper, K. 1968. The logic of scientific discovery. rev ed. New York: Harper Torchbooks.

    Google Scholar 

  • Pötscher, B.M. 1983. Order estimation in ARMA-models by Lagrange multiplier tests. Annals of Statistics 11: 872–885.

    Article  Google Scholar 

  • Pötscher, B. 1991. Effects of model selection on inference. Econometric Theory 7: 163–185.

    Article  Google Scholar 

  • Pötscher, B. 2002. Lower risk bounds and properties of confidence sets for ill-posed estimation problems with applications to spectral density and persistence estimation, unit roots and estimation of long memory parameters. Econometrica 70: 1035–1065.

    Article  Google Scholar 

  • Sakamoto, Y., M. Ishiguro, and G. Kitagawa. 1985. Akaike information criterion statistics. Dordrecht: Reidel.

    Google Scholar 

  • Sawa, T. 1978. Information criteria for discriminating among alternative regression models. Econometrica 46: 1273–1291.

    Article  Google Scholar 

  • Schwarz, G. 1978. Estimating the dimension of a model. Annals of Statistics 6: 461–464.

    Article  Google Scholar 

  • Shibata, R. 1976. Selection of the order of an autoregressive model by Akaike’s information criterion. Biometrika 71: 117–126.

    Article  Google Scholar 

  • Shibata, R. 1980. Asymptotically efficient selection of the order of the model for estimating parameters of a linear process. Annals of Statistics 8: 147–164.

    Article  Google Scholar 

  • Theil, H. 1957. Specification errors and the estimation of economic relationships. Review of the International Statistical Institute 25: 41–51.

    Article  Google Scholar 

  • Theil, H. 1961. Economic forecasts and policy. 2nd ed. Amsterdam: North-Holland.

    Google Scholar 

  • West, K.D. 1996. Asymptotic inference about predictive ability. Econometrica 64: 1067–1084.

    Article  Google Scholar 

  • West, K.D., and M.D. McCracken. 1998. Regression-based tests of predictive ability. International Economic Review 39: 817–840.

    Article  Google Scholar 

  • White, H. 2000. A reality check for data snooping. Econometrica 68: 1097–1126.

    Article  Google Scholar 

  • Zellner, A. 1971. An introduction to Bayesian inference in econometrics. New York: Wiley.

    Google Scholar 

  • Zellner, A., H.A. Keuzenkamp, and M. McAleer. 2001. Simplicity, inference and modelling: Keeping it sophisticatedly simple. Cambridge: Cambridge University Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. http://link.springer.com/referencework/10.1057/978-1-349-95121-5

    Jean-Marie Dufour

Authors
  1. Jean-Marie Dufour
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Copyright information

© 2018 Macmillan Publishers Ltd.

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Dufour, JM. (2018). Model Selection. In: The New Palgrave Dictionary of Economics. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-349-95189-5_1964

Download citation

Publish with us

Policies and ethics

Search

Navigation