Implications of Model Uncertainty for Bank Stress Testing

Article
  • 265 Downloads

Abstract

We aim to raise the awareness that model uncertainty stemming from stress test satellite equations that relate bank risk parameters to macro-financial variables can be significant. Based on a set of credit risk models derived by means of a Bayesian model averaging (BMA) methodology we conduct a stress test for 75 European banks to highlight that i) an optimistic equation choice can imply significantly overstated capital estimates, ii) model uncertainty contributes on average about 35% to overall uncertainty in our application, and iii) the impact of model uncertainty feeding through regulatory risk weights can easily turn twice as sizable as that from loan losses. Model methods that account for model uncertainty, such as the BMA, should mitigate the risks arising along these three dimensions and help establish a level playing field with regard to an equal extent of conservatism across banks.

Keywords

Stress testing Model uncertainty Bank regulation and supervision 

JEL Classification

C11 C22 C51 E58 G21 

References

  1. Alessandri P, Gai P, Kapadia S, Mora N, Puhr C (2009) Towards a framework for quantifying systemic stability. International Journal of Central Banking 5(3):47–81Google Scholar
  2. Altman E, Saunders A (1997) Credit risk measurement: developments over the last 20 years. J Bank Financ 21(11):1721–1742CrossRefGoogle Scholar
  3. BCBS (2006) International convergence of capital measurement and capital standards. Bank for International Settlements (BIS)Google Scholar
  4. Begley TA, Purnanandam AK, Zheng KC (2016) The strategic under-reporting of bank risk. Rev Financ Stud, forthcomingGoogle Scholar
  5. Behn M, Haselmann R, Vig V (2016) The limits of model-based regulation. ECB Working Paper No. 1928Google Scholar
  6. Bolotnyy V, Edge R, Guerrieri L (2015) Revenue forecasts, capital adequacy, and the uncertainty of stress test results. Unpublished manuscriptGoogle Scholar
  7. Borio C, Drehmann M, Tsatsaronis K (2012) Stress-testing macro stress testing: does it live up to expectations? BIS Working Papers No. 369Google Scholar
  8. Boss M, Krenn G, Puhr C, Summer M (2006) Systemic risk monitor: a model for systemic risk analysis and stress testing of banking systems. Austrian National Bank Financial Stability Report 11:83–95Google Scholar
  9. Bradley E, Hastie T, Johnstone I, Tibshirani R (2004) Least angle regression. Ann Stat 32(2):407–499CrossRefGoogle Scholar
  10. Breuer T, Jandacka M, Rheinberger K, Summer M (2009) How to find plausible, severe, and useful stress scenarios. International Journal of Central Banking 5(3):205–224Google Scholar
  11. Castren O, Deesa S, Zaherb F (2010) Stress-testing euro area corporate default probabilities using a global macroeconomic model. J Financ Stab 6(2):64–78CrossRefGoogle Scholar
  12. Cihak M (2007) Introduction to applied stress testing. IMF Working Paper 07/59Google Scholar
  13. Covas F, Rump B, Zakrajsek E (2014) Stress-testing US bank holding companies: a dynamic panel quantile regression approach. Int J Forecast 30(3):691–713CrossRefGoogle Scholar
  14. Crosbie P, Bohn J (2003) Modeling default risk. Moody’s AnalyticsGoogle Scholar
  15. Crouhy M, Galai D, Mark R (2000) A comparative analysis of current credit risk models. J Bank Financ 24(1-2):59–117CrossRefGoogle Scholar
  16. CRR (2013) Regulation (eu) no 575/2013 of the European Parliament and of the Council (CRR). Off J Eur UnionGoogle Scholar
  17. Dees S, Henry J, Reiner M (2017) STAMP€: stress test analytics for macroprudential purposes in the euro area. http://www.ecb.europa.eu/pub/pdf/other/stampe201702.en.pdf
  18. Demyanyk Y, Van Hemert O (2011) Understanding the subprime mortgage crisis. Rev Financ Stud 24(6):1848–1880Google Scholar
  19. Derksen S, Keselman HJ (1992) Backward, forward and stepwise automated subset selection algorithms: frequency of obtaining authentic and noise variables. Br J Math Stat Psychol 45:265–282CrossRefGoogle Scholar
  20. Ferry DH, Hughes T, Ding M (2012) Stressed EDF credit measures for North America. Moody’s AnalyticsGoogle Scholar
  21. Firestone S, Rezende M (2013) Are banks’ internal risk parameters consistent? Evidence from syndicated loans. J Financ Serv Res 50(2):211–242CrossRefGoogle Scholar
  22. Foglia A (2009) Risk, Stress testing credit A survey of authorities’ approaches. International Journal of Central Banking 5(3):9–45Google Scholar
  23. Gordy M (2000) A comparative anatomy of credit risk models. J Bank Financ 24(1/2):119–149CrossRefGoogle Scholar
  24. Gray D, Gross M, Paredes J, Sydow M (2013) Modeling banking, sovereign, and macro risk in a CCA global VAR. IMF Working Paper 13/218Google Scholar
  25. Guerrieri L, Welch M (2012) Can macro variables used in stress testing forecast the performance of banks? Board of Governors of the Federal Reserve System Working Paper 2012–49Google Scholar
  26. Hardy D, Schmieder C (2011) Rules of thumb to stress test credit risk. IMF Working Paper 13/232Google Scholar
  27. Henry J, Kok C (2013) A macro stress testing framework for assessing systemic risks in the banking sector. European Central Bank Occasional Paper No. 152Google Scholar
  28. Hirtle B, Kovner A, Vickery J, Bhanot M (2016) Assessing financial stability: the capital and loss assessment under stress scenarios (CLASS) model. J Bank Financ 69:35–55CrossRefGoogle Scholar
  29. Hoggarth G, Sorensen S, Zicchino L (2005) Stress tests of UK banks using a VAR approach. Bank of England Working Paper No. 282Google Scholar
  30. Jacobson T, Linde J, Roszbach K (2005) Exploring interactions between real activity and the financial stance. J Financ Stab 1:308–341CrossRefGoogle Scholar
  31. Jacobson T, Linde J, Roszbach K (2006) Internal ratings systems, implied credit risk and the consistency of banks’ risk classification policies. J Bank Financ 30 (7):1899–1926CrossRefGoogle Scholar
  32. Jimenez G, Saurina J (2006) Credit cycles, credit risk, and prudential regulation. International Journal of Central Banking 2(2):65–98Google Scholar
  33. Kapinos P, Mittnik OA (2016) A top-down approach to stress-testing banks. J Financ Serv Res 49:229–264CrossRefGoogle Scholar
  34. Pesaran M, Schuermann T, Treutler B, Weiner S (2006) Macroeconomic dynamics and credit risk: a global perspective. J Money Credit Bank 38(5):1211–1261CrossRefGoogle Scholar
  35. Piskorski T, Seru A, Witkin J (2015) Asset quality misrepresentation by financial intermediaries: evidence from the RMBS market. J Financ 70(6):2635–2678CrossRefGoogle Scholar
  36. Plosser MC, Santos JAC (2014) Banks’ incentives and the quality of internal risk models. FRB of New York Staff Report No. 704Google Scholar
  37. Rajan U, Seru A, Vig V (2010) Statistical default models and incentives. Am Econ Rev 100(2):506–510CrossRefGoogle Scholar
  38. RMA Capital Working Group (2000) EDF estimation: a “test-deck” exercise. RMA J:54–61Google Scholar
  39. Roecker EB (1991) Prediction error and its estimation for subset-selection models. Technometrics 33:459–469CrossRefGoogle Scholar
  40. Sala-I-Martin X, Doppelhofer G, Miller RI (2004) Determinants of long-term growth: a Bayesian averaging of classical estimates (BACE) approach. Am Econ Rev 94(4):813–835CrossRefGoogle Scholar
  41. Salas V, Saurina J (2002) Credit risk in two institutional regimes: Spanish commercial and savings banks. J Financ Serv Res 22(3):203–224CrossRefGoogle Scholar
  42. Schmieder C, Puhr C, Hasan M (2011) Next generation balance sheet stress testing. IMF Working Paper No 11/83Google Scholar
  43. Simons D, Rolwes F (2009) Macroeconomic default modeling and stress testing. International Journal of Central Banking 5(5):177–204Google Scholar
  44. Sun Z, Munves D, Hamilton D (2012) Public firm expected default frequency (EDFTM) credit measures: methodology, performance, and model extensions. Moody’s AnalyticsGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.European Central BankFrankfurt am MainGermany

Personalised recommendations