8. Conclusion
In this chapter we dealt with validation of rating systems, constructed to forecast a 1-year probability of default. Hereby, we focused on statistical tests and their application for bank internal purposes, especially in the Basel II periphery. We built up a simulation based framework to take account of dependencies in defaults (asset correlation), which additionally has the potential to appraise the type II error, i.e. the non-detection of a bad rating system, for optional scenarios. Hereby, the well known exact and approximated binomial test and the Hosmer-Lemeshow-x 2 test are used, but we also introduced the less popular Spiegelhalter test and an approach called simultaneous binomial test, which allow the testing of a complete rating system and not just each grade separately. As it is important for banks to compare the quality of modules of their rating system, we also refer to the Redelmeier test. As for any applied statistical method, building test samples is an important issue. We designed the concept of “the rolling 12-months-window” to fulfil the Basel II and bank’s internal risk management requirements as well as using the bank’s IT-environment (rating database) effectively and is in harmony with our definition of what a rating should reflect, namely the bank’s most accurate assessment of the 1-year-PD of a borrower. All concepts are demonstrated with a very up-to-date, real-life bank internal rating data set in detail.
We focus mainly on statistical concepts for rating validation (backtesting) but it has to be emphasised that for a comprehensive and adequate validation in the spirit of Basel II, much more is required. To name a few, these include adherence of defined bank internal rating processes, accurate and meaningful use of ratings in the bank’s management systems and correct implementation in the IT-environment.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
The views expressed in this article are those of the author and do not necessarily reflect those of Dresdner Bank AG.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balthazar L (2004), PD estimates for Basel II, Risk, April, pp. 84–85.
Basel Committee on Banking Supervision (BCBS) (2005a), Basel II: International Convergence of Capital Measurement and Capital Standards: a Revised Framework — Updated November 2005. http://www.bis.org/publ/bcbs118.pdf
Basel Committee on Banking Supervision (BCBS) (2005b), Studies on the Validation of Internal Rating Systems — revised version May 2005, Working Paper No. 14. http://www.bis.org/publ/bcbs_wp14.pdf
Brier G (1950), Verification of Forecasts expressed in Terms of Probability, Monthly Weather Review, Vol. 78, No. 1, pp. 1–3.
DeGroot M, Fienberg S (1983), The Comparison and Evaluation of Forecasters, The Statistician, Vol. 32, pp. 12–22.
Finger C (2001), The One-Factor CreditMetrics Model in The New Basle Capital Accord, RiskMetrics Journal, Vol. 2(1), pp. 9–18.
Hamerle A, Liebig T, Rösch D (2003), Benchmarking Asset Correlation, Risk, November, pp. 77–81.
Hosmer D, Lemeshow S, Klar J (1988), Goodness-of-Fit Testing for Multiple Logistic Regression Analysis when the estimated Probabilities are small, Biometrical Journal, Vol. 30, pp. 911–924.
Murphy A, Daan H (1985), Forecast Evaluation, in: Murphy A, Katz R (eds.), Prob-ability, Statistics, and Decision Making in the Atmospheric Sciences, Westview Press, Boulder, pp. 379–438.
Redelmeier DA, Bloch DA, Hickman DH (1991), Assessing Predictive Accuracy: How to compare Brier Score, Journal of Clinical Epidemiology, Vol. 44, No. 11, pp. 1141–1146.
Scheule H, Rauhmeier R (2005), Rating Properties and their Implication on Basel II-Capital, Risk, March, pp.78–81.
Sobehart JR, Keenan SC (2001), Measuring Default Accurately, Risk, pp. S31–S33.
Sobehart JR, Keenan SC, Stein RM (2000), Benchmarking Quantitative Default Risk Models: A Validation Methodology, Moody’s Investors Service.
Somers R (1962), A New Asymmetric Measure of Association for Ordinal Variables, American Sociological Review, 27, pp. 799–811.
Spiegelhalter D (1986), Probabilistic Prediction in Patient Management and Clinical Trails, Statistics in Medicine, Vol. 5, pp. 421–433.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer Berlin · Heidelberg
About this chapter
Cite this chapter
Rauhmeier, R. (2006). PD-Validation — Experience from Banking Practice. In: Engelmann, B., Rauhmeier, R. (eds) The Basel II Risk Parameters. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-33087-9_14
Download citation
DOI: https://doi.org/10.1007/3-540-33087-9_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33085-1
Online ISBN: 978-3-540-33087-5
eBook Packages: Business and EconomicsEconomics and Finance (R0)