A Generic Method for Density Forecasts Recalibration

  • Jérôme Collet
  • Michael RichardEmail author
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 254)


We address the calibration constraint of probability forecasting. We propose a generic method for recalibration, which allows us to enforce this constraint. It remains to be known the impact on forecast quality, measured by predictive distributions sharpness, or specific scores. We show that the impact on the Continuous Ranked Probability Score (CRPS) is weak under some hypotheses and that it is positive under more restrictive ones. We used this method on temperature ensemble forecasts and compared the quality of the recalibrated forecasts with that of the raw ensemble and of a more specific method, that is Ensemble Model Output Statistics (EMOS). Better results are shown with our recalibration rather than with EMOS in this case study.


Density forecasting Rosenblatt transform PIT series Calibration Bias correction 



This research was supported by the ANR project FOREWER (ANR-14-CE05-0028).


  1. 1.
    S. Ben Taieb, R. Huser, R.J. Hyndman, M.G. Genton, Forecasting uncertainty in electricity smart meter data by boosting additive quantile regression. IEEE Trans. Smart Grid 7, 2448–2455 (2016)CrossRefGoogle Scholar
  2. 2.
    J. Bröcker, Reliability, sufficiency, and the decomposition of proper scores. Q. J. R. Meteorol. Soc. (2009). Scholar
  3. 3.
    V. Corradi, N.R. Swanson, Predictive density evaluation, in Handbook of Economic Forecasting ed. by G. Elliott, C.W.J. Granger, A. Timmermann (Elsevier, Amsterdam, 2006), pp. 197–284Google Scholar
  4. 4.
    V. Fortin, A.-C. Favre, M. Said, Probabilistic forecasting from ensemble prediction systems: improving upon the best-member method by using a different weight and dressing kernel for each member. Q. J. R. Meteorol. Soc. (2006). Scholar
  5. 5.
    T. Gneiting, Calibration of medium-range weather forecasts, Technical Memorandum, European Centre for Medium-Range Weather Forecasts. (2014)
  6. 6.
    T. Gneiting, M. Katzfuss, Probabilistic forecasting. Annu. Rev. Stat. Appl. (2014). Scholar
  7. 7.
    T. Gneiting, A.E. Raftery, A.H. Westveld III, T. Goldman, Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Mon. Weather Rev. (2005). Scholar
  8. 8.
    T. Gneiting, F. Balabdaoui, A.E. Raftery, Probabilistic forecasts, calibration and sharpness. J. R. Stat. Soc. Ser. B (Stat. Methodol.) (2007). Scholar
  9. 9.
    A. Gogonel, J. Collet, A. Bar-Hen, Improving the calibration of the best member method using quantile regression to forecast extreme temperatures. Nat. Hazards Earth Syst. Sci. (2013). Scholar
  10. 10.
    H. Hersbach, Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather Forecast. (2000).<0559:DOTCRP>2.0.CO;2
  11. 11.
    R. Krzysztofowicz, Bayesian processor of output: a new technique for probabilistic weather forecasting, in 17th Conference on Probability and Statistics in the Atmospheric Sciences (American Meteorological Society, 2004).
  12. 12.
    P.-A. Michelangeli, M. Vrac, H. Loukos, Probabilistic downscaling approaches: application to wind cumulative distribution functions. Geophys. Res. Lett. (2009).
  13. 13.
    D.S. Wilks, Statistical Methods in the Atmospheric Sciences. International Geophysics Series ed. by D.S. Wilks, vol. 100 (Academic Press, Cambridge, 2011)Google Scholar
  14. 14.
    D.S. Wilks, Enforcing calibration in ensemble postprocessing. Q. J. R. Meteorol. Soc. (2017). Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.EdF R&DPalaiseauFrance
  2. 2.University of OrléansOrléansFrance

Personalised recommendations