# Multi-level emulation of complex climate model responses to boundary forcing data

- 67 Downloads

## Abstract

Climate model components involve both high-dimensional input and output fields. It is desirable to efficiently generate spatio-temporal outputs of these models for applications in integrated assessment modelling or to assess the statistical relationship between such sets of inputs and outputs, for example, uncertainty analysis. However, the need for efficiency often compromises the fidelity of output through the use of low complexity models. Here, we develop a technique which combines statistical emulation with a dimensionality reduction technique to emulate a wide range of outputs from an atmospheric general circulation model, PLASIM, as functions of the boundary forcing prescribed by the ocean component of a lower complexity climate model, GENIE-1. Although accurate and detailed spatial information on atmospheric variables such as precipitation and wind speed is well beyond the capability of GENIE-1’s energy-moisture balance model of the atmosphere, this study demonstrates that the output of this model is useful in predicting PLASIM’s spatio-temporal fields through multi-level emulation. Meaningful information from the fast model, GENIE-1 was extracted by utilising the correlation between variables of the same type in the two models and between variables of different types in PLASIM. We present here the construction and validation of several PLASIM variable emulators and discuss their potential use in developing a hybrid model with statistical components.

## Keywords

Probabilistic prediction Multi-level emulators Model hierarchy Spatio-temporal data Intermediate complexity model## Supplementary material

## References

- Barnett TP, Latif M, Graham N, Flugel M, Pazan S, White W (1993) ENSO and ENSO-related predictability. Part I: Prediction of equatorial Pacific Sea surface temperature with a hybrid coupled ocean–atmosphere model. J Clim 6(8):1545–1566CrossRefGoogle Scholar
- Barnett TP, Preisendorfer R (1987) Origins and levels of monthly and seasonal forecast skill for United states furface air temperature determined by canonical correlation analysis. Mon Weather Rev 115(9):1825–1850CrossRefGoogle Scholar
- Bastos LS, O’Hagan A (2009) Diagnostics for Gaussian process emulators. Technometrics 51(4):425–438CrossRefGoogle Scholar
- Bayarri MJ, Berger JO, Cafeo J, Garcia-Donato G, Liu F, Palomo J, Parthasarathy RJ, Paulo R, Sacks J, Walsh D (2007) Computer model validation with functional output. Ann Stat 35(5):1874–1906. https://doi.org/10.1214/009053607000000163 CrossRefGoogle Scholar
- Boukouvalas A, Cornford D (2009) Dimension reduction for multivariate emulation. Tech. Rep. November 2009, Aston University, BirminghamGoogle Scholar
- Bounceur N, Crucifix M, Wilkinson RD (2015) Global sensitivity analysis of the climate-vegetation system to astronomical forcing: an emulator-based approach. Earth Syst Dyn 6(1):205–224CrossRefGoogle Scholar
- Challenor PG, McNeall D, Gattiker J (2010) Assessing the probability of rare climate events. In: O’Hagan A, West M (eds) The Oxford handbook of applied bayesian analysis. Oxford University Press, New York, pp 403–430 chap 16Google Scholar
- Cimatoribus AA, Drijfhout SS, Dijkstra HA (2012) A global hybrid coupled model based on atmosphere-SST feedbacks. Clim Dyn 38(3–4):745–760CrossRefGoogle Scholar
- Conti S, O’Hagan A (2010) Bayesian emulation of complex multi-output and dynamic computer models. J Stat Plann Inference 140(3):640–651CrossRefGoogle Scholar
- Cook RD, Nachtsheim CJ (1980) A comparison of algorithms for constructing exact D-optimal designs. Technometrics 22:315–324CrossRefGoogle Scholar
- Edwards NR, Marsh R (2005) Uncertainties due to transport-parameter sensitivity in an efficient 3-D ocean-climate model. Clim Dyn 24(4):415–433CrossRefGoogle Scholar
- Edwards NR, Cameron D, Rougier J (2011) Precalibrating an intermediate complexity climate model. Clim Dyn 37(7–8):1469–1482CrossRefGoogle Scholar
- Foley AM, Holden PB, Edwards NR, Mercure JF, Salas P, Pollitt H, Chewpreecha U (2016) Climate model emulation in an integrated assessment framework: a case study for mitigation policies in the electricity sector. Earth Syst Dyn 7(1):119–132CrossRefGoogle Scholar
- Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc A Math Phys Eng Sci 463(2088):3251–3269CrossRefGoogle Scholar
- Fraedrich K (2012) A suite of user-friendly global climate models: hysteresis experiments. Eur Phys J Plus 127(5):53CrossRefGoogle Scholar
- Fraedrich K, Jansen H, Kirk E, Luksch U, Lunkeit F (2005) The planet simulator: towards a user friendly model. Meteorol Z 14(3):299–304CrossRefGoogle Scholar
- Geil KL, Zeng X (2015) Quantitative characterization of spurious numerical oscillations in 48 CMIP5 models. Geophys Res Lett 42(12):5066–5073. https://doi.org/10.1002/2015GL063931 CrossRefGoogle Scholar
- Haberkorn K, Sielmann F, Lunkeit F, Kirk E, Schneidereit A, Fraedrich K (2009) Planet simulator climate. Tech. rep., Meteorologisches Institut, Universität HamburgGoogle Scholar
- Hardoon DR, Szedmak S, Shawe-Taylor J (2004) Canonical correlation analysis; an overview with application to learning methods. Neural Comput 16(12):2639–2664CrossRefGoogle Scholar
- Higdon D, Gattiker J, Williams B, Rightley M (2008) Computer model calibration using high-dimensional output. J Am Stat Assoc 103(482):570–583CrossRefGoogle Scholar
- Holden PB, Edwards NR, Garthwaite PH, Wilkinson RD (2015) Emulation and interpretation of high-dimensional climate model outputs. J Appl Stat 42(9):2038–2055CrossRefGoogle Scholar
- Holden PB, Edwards NR (2010) Dimensionally reduced emulation of an AOGCM for application to integrated assessment modelling. Geophys Res Lett 37(21): L21707CrossRefGoogle Scholar
- Holden PB, Edwards NR, Oliver KIC, Lenton TM, Wilkinson RD (2010) A probabilistic calibration of climate sensitivity and terrestrial carbon change in GENIE-1. Clim Dyn 35(5):785–806CrossRefGoogle Scholar
- Holden PB, Edwards NR, Müller SA, Oliver KIC, Death RM, Ridgwell A (2013) Controls on the spatial distribution of oceanic d13CDIC. Biogeosciences 10(3):1815–1833. https://doi.org/10.5194/bg-10-1815-2013 CrossRefGoogle Scholar
- Holden PB, Edwards NR, Garthwaite PH, Fraedrich K, Lunkeit F, Kirk E, Labriet M, Kanudia A, Babonneau F (2014) PLASIM-ENTSem v1.0: a spatio-temporal emulator of future climate change for impacts assessment. Geosci Model Dev 7(1):433–451CrossRefGoogle Scholar
- Holden PB, Edwards NR, Fraedrich K, Kirk E, Lunkeit F, Zhu X (2016) PLASIM GENIE v1.0: a new intermediate complexity AOGCM. Geosci Model Dev 9:3347–3361. https://doi.org/10.5194/gmd-9-3347-2016 CrossRefGoogle Scholar
- Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13CrossRefGoogle Scholar
- Kennedy MC, O’Hagan A (2001) Bayesian calibration of computer models. J R Stat Soc Ser B (Stat Methodol) 63(3):425–464CrossRefGoogle Scholar
- La Lee, Carslaw KS, Pringle KJ, Mann GW (2012) Mapping the uncertainty in global CCN using emulation. Atmos Chem Phys 12(20):9739–9751CrossRefGoogle Scholar
- Labriet M, Joshi SR, Vielle M, Holden PB, Edwards NR, Kanudia A, Loulou R, Babonneau F (2015) Worldwide impacts of climate change on energy for heating and cooling. Mitig Adapt Strat Glob Chang 20(7):1111–1136CrossRefGoogle Scholar
- Lenton TM, Williamson MS, Edwards NR, Marsh R, Price aR, Ridgwell aJ, Shepherd JG, Cox SJ (2006) Millennial timescale carbon cycle and climate change in an efficient Earth system model. Clim Dyn 26(7–8):687–711CrossRefGoogle Scholar
- Liakka J, Nilsson J, Lofverstrom M (2012) Interactions between stationary waves and ice sheets: linear versus nonlinear atmospheric response. Clim Dyn 38(5–6):1249–1262CrossRefGoogle Scholar
- Loeppky JL, Sacks J, Welch WJ (2009) Choosing the sample size of a computer experiment: a practical guide. Technometrics 51(4):366–376CrossRefGoogle Scholar
- Lucarini V, Fraedrich K, Lunkeit F (2010) Thermodynamic analysis of snowball earth hysteresis experiment: efficiency, entropy production and irreversibility. Q J R Meteorol Soc 136(646):2–11. https://doi.org/10.1002/qj.543 CrossRefGoogle Scholar
- Lunt DJ, Williamson MS, Valdes PJ, Lenton TM, Marsh R (2006) Comparing transient, accelerated, and equilibrium simulations of the last 30,000 years with the GENIE-1 model. Clim Past 2(2):221–235CrossRefGoogle Scholar
- Maniyar DM, Cornford D, Boukouvalas A (2007) Dimensionality reduction in the emulator setting. Tech. Rep. October 2007, Neural Computing research group. Aston University, BirminghamGoogle Scholar
- Mardia KV, Marshall RJ (1984) Maximum likelihood estimation of models for residual covariance in spatial regression. Biometrika 71(1):135–146CrossRefGoogle Scholar
- Marsh R, Sa Müller, Yool A, Edwards NR (2011) Incorporation of the C-GOLDSTEIN efficient climate model into the GENIE framework: “eb_go_gs” configurations of GENIE. Geosci Model Dev 4(4):957–992CrossRefGoogle Scholar
- Matthews HD, Caldeira K (2007) Transient climate-carbon simulations of planetary geoengineering. Proc Nat Acad Sci USA 104(24):9949–54CrossRefGoogle Scholar
- Mcneall DJ (2008) Dimension reduction in the Bayesian analysis of a numerical climate model. PhD Thesis, University of SouthamptonGoogle Scholar
- Morris MD, Mitchell TJ (1995) Exploratory designs for computational experiments. J Stat Plann Inference 43:381–402CrossRefGoogle Scholar
- Oa Saenko, Schmittner A, Weaver AJ (2004) The Atlantic Pacific seesaw. J Clim 17(11):2033–2038. https://doi.org/10.1175/1520-0442(2004)017%3c2033:TAS%3e2.0.CO;2 CrossRefGoogle Scholar
- Oakley JE, O’Hagan A (2004) Probabilistic sensitivity analysis of complex models: a Bayesian approach. J R Stat Soc Ser B (Stat Methodol) 66(3):751–769. https://doi.org/10.1111/j.1467-9868.2004.05304.x CrossRefGoogle Scholar
- Osborne JW, Costello AB (2009) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pan Pac Manag Rev 12(2):131–146Google Scholar
- Peltier W (2004) Global glacial isostasy and the surface of the ice-age earth: the ICE-5G (VM2) model and GRACE. Annu Rev Earth Planet Sci 32(1):111–149CrossRefGoogle Scholar
- Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press, CambridgeGoogle Scholar
- Richman MB (1986) Rotation of principal components. J Climatol 6(3):293–335CrossRefGoogle Scholar
- Romanova V, Lohmann G, Grosfeld K, Butzin M (2006) The relative role of oceanic heat transport and orography on glacial climate. Quatern Sci Rev 25(7–8):832–845CrossRefGoogle Scholar
- Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423CrossRefGoogle Scholar
- Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer, New YorkCrossRefGoogle Scholar
- Schmittner A, Silva TAM, Fraedrich K, Kirk E, Lunkeit F (2011) Effects of mountains and ice sheets on global ocean circulation. J Clim 24(11):2814–2829CrossRefGoogle Scholar
- Stocker TF, Johnsen SJ (2003) A minimum thermodynamic model for the bipolar seesaw. Paleoceanography 18(4):1087. https://doi.org/10.1029/2003PA000920 CrossRefGoogle Scholar
- Syu HH, Neelin DJ, Gutzler D (1995) Seasonal and interannual variability in a hybrid coupled GCM. J Clim 8:2121–2143CrossRefGoogle Scholar
- Thompson SL, Warren SG (1982) Parameterization of outgoing infrared radiation derived from detailed radiative calculations. J Atmos Sci 39:2667–2680CrossRefGoogle Scholar
- Tran GT (2017) Developing a multi-level gaussian process emulator of an atmospheric general circulation model for palaeoclimate modelling. PhD Thesis, University of SouthamptonGoogle Scholar
- Tran GT, Oliver KIC, Sobester A, Toal DJJ, Holden PB, Marsh R, Challenor PG, Edwards NR (2016) Building a traceable climate model hierarchy with multi-level emulators. Adv Stat Climatol Meteorol Oceanogr 2(1):1–21CrossRefGoogle Scholar
- Weaver AJ, Eby M, Wiebe EC, Bitz CM, Duffy PB, Ewen TL, Fanning AF, Holland MM, Macfadyen A, Matthews HD, Meissner KJ, Saenko O, Schmittner A, Wang H, Masakazu Y (2001) The UVic earth system climate model: model description, climatology, and applications to past, present and future climates. Atmos Ocean 39(4):361–428CrossRefGoogle Scholar
- Wilkinson RD (2010) Bayesian calibration of expensive multivariate computer experiments. In: Biegler L, Biros G, Ghattas O, Heinkenschloss M, Keyes D, Mallick B, Marzouk Y, Tenorio L, Waanders BB, Willcox K (eds) Computational methods for large-scale inverse problems and quantification of uncertainity. Wiley, Chichester chap 10Google Scholar
- Williamson M, Lenton T, Shepherd J, Edwards N (2006) An efficient numerical terrestrial scheme (ENTS) for Earth system modelling. Ecol Model 198(3–4):362–374CrossRefGoogle Scholar
- Williamson D, Blaker AT, Hampton C, Salter J (2015) Identifying and removing structural biases in climate models with history matching. Clim Dyn 45(5–6):1299–1324. https://doi.org/10.1007/s00382-014-2378-z CrossRefGoogle Scholar