1 Introduction

Climate models are an important tool in simulating the responses of the Earth’s climate system to the emissions of greenhouse gases (GHGs) and atmospheric aerosols that are critical for shaping future climate. Many centers around the world are currently developing their own models and are contributing to the activities of the Intergovernmental Panel on Climate Change (IPCC). Through internationally coordinated model comparison projects such as the coupled model inter-comparison project (CMIP), many modeling groups have developed coupled models including from simple conceptual ones to highly advanced ones that cover the entire Earth system. Reichler and Kim (2008) suggested that the performance of climate models has improved in each generation of the CMIP. Since the IPCC Fourth Assessment Report (hereafter AR4), a number of improvements have been introduced to climate models in their resolutions, parameterizations of various physical processes, and additional components of the Earth system. The IPCC Fifth Assessment Report (AR5) (IPCC 2014) indicates that a number of current state-of-the-art models include various components of the Earth system to result in significant progresses in simulating the physical, chemical, and biogeochemical components of Earth systems. Models use numerical representations of complex processes in the climate system. These representations depend on the assumptions and methods used in the model and are sources of inherent internal variability and diverse responses to external climate forcing. According to FAQ 12.1 in AR5, various numerical representations for climate models result in inter-model spreads; however, these differences are acceptable since they allow us to estimate the range of uncertainties in multi-model ensemble climate projections. The multi-model ensemble approach has become a standard technique in projecting future climate (AR5, chapter 12).

The National Institute of Meteorological Sciences/Korea Meteorological Administration (NIMS/KMA) has been participating in CMIP experiments under the framework of the IPCC. There have been many efforts in the scientific community to assess the observed climate change, to develop measures to enhance understanding of it, and to secure the capacity for projecting future climate change. In this context, NIMS/KMA has developed the KMA Advanced Community Earth (K-ACE) model, a coupled atmosphere-ocean-land model created via KMA-Met Office collaboration for climate research. This paper presents general descriptions of the K-ACE model including the coupling strategy, as well as the evaluations of the model’s performance in simulating key climate fields assessed in a multi-decadal present-day simulation. The following sections provide descriptions of the model components, experimental design for the present-day experiment, and the results from their evaluations.

2 Model Description

The Earth System Model, as common used climate community, refers to the interacting composition of physical climate system along with the physical, biological and chemical processes (Flato 2011). The KMA’s Advanced Community Earth system (K-ACE) model was developed by coupling with each component of Earth System Model which has well represented biogeochemical processes. Compositions of K-ACE are the UM (Unified Model of UK Met Office; Walters et al. 2017), MOM (Modular Ocean Model of GFDL; Griffies et al. 2007), CICE (Sea Ice model of Los Alamos; Hunke et al. 2015), and the OASIS3-MCT coupler (Craig et al. 2017; Valcke et al. 2015). Sea ice is generally known to affect the heat and moisture exchanges between the atmosphere and ocean. Our coupling approach takes this feature: sea ice model is directly coupled to the atmosphere and ocean layers and acts as an intervening layer that moderates the heat and moisture fluxes between the atmosphere and ocean. The following subsections describe the main features of each component model and of the coupler.

2.1 Atmospheric Component

The Unified Model (UM) in the Global Atmosphere 7.1 configuration, the latest optimal configuration for use in both weather and climate predictions (Walters et al. 2017; hereafter GA7.1), is the atmospheric component of the K-ACE model. The model solves a set of non-hydrostatic and fully compressible governing equations for atmospheric motions on a regular latitude-longitude grid nest in the horizontal and on a hybrid grid in the vertical (Wood and Mason 1993; Wood et al., 2014). The main prognostic variables include three-dimensional wind, virtual dry potential temperature, and moisture variables related to water phases. The dependent variables are staggered horizontally using the Arakawa C-grid (Arakawa and Lamb 1977) and vertically using the Charney-Phillips grid (Charney and Phillips 1953).

A new dynamics scheme, the Even Newer Dynamics for General atmospheric modeling of the environment (ENDGame, Wood et al. 2014), is implemented for faster and more efficient model integrations. The scheme solves the advection equation using a semi-Lagrangian advection for dependent model variables. In order to ensure local conservation of key conservative quantities, the model uses a shape-conserving advection scheme, the Semi-Lagrangian Inherently Conserving and Efficient (SLICE), to advect mass and tracers. Atmospheric radiative transfer is calculated using the radiation scheme, Suite Of Community RAdiative Transfer codes based on Edwards and Slingo SOCRATES (Edwards and Slingo 1996) that features correlated-k coefficients (Rothman et al. 2013) for 81 gas species. Tropospheric aerosols are calculated using the GLObal Model of Aerosol Processes (Mann et al. 2010; Bellouin et al. 2011, 2013) that considers the number concentration, size distribution, composition, and optical properties of aerosols based on the aerosol microphysics and chemistry. Atmospheric convection is calculated using a mass-flux-based scheme that transports heat, momentum, and moisture by the sub-grid scale processes within a grid box (Gregory and Rowntree 1990) with a modified closure based on the convective available potential energy (CAPE) as in Fritsch and Chappell (1980). Shallow convections are calculated using a scheme based on the Grant method (Grant 2001) in conjunction with the convective momentum transport (CMT).

2.2 Ocean and Sea Ice Component

The Modular Ocean Model (MOM) in the K-ACE model was developed at the Geophysical Fluid Dynamics Laboratory (GFDL)/ the National Oceanic and Atmospheric Administration (NOAA). It solves the hydrostatic non-Boussinesq primitive equations for the resolvable-scale processes within the ocean with sub-grid scale parameterizations (Griffies et al. 2011), and can handle multiple global orthogonal curvilinear grids; a tripolar grid is used in the K-ACE model to eliminate a polar singularity near the Arctic (Murray 1996). Prognostic variables such as ocean currents, potential temperatures, and salinity are staggered horizontally on an Arakawa-B grid.

A traditional depth-based vertical coordinate is chosen because it allows the conservation of the ocean volume. The model splits the primitive equations into a faster barotropic and a slower baroclinic mode to integrate in a time-split manner using a predictor-corrector scheme in which the time tendencies for the pressure gradient and tracer advection, lateral tracer, and velocity mixings are integrated in forward time stepping. The use of forward time stepping instead of the more traditional leap-frog scheme, makes time filtering steps (e.g., the Robert-Asselin filter) unnecessary for ensuring numerical stability, and in turn allows discrete and exact conservation of tracers. A third-order Adams–Bashforth scheme is used to advect all prognostic model variables except tracers. The multi-dimensional flux-limited scheme adapted from the global climate model from the Massachusetts Institute of Technology, is used to advect tracers to ensure monotonicity and efficiency in this configuration.

An external mode solver is used to deal with the explicit free surface of the model. The volumes of the top model grid cells are time-dependent for conservation of the fresh water budget at the atmosphere–ocean interface. In addition, the salinity flux from sea ice is used directly instead of an estimated virtual one that is proportional to the fresh water input. Neutral tracer diffusion and Gent–McWilliams stirring are implemented to diffuse neutral tracers. The K-profile parameterization scheme (Large et al. 1994, 2001) is used for vertical mixing and the Smagorinsky viscosity scheme (Griffies and Hallberg 2000) with the anisotropic biharmonic operator is used for the horizontal diffusion. To diffuse tracers along topography, a sigma-diffusion (Beckmann and Döscher 1997; Döscher and Beckmann 1999) is used with enhanced diffusion for weakly stratified environments.

The Los Alamos sea ice model (CICE) version 5.1.2 (Hunke et al. 2015) in the K-ACE model was developed by the members of the community climate system model polar climate working group and by the researchers at the UK Met Office Hadley Centre. The model predicts the spatiotemporal evolution of the ice thickness distribution (ITD) (Thorndike et al. 1975). The sub-grid-scale ITD is modeled by dividing the ice pack at each grid point into several thickness categories (Bitz et al. 2001) and by calculating other physical properties such as the turbulent heat fluxes. When snowfall and the vertical conductive, radiation and turbulent fluxes are given, ice thermodynamics can compute the local growth or melting rates for the ice and snow layers. Ice dynamics determine the material strength of the ice and predict the velocity field of the ice pack. The area-conserving advection scheme is used to advect ice concentrations, volumes, enthalpies, and other state variables (Lipscomb and Hunke, 2004). The ridging parameterization for transferring ice between thickness categories, maintains the energetic balances and strain rates (Lipscomb et al. 2007).

2.3 Land Component

To simulate the land surface processes, the Joint UK Land Environment Simulator (JULES) in the Global Land 7.0 configuration (Walters et al. 2017; hereafter GL 7.0) has been employed. The JULES is coupled directly to the atmosphere model (UM) for calculating the surface energy balance, hydrological and carbon cycles, and soil variables in conjunction with dynamic vegetation process (Best et al. 2011). The model calculates surface temperatures on the land and sea ice surface. The carbon cycle is represented in terms of carbon fluxes, leaf and canopy photosynthesis, and stomatal conductance (Clark et al. 2011).

K-ACE uses a traditional tile approach (mosaic) widely used in land surface models (Essery et al. 2003); a total of nine plant functional types (PFTs) with five vegetated and four non-vegetated types are used to represent the sub-grid scale surface heterogeneity. Physiological parameters such as the maximum photosynthetic rate and the optimal temperature for photosynthesis are determined by land surface categorization, implying that an accurate categorization of surface type is critical for climate simulations.

Land surface types are classified using the Land Use Harmonization data v2 (LUHv2; Lawrence et al. 2016); the land cover data from the Max Planck Institute for Meteorology (Pongratz et al. 2008) are used where the former is insufficient. The soil hydrological parameters are taken from the Harmonized World Soil Database (FAO/IIASA/ISRIC/ISS-CAS/JRC 2009). The plant canopy height is provided from the Global Soil Data Task (2000).

2.4 Coupling the Components

The K-ACE model is coupled using the OASIS3-MCT coupler (Valcke et al. 2013, 2015) which has advanced features for improved parallelization and coupling of high resolution and multivariate exchanges (Craig et al. 2017). While the atmospheric model uses a regular latitude-longitude grid, the ocean and sea ice models use a tripolar grid. For long-term simulations, these models are coupled using a Spherical Coordinate Remapping and Interpolation Package (SCRIP) conservative remapping method so that heat and freshwater can be exchanged in a conserving manner (Hewitt et al. 2011). The sea ice model is in the center of coupling structure (only for ocean grids), acting as an intervening layer between the atmosphere and ocean. The sea ice model receives all of the coupling fields (Tables 1, 2 for the atmosphere and the ocean models, respectively) from the atmosphere and the ocean models to update the fields with the latest state of the ice. The updated variables are then used to integrate the ice model. The updated states are returned to the atmosphere and the ocean models for the next time integration. Refer to Fig. 1, for the coupling structure. The superscript “a” denotes a variable defined on the atmospheric model grid, and the variables without a superscript denote variables defined on either the ocean or the sea ice grids; of these, the horizontal grids are identical in the coupling system. The subscript “n” with the parenthesis denotes the sea ice depth category. The angled brackets denote a grid box mean value; otherwise, the latter is local or averaged only over the sea ice.

Table 1 Variables from the atmosphere coupled to the sea ice
Table 2 Variables from the ocean coupled to the sea ice
Fig. 1
figure 1

Flow chart of simplified coupling process of K-ACE

For the exchanges between the atmosphere and the sea ice models, the atmosphere and sea ice models utilize different grids, and thus model variables are transformed from one grid to the other grid using conservative or bilinear interpolation methods. All the scalar variables except wind stress are interpolated using a conservative remapping which conserves the global total the variable. The wind stress is remapped using the bilinear interpolation as it is not a critical quantity for the conservation of heat and moisture in a coupled system. The exchange frequency is set to three hours, so all variables are in three-hour averages.

The coupling variables from the ice to the atmosphere and ocean are listed in Tables 3 and 4, respectively. During integrations, the sea ice model computes and updates the ice state, and passes all coupling variables to the ocean model after updating them with the recently updated sea ice state. The equation for heat flux to the ocean is similar to the equation for the surface heat budget used to determine SST: the shortwave radiation and snowfall are added to the terms from the atmosphere with the updated ice state. The additional subscripts for shortwave radiation denote visible direct (vr), visible diffusive (vf), near infrared (IR) direct (nr), and near IR diffusive (nf) components (Table 4); these are necessary because the sea ice model partitions shortwave radiation into its constituent components using empirical weights. The two visible components are used for penetrative ocean heating and biogeochemistry, and the selection of the empirical weights affect the ocean vertical structure and circulation. The calving, or frozen runoff, is not considered yet but is reserved for future analysis.

Table 3 Variables from the sea ice coupled to the atmosphere
Table 4 Variables from the sea ice coupled to the ocean

However, the momentum, freshwater, and heat fluxes exchanges from the atmosphere to the ocean are directly coupled in outside of sea ice area. The component of heat exchanges (turbulent fluxes) provided from the atmosphere is coupling interval time-mean values. Also, the component of rain, snow and river input provide freshwater to the ocean and evaporation take freshwater away from the ocean (Hewitt., et al. 2011).

3 Experimental Design

To evaluate the performance of the coupled K-ACE model, focus on coupling performances in mean climatology, with a K-ACE model simulation was performed using the present-day climatological forcing. The K-ACE results are then compared against suitable observations and CMIP5 model outputs for evaluating the absolute errors and the performance of K-ACE relative to the CMIP5 models, respectively, in simulating key Earth system fields. For the initialization of this experiment, a two-step strategy is adopted to achieve model equilibrium. First, the atmospheric initial state is based on the initial estimate of equilibrium states from a CMIP6 pre-industrial simulation using Met Office Unified Model (thousand year of model time for spin-up). Also, the ocean component is initialized using a standard practice of the Coordinated Ocean-ice Reference Experiments (COREs) phase 2 which is useful design of the baseline experiment set for more comprehensive model or research program (Griffies et al. 2009).

In the second step (spin-up), the coupled model is forced with fixed external forcing specified for the present-day period. The ocean circulation takes thousands of years of model time to reach its equilibrium state in a coupled system; however, the upper several hundred meters of the ocean may approach to an equilibrium state within several decades with fixed forcing. Based on this hypothesis, the present-day experiment was performed for 80 years: the first 60-year integration was for a spin-up, and the subsequent 20-year integration was used for the model evaluation in this study. In 80-year integration, the final trend of surface air temperature is less than 0.04 K/century and energy budget trend at the top of the atmosphere (TOA) is −0.30Wm−2/century (not shown). It means that the K-ACE shows a small positive imbalance in present-day experiment. However, this trend rates may be modest in comparison with CMIP3 models, where the median-trend is approximately 0.12 K/century (Sen Gupta et al. 2012), to evaluate mean climate state from K-ACE simulation.

For the external forcing specified from present-day mean climatology, 11-year mean forcing from 1999 to 2009 obtained by averaging the anthropogenic and natural climatological factors such as the greenhouse gases, aerosols, vegetation fractions, volcanic optical thickness, solar variability, and ozone concentration using input4MIP in CMIP6 (Meinshausen et al. 2017) was used to assess only the climatology and intrinsic variability. Meinshausen et al. (2017) suggests that the models handle only some portions of the entire GHG fraction, thus modifying the concentrations of the top five gases that the net radiative effect is equivalent to all of the GHGs. In this experiment, the concentrations of CO2, CH4, N2O, CFC-12, and HFC-134a equivalent are set to 376.021 ppm, 1783.63 ppb, 318.139 ppb, 1052.68 ppt, and 137.315 ppt, respectively. The concentrations are converted into mass mixing ratios before use because the model only accepts GHGs in that format.

4 Results

4.1 General Model Performance

4.1.1 Energy Budget at the Top of the Atmosphere

The radiation budget of the Earth is fundamental for the changes and maintenance of the climate system. The global radiative fluxes at the TOA and the surface are estimated. Figure 2 presents the annual-mean distribution of the absorbed solar radiation (ASR), outgoing longwave radiation (OLR), and net downward radiation at the TOA for the 10-year period 2001–2010. Because of the short period of the observed data, the 20-year model climatology is compared against the 10-year observational climatology. The ASR is calculated as the incoming shortwave radiation minus the outgoing shortwave radiation, and the net downward radiation is the difference between the ASR and OLR. The observations came from the Clouds and the Earth’s Radiant Energy System (CERES) Energy Balanced and Filled (EBAF) Edition4A data set for the period from 2001 to 2010 (Smith et al. 2004; Loeb et al. 2009). The zonal pattern of the bias is similar to those found in Raschke et al. (2005) and Mlynczak et al. (2011). The highest ASR is over the equatorial Pacific Ocean as in the observations, and is mainly due to low ocean albedo. There are large positive biases in the ASR over the coastal waters of Peru and in the Southern Hemisphere high latitudes. The OLR is generally underestimated (overestimated) in the high (low). Overall, the net down energy is overestimated and shows a somewhat large bias in the areas where the ASR biases are large and positive.

Fig. 2
figure 2

Annual-mean distribution (Unit: W m−2) of the ASR (Absorbed Solar Radiation: upper panels), OLR (Outgoing Longwave Radiation: central panels), and net down radiation (lower panels) at the TOA for the period 2001 to 2010. Each column indicates the result of K-ACE (left), CERES (center), and bias (right)

The simulated global annual mean of net radiation at the TOA and the CERES data are 1.5 and 0.8 W m−2, respectively (Table 5). Although the difference is not trivial, considering the uncertainties in the observations as well as the reanalysis of Trenberth et al. (2009), the energy balance of the model can be considered reasonably close to the observed value. However, the simulated Earth’s energy imbalance at the TOA is nearly outside the range of the observed global imbalances (Hansen et al. 2005).

Table 5 The global annual-mean radiation budget quantities at the TOA (Wm−2). The quantities were calculated for the downward (Solar in), reflected (Solar reflected), and absorbed solar radiations (ASR), outgoing longwave radiation (OLR), and net down radiation (Net)

4.1.2 Sea Ice Concentration

Sea ice, a product of interactions between the atmosphere and the ocean, controls the transfer of energy, mass, and momentum between these components. As noted in AR4, the primary sources of the biases in the simulated sea ice distributions include the biases in the SST, ocean heat advection, high-latitude winds, and solar energy. Evaluating the performance of the sea ice model requires accurate data on the ice concentration, velocity, snow cover, salinity, thickness, and other factors that are difficult to obtain at this time.

Arctic and Antarctic sea ice cover from the K-ACE and observations (more than 15%) is shown in Fig. 3. Observations are from the Hadley Centre Sea Ice and Sea Surface Temperature (HadISST) data set (Rayner et al. 2003). The bias in the simulated sea ice distribution is characterized by overestimation and underestimation of the sea ice cover in the Arctic and the Antarctic oceans, respectively, in their corresponding winter season (DJF for the Arctic and JJA for the Antarctic). Although the underestimation in the Antarctic ocean is also common in the CMIP5 models (Turner et al. 2013), the biases in the K-ACE simulation is very large; one possible cause is that the sea ice shelf flux around the Antarctica and the melting of icebergs are not considered in this sea ice model version. These two physical processes would contribute to reduce the sea surface temperature and vertical stratification of the Antarctic ocean, and eventually contribute to the increase of the Antarctic sea ice (Storkey et al. 2018). A parameterization including these effects is currently under development and is expected to be implemented in near future.

Fig. 3
figure 3

Averaged sea ice concentrations (%) in the Northern Hemisphere (upper panels) and Southern Hemisphere (lower panels) during summer (left) and winter (right) in the K-ACE 20-year simulation. The red lines indicate observed sea ice concentrations from HadISST data which is based on 15% concentration boundaries for the period 1996 to 2015

4.2 Atmospheric and Surface Climatology

A number of observation data sets are used in this study to evaluate the simulated surface climatology. The Climatic Research Unit TS 2.3 (CRU ts3.23) analysis data (Harris et al. 2014) are employed to evaluate the simulated surface air temperature. The Global Precipitation Climatology Project (GPCP) data (Adler et al. 2003) and the ERA-Interim MSLP data (Dee et al. 2011) are used to compare the simulated precipitation and the mean sea-level pressure, respectively. For each data field, a 20-year (1996 to 2015) mean value is used as the climatology for the present-day period.

4.2.1 Surface Air Temperature

Temperature is determined by the amount of solar radiation affected by clouds, surface heat flux, and energy transported by the atmosphere and oceans (IPCC 2014), making it one of the key variables for measuring overall model performance. The Taylor diagram (Taylor 2001) shows that the simulated spatial distribution of the temperature climatology compares well with observations with correlation of 0.99 and standardized deviation of 1.05 (Fig. 4).

Fig. 4
figure 4

Taylor diagram of the 20-year (1996–2015) surface climatology. Red/Blue/ Green markers represent the simulation field (surface air temperature, precipitation, and MSLP) evaluated against the observation data set which defined in Section 4.2. Black marker indicates the reference

The first row in Fig. 5 shows the 20-year averaged observed and simulated surface air temperatures with their biases compared to the CRU data set from 1996 to 2015. The spatial distribution simulated by the K-ACE compares well with the observations. In most regions, the simulated and observed temperatures agree within 3 K. Notable warm biases occur in northern Russia, northern India, central Africa, North America, South America, and Australia. The simulation also overestimates temperatures along the Pacific coastal area of the South America. There are noticeable cold biases in the Greenland and in northern Europe as well as in high elevation regions including major mountain ranges (the Rockies, the Andes, and the Alps) and the Tibetan plateau. The large biases appear mainly where the terrain slopes are large. The large biases might be due to the resolution of the model not being high enough to resolve the actual terrain within the model; this is also common in the CMIP5 models (IPCC 2014).

Fig. 5
figure 5

Annual mean surface (2 m) air temperature (K) (upper panels) and precipitation (mm/day) (lower panels) for 1996–2015: observation (CRU, GPCP; left), K-ACE (center), and bias (right)

4.2.2 Precipitation

The lower panel of Fig. 5 shows the observed (GPCP) and simulated annual-mean precipitation, with the biases (simulation – GPCP) for the same period. The model simulates the observed large-scale zonal distribution but notably overestimates precipitation in some tropical/subtropical regions including the western North Pacific, the Maritime Continent, the South Pacific Convergence Zone, and the western Indian Ocean with dry biases in most of Europe, eastern India, off the coast of the Central America, and the Amazon basin. The South Pacific Convergence Zone (SPCZ) extends too much to the east, resulting in a double inter-tropical convergence zone (ITCZ). The dry biases over the ocean area in the eastern Pacific and the eastern Atlantic coincide with the regions of significant upwelling. The general overestimation of precipitation over the Indo-Pacific warm-pool areas is broken by the underestimation over the latitudes covering much of the Indian monsoon region, from the Equator to the Himalayas, including the eastern Indian Ocean, Bay of Bengal, and most of India. The strong dry bias in the northeastern Brazil (the Amazon basin) occurs in the region strongly affected by the tropical monsoon. The model reproduces the observed precipitation pattern over land surfaces (the upper row in Fig. 5) in the Northern Hemisphere reasonably well (also shown in Fig. 4. with pattern correlation of 0.88 and standardized deviation of 1.18).

4.2.3 Pressure-Level Variables

The simulated mean sea-level pressure (MSLP) also shows good agreements with observations; the pattern correlation exceeds 0.95 with standardized deviation of 1.05 (Fig. 4.). All of the pressure-level variables except on the 850 hPa level (v850hPa, t850 hPa, and gph850hPa) show pattern correlations greater than 0.9 and standardized deviations close to unity (Fig. 6.). For the 850 hPa fields, the correlations vary widely depending on the variables from 0.69 to 0.95. The zonal wind (u) variations are especially well simulated with standardized deviation close to unity and correlation of 0.95. At the 500 and 200 hPa levels, the pattern correlations between the simulated and observed fields exceed 0.9 (>0.99 for the geopotential height and temperature) with standardized deviations close to 1 except for the 200 hPa temperatures for which standardized deviation is 1.6, much larger than for the other variables.

Fig. 6
figure 6

Taylor diagram of the pressure-level variables for global fields from K-ACE. Black/Gray/White markers represent pressure level variables at 850, 500, 200 hPa, respectively

4.2.4 Sea Surface Temperature

Figure 7 compares 20-year averaged HadISST (left) and the simulated climatological SST (center); the model biases (right) are also presented. The simulated SST distribution compares well with the observations, although large biases are found in several regions. Cold biases occur over most of the Northern Hemisphere oceans, especially near the Barents and Labrador Seas and the Atlantic subtropical gyre in the North Atlantic. The model also underestimates the observed SST in the Central Pacific and in the Sea of Okhotsk. There are warm biases most notable off the Pacific coast of Japan where the Kuroshio Current exists and in the western North Atlantic. Positive SST biases are also clear in and near the strong upwelling region of western tropical Africa and the tropical eastern Pacific off the coast of Peru. These biases are a common problem in most coupled atmosphere-ocean models (Richer and Xie 2008). In contrast, most of the Southern Ocean shows warm biases.

Fig. 7
figure 7

Annual mean sea surface temperature (K) of the observation (left), K-ACE (center), and bias (right) to the period 1996–2015

4.3 Comparison Against the CMIP5 Models

To evaluate the performance of the K-ACE model relative to the CMIP5 models, the skill of the K-ACE model, measured in terms of the pattern correlation between the observed and simulated fields, in simulating the key fields of the Earth system is compared with the corresponding skill of the CMIP5 models.

Figure 8 summarizes the pattern correlation between the simulated and observed in the K-ACE simulation (red) against the CMIP5 models (black). The performance of the K-ACE in simulating the spatial variations of the surface air temperature is similar to the CMIP5 model ensemble mean and is slightly below the CMIP5 model median. For precipitation, the pattern correlation of the CMIP5 models has much more wide spread than for the surface temperature. The K-ACE model outperforms most of the CMIP5 models with correlation higher than the ensemble-mean and the median of the CMIP5 models.

Fig. 8
figure 8

Pattern correlations between simulated and observed annual mean climatology for the period 1996 to 2005. The thick bold bars indicate the mean of CMIP5 models and the circle means median for CMIP5 models, while the red bars are for the K-ACE. On the x-axis, TAS and PR mean 2 m air temperature and precipitation, respectively

Additionally, the performance index given in Reichler and Kim (2008) which are composed with aggregated and normalized errors in 30 different key climate quantities (Table 6). The base period for the observations is 1990–2005 and the model data is compared against the present-day climate. To determine this index (performance index) for the K-ACE model, normalized error variance \( {E}_m^2 \) was calculated for each model in first step. The equation given below:

$$ {E}_m^2=\sum \limits_{n=1}^N\frac{{\left(\overline{S_n}-\overline{O_n}\right)}^2}{{\sigma_n}^2} $$

Where, \( \overline{S_n} \) is the simulated climatology for grid point (n), the over bar indicates averaging, and the subscript “m” denotes each model. \( \overline{O_n} \) is the observed climatology and σn2 is the inter-annual variance from the corresponding observations. Second, \( {E}_m^2 \) was scaled using ensemble to ensure the similar weight when combining their errors. The scaled equation as follows:

$$ {I}_m^2=\frac{E_m^2}{\overline{E_{Ens.}^2}} $$
Table 6 Climate variables and corresponding validation data. Those listed as ‘global’ or ‘ocean’ are single-level fields over their respective regions

The ensemble used in scaling is the present-day CMIP5 experiment. The final model performance index (I2) of the comparison between the K-ACE and the 29 CMIP5 models is presented in Fig. 9. A small value of index implies that the K-ACE model is closer to the observations for the corresponding variable. 17 climate variables in the evaluation of K-ACE simulation show medians below the 29 CMIP5 models; some climate variables (CLT, RSDS, RSUT, CRFST, V200, T200, PR, TAUU and TAUV) are much better simulated to be within the top 25% of the CMIP5 models. Moreover, the standard deviation of climate variables simulated by K-ACE is within the range of CMIP5 ensembles (not shown). This means that the K-ACE performance is comparable with CMIP5 model ensembles.

Fig. 9
figure 9

The performance indexes of the K-ACE and CMIP5 models. The bars indicate the spread of the models, the boxes indicate a 25~75% performance for the 29 models. The red bars indicate the median values and the blue dots indicate values for the K-ACE model. On the x-axis, chi and psi mean χ200 and ψ200, respectively

5 Summary and Discussion

This paper provides a general description of the first generation of KMA coupled model and the preliminary evaluation results from a climatological run of the model for the present day. The coupling structure is based on the role of sea ice in the climate system. The coupled model consists of the UM atmosphere model with JULES land model, MOM4p1 ocean and CICE sea ice models. The models are coupled using the OASIS3-MCT coupler. The model is evaluated using its simulation over the last 20 years out of 80 years to acquire an equilibrium state.

The surface air temperatures are well simulated with biases less than 3 K, except in the high latitudes. The simulated precipitation over the tropics captures the observed climatological characteristics well; however, a double ITCZ with an elongated southern branch that almost reaches the Central Pacific in the Southern Hemisphere, which is very common in other CMIP5 models, is still present. The mid-latitude precipitation has a wet bias in the eastern Asian monsoon band and in the North Atlantic. The positive SST biases off the coast of Peru and Western Sahara is considered to indicate that the coupled model underestimates coastal upwelling.

The simulated geographic distribution of the TOA radiation fluxes generally agrees with the observations. However, large regional biases appeared, particularly in the high latitudes of the Southern Hemisphere, where Antarctic sea ice is prevalent throughout the year. The model underestimates the Antarctic sea ice cover and, as a result, underestimates albedo to overestimate net radiation. The large biases may be attributed to the warm bias in the SST and the formation of less sea ice over the Antarctic Ocean which results from complex interactions between the atmosphere, ocean, and sea ice models.

Sea ice formation and maintenance is dependent on the SST. The cold (warm) bias in the Northern (Southern) Hemisphere resulted in overestimation (underestimation) of Arctic (Antarctic) sea ice. Although it has been reported that the negative sea ice bias in the Southern Hemisphere is common in the other CMIP5 models (Shu et al. 2015), the bias in the K-ACE simulation is even larger than other CMIP5 models. Therefore, research to identify the cause and improve the sea ice statistics is in progress. One of the possible ways to reduce this bias is to include Antarctic runoff (or ice shelf flux around Antarctica); this is expected to alleviate the overestimation by reducing the SST bias and altering the vertical structure of the ocean. Horizontal distributions and variability agree well with the observations for the surface and the pressure-level variables (0.88–0.99 and 0.69–0.99, respectively). Performance of surface air temperatures and precipitation is similar to the CMIP5 model ensemble. In addition, trend of climate variability such as pacific decadal oscillation (PDO) is well represented in this research (not shown).

Thus, the first generation of the KMA coupled model is capable of capturing the average climatology and internal variability reasonably which are encouraging result behavior for a new model. Several deficiencies such as the biases in precipitation and SST in the tropics and Antarctic sea ice distributions are also identified in the evaluation work. Further work towards improving the performance of the model is in progress, and NIMS/KMA plans to contribute to CMIP6 using this model. Additionally, detail descriptions of climate variability in K-ACE earth system model will be introduced in next research which shows historical and future scenario simulation results.