Abstract
Data assimilation is the process of hindcasting, now-casting, and forecasting using information from both observations and ocean dynamics. Modern ocean forecasting systems rely on data assimilation to estimate initial and boundary data, to interpolate and smooth sparse or noisy observations, and to evaluate observing systems and dynamical models. Every data assimilation system implements an optimality criterion which defines how to best combine dynamics and observations, given an hypothesized error model for both. The realization of practical ocean data assimilation systems is challenging due to both the technical issues of implementation, and the scientific issues of determining the appropriate set of hypothesized priors. This chapter reviews methodologies and highlights themes common to all approaches.
“Conventional ocean modeling consists of solving the model equations as accurately as possible, and then comparing the results with observations. While encouraging levels of quantitative agreement have been obtained, as a rule there is significant quantitative disagreement owing to many sources of error: model formulation, model inputs, computation and the data themselves. Computational errors aside, the errors made both in formulating the model and in specifying its inputs usually exceed the errors in the data. Thus it is unsatisfactory to have a model solution which is uninfluenced by the data.”—Bennett (Inverse Methods in Physical Oceanography, 1st edn. Cambridge University Press, New York, p. 112, 1992)
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ambadan JT, Tang Y (2009) Sigma-point Kalman Filter data assimilation for strongly nonlinear systems. J Atmos Sci 66:261–285
Amodei L (1995) Solution approchee pour un probleme d’assimilation avec prise en compte l’erreur de modele. C R Acad Sci 321:1087–1094
Anderson J, Hoar T, Raeder K, Liu H, Collins N, Torn R, Avellano A (2009) The data assimilation research testbed: a community facility. Bull Am Meteorol Soc 90:1283–1296
Atlas R (1997) Atmospheric observations and experiments to assess their usefulness in data assimilation. J Meteorol Soc Japan 75:111–130
Australian Bureau of Meterolology (2009) Ocean analysis. http://www.bom.gov.au/oceainography/analysis.shtml
Baker NL, Daley R (2000) Observation and background adjoint sensitivity in the adaptive observation-targeting problem. Q J Roy Meteorol Soc 126:1431–1453
Balmaseda MA, Vidard A, Anderson DL (2007) The ECMWF System 3 Ocean Analysis System, ECMWF Technical Memorandum. Technical Report 7. European Center for Medium-Range Weather Forecasts
Bennett AF (1992) Inverse Methods in Physical Oceanography, 1st edn. Cambridge University Press, New York, p 346
Bennett AF (2002) Inverse Modeling of the Ocean and Atmosphere. Cambridge University Press, New York, p 234
Bennett AF, Budgell W (1987) Ocean data assimilation and the Kalman filter: spatial regularity. J Phys Oceanogr 17:1583–1601
Bennett AF, Thorburn MA (1992) The generalized inverse of a nonlinear quasigeostrophic ocean circulation model. J Phys Oceanogr 22:213–230
Bennett AF, Chua BS, Ngodock H, Harrison DE, McPhaden MJ (2006) Generalized inversion of the Gent-Cane model of the Tropical Pacific with Tropical Atmosphere-Ocean (TAO) data. J Mar Res 64:1–42
Bennett AF, Chua BS, Pflaum BL, Erwig M, Fu Z, Loft RD, Muccino JC (2008) The inverse ocean modeling system. I: implementation. J Atmos Oceanic Technol 25:1608–1622
Bretherton F, Davis R, Fandry C (1976) A technique for objective analysis and design of oceanographic experiments applied to MODE-73. Deep Sea Res 23:559–582
Broquet G, Edwards CA, Moore AM, Powell BS, Veneziani M, Doyle JD (2009) Application of 4D-variational data assimilation to the California Current system. Dyn Atmos Oceans 48:69–92
Cane M, Kaplan A, Miller R, Tang B, Hackert E, Busalacchi A (1996) Mapping Tropical Pacific sea level: data assimilation via a reduced state space Kalman filter. J Geophys Res 101:22599–22617
Chao Y, Li Z, Farrara J, Hung P (2009) Blending sea surface temperatures from multiple satellites and in situ observations for coastal oceans. J Atmos Oceanic Technol 26:1415–1426
Chapnik B, Desroziers G, Rabier F, Talagrand O (2006) Diagnosis and tuning of observational error in quasi-operational data assimilation setting. Q J Roy Meteorol Soc 132:543–565
Chua B, Bennett AF (2001) An inverse ocean modeling system. Ocean Modelling 3:137–165
Cohn SE, Da Silva A, Guo J, Sienkiewicz M, Lamich D (1998) Assessing the effects of data selection with the DAO physical-space statistical analysis system. Mon Wea Rev 126:2913–2926
Courtier P (1997) Dual formulation of four-dimensional assimilation. Q J Roy Meteorol Soc 123:2449–2461
Courtier P, Derber J, Errico R, Louis J, Vukicevic T (1993) Important literature on the use of adjoint, variational methods and the Kalman Filter in meteorology. Tellus 45A:342–357
Courtier P, Thepaut J, Hollingsworth A (1994) A strategy for operational implementation of 4D-Var, using an incremental approach. Q J Roy Meteorol Soc 120:1367–1387
Cummings J, Bertino L, Brasseur P, Fukumori I, Kamachi M, Martin MJ, Mogensen K, Oke P, Testut CE, Verron J, Weaver A (2009) Ocean data assimilation systems for GODAE. Oceanography 22:96–109
Daescu DN, Navon IM (2008) A dual-weighted approach to order reduction in 4DVAR data assimilation. Mon Wea Rev 136:1026–1041
Daley R (1991) Atmospheric Data Analysis. Cambridge University Press, New York, p 457
De Mey P, Craig P, Kindle J, Ishikawa Y, Proctor R, Thompson K, Zhu J (2007) Towards the assessment and demonstration of the value of GODAE results for coastal and shelf seas models and forecasting systems, 2nd edn. GODAE white paper. http://www.godae.org/modules/documents/documents/GODAE-CSSWG-paper-ed2.pdf. Accessed 15 March 2010
Dee DP, daSilva AM (1999) Maximum-likelihood estimation of forecast and observations error covariance parameters. Part I: methodology. Mon Wea Rev 127:1822–1834
Desroziers G, Ivanov S (2001) Diagnosis and adaptive tuning of observation-error parameters in a variational assimilation. Q J Roy Meteorol Soc 127:1433–1452
Dombrowsky E, Bertino L, Brassington GB, Chassignet EP, Davidson F, Hurlburt HE, Kamachi M, Lee T, Martin MJ, Mei S, Tonani M (2009) GODAE systems in operation. Oceanography 22:81–95
Egbert GD, Bennett AF, Foreman M (1994) TOPEX/POSEIDON tides estimated using a global inverse model. J Geophys Res 99:24821–24852
Evensen G (1997) Advanced data assimilation for strongly nonlinear dynamics. Mon Wea Rev 125:1342–1354
Evensen G (2006) Data assimilation: the ensemble Kalman Filter. Springer, Berlin, p 280
Gelaro R, Zhu Y (2009) Examination of observation impacts derived from observing system experiments (OSEs) and adjoint models. Tellus 61A:179–193
Gelb A (ed) (1974) Applied Optimal Estimation. MIT Press, Cambridge
Ghil M (1989) Meteorological data assimilation for oceanographers. Part I: description and theoretical framework. Dyn Atmos Oceans 13:171–218
Giering R, Kaminski T (1998) Recipes for adjoint code construction. ACM Trans Math Software 24:437–474. http://autodiff.com
Girard D (1989) A fast Monte-Carlo cross-validation procedure for large least squares problems with noisy data. Numer Math 56:1–23
Golub G, Van Loan C (1989) Matrix Computations, 2nd edn. Johns Hopkins University Press, Baltimore, p 642
He R, Wilkin JL (2006) Tides on the Southeast New England shelf: a view from a hybrid data assimilative modeling approach. J Geophys Res 111:C08002
Heemink AW, Mouthaan EE, Roest MR, Vollebregt EA, Robaczewska KB, Verlaan M (2002) Inverse 3D shallow water flow modeling of the continental shelf. Cont Shelf Res 22:465–484
Hoffman RN, Ponte RM, Kostelich EJ, Blumberg A, Szunyogh I, Vinogradov SV, Henderson JM (2008) A simulation study using a local ensemble transform Kalman Filter for data assimilation in New York Harbor. J Atmos Oceanic Technol 25:1638–1656
Hofmann EE, Druon JN, Fennel K, Friedrichs M, Haidvogel D, Lee C, Mannino A, McClain C, Najjar R, Siewert J, O’Reilly J, Pollard D, Previdi M, Seitzinger S, Signorini S, Wilkin J (2008) Eastern U.S. continental shelf carbon budget: Integrating models, data assimilation, and analysis. Oceanography 21:86–104
Hollingsworth A, Lonnberg P (1986) The statistical structure of short-range forecast errors as determined from radiosonde data. Part I: the wind field. Tellus 38:111–136
Hutchinson MF (1989) A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines. Comm Statist Simulation Comput 18:1059–1076
Ide K, Courtier P, Ghil M, Lorenc AC (1997) Unified notation for data assimilation: operational, sequential and variational. J Meteorol Soc Japan 75:181–189
Jet Propulsion Laboratory (2009) JPL ECCO Ocean Data Assimilation. http://ecco.jpl.nasa.gov/external/index.php.
Kalnay E (2003) Atmospheric Modeling, Data Assimilation, and Predictability. Cambridge University Press, New York, p 341
Kurapov AL, Allen JS, Egbert GD, Miller RN, Kosro PM, Levine MD, Boyd T, Barth JA (2005) Assimilation of moored velocity data in a model of coastal wind-driven circulation off Oregon: multivariate capabilities. J Geophys Res 110:C10S08
Lardner RW, Al-Rabeh AH, Gunay N (1993) Optimal estimation of parameters for a two-dimensional hydrodynamical model of the Arabian Gulf. J Geophys Res 98:18229–18242
Lermusiaux PF, Robinson AR (1999) Data assimilation via error subspace statistical estimation. Part I: theory and schemes. Mon Wea Rev 127:1385–1407
Li Z, Chao Y, McWilliams J, Ide K (2008) A three-dimensional variational data assimilation scheme for the regional ocean modeling system. J Atmos Oceanic Technol 25:2074–2090
Logutov OG, Lermusiaux PF (2008) Inverse barotropic tidal estimation for regional ocean applications. Ocean Model 25:17–34
Lorenc A (1986) Analysis methods for numerical weather prediction. Q J Roy Meteorol Soc 112:1177–1194
Losch M, Wunsch C (2003) Bottom topography as a control variable in an ocean model. J Atmos Oceanic Technol 20:1685–1696
McIntosh P (1987) Systematic design of observational arrays. J Phys Oceanogr 17:885–902
Miller RN, Ghil M, Gauthiez F (1994) Advanced data assimilation in strongly nonlinear dynamical systems. J Atmos Sci 51:1037–1056
Moore AM, Arango HG, Di Lorenzo E, Cornuelle BD, Miller AJ, Neilson DJ (2004) A comprehensive ocean prediction and analysis system based on the tangent linear and adjoint of a regional ocean model. Ocean Model 7:227–258
Moore AM, Arango HG, DiLorenzo E, Miller AJ, Cornuelle BD (2009) An adjoint sensitivity analysis of the Southern California Current circulation and ecosystem. J Phys Oceanogr 39:702–720
Mourre B, De Mey P, Lyard F, Le Provost C (2004) Assimilation of sea level data over continental shelves: an ensemble method for the exploration of model errors due to uncertainties in bathymetry. Dyn Atmos Oceans 38:93–121
Muccino JC, Bennett AF, Hubele NF (2004) Significance testing for variational assimilation. Q J Roy Meteorol Soc 130:1815–1838
Muccino JC, Arango H, Bennett AB, Chua BS, Cornuelle B, DiLorenzo E, Egbert GD, Hao L, Levin J, Moore AM, Zaron ED (2008) The inverse ocean modeling system. II: applications. J Atmos Oceanic Technol 25:1623–1637
National Center for Environmental Prediction (2009) Global ocean data assimilation system (GODAS). http://www.cpc.ncep.noaa.gov/products/GODAS
Navon I, Legler D (1987) Conjugate-gradient methods for large-scale minimization in meteorology. Mon Wea Rev 115:1479–1502
Ngodock HE, Smith SR, Jacobs GA (2009) Cycling the representer method with nonlinear models. In: Park SK, Xu L (eds) Data assimilation for atmospheric, oceanic, and hydrologic applications. Springer, Berlin, pp 321–340
Oke PR, Sakov P (2008) Representativeness error of oceanic observations for data assimilation. J Atmos Oceanic Technol 25:1004–1017
Oke PR, Allen JS, Miller RN, Egbert GD, Kosro PM (2002) Assimilation of surface velocity data into a primitive equation coastal ocean model. J Geophys Res 107:3122
Paduan JD, Shulman I (2004) HF radar data assimilation in the Monterey Bay area. J Geophys Res 109. doi:10.1029/2003JC001949
Powell BS, Arango HG, Moore AM, DiLorenzo E, Milliff RF, Foley D (2008) 4DVAR data assimilation in the Intra-American Sea with the Regional Ocean Modeling System (ROMS). Ocean Mod 23:130–145
Powell BS, Moore AM, Arango HG, DiLorenzo E, Milliff RF, Leben RR (2009) Near realtime ocean circulation assimilation and prediction in the Intra-American Sea with ROMS. Dyn Atmos Oceans 48:16–45
Purser RJ, Wu W-S, Parrish DF, Roberts NM (2003a) Numerical aspects of the application of recursive filters to variational statistical analysis. Part I: spatially homogeneous and isotropic Gaussian covariances. Mon Wea Rev 131:1524–1535
Purser RJ, Wu W-S, Parrish DF, Roberts NM (2003b) Numerical aspects of the application of recursive filters to variational statistical analysis. Part II: spatially inhomogeneous and anisotropic general covariances. Mon Wea Rev 131:1536–1548
Rabier F, Jarvinen H, Klinker E, Mahfouf JF, Simmons A (2000) The ECMWF operational implementation of four-dimensional variational assimilation. I: experimental results with simplified physics. Q J Roy Meteorol Soc 126:1143–1170
Richman JG, Miller RN, Spitz YH (2005) Error estimates for assimilation of satellite sea surface temperature data in ocean climate models. Geophys Res Lett 32:L18608.
Ross S (2005) A First Course in Probability, 7th edn. Prentice Hall, New York
Stewart LM, Dance SL, Nichols NK (2008) Correlated observation errors in data assimilation. Int J Numer Meth Fluids 56:1521–1527
Strong GM (2007) Udana. Forgotten Books, New York, pp 68–69
Szunyogh I, Kostelich EJ, Gyarmati G, Kalnay E, Hunt BR, Ott E, SatterïňĄeld E, Yorke JA (2008) A local ensemble transform Kalman filter data assimilation system for the NCEP global model. Tellus A 60:113–130
Talagrand O (1997) Assimilation of observations, an introduction. J Meteorol Soc Japan 75:191–209
Talagrand O (1999) A posterior verification of analysis and assimilation algorithms. Proceedings of a Workshop on Diagnosis of Data Assimilation Systems. ECMWF, Reading, UK
Talagrand O, Courtier P (1987) Variational assimilation of meteorological observations with the adjoint vorticity equation I, theory. Q J Roy Meteorol Soc 113:1311–1328
Todling R, Cohn SE (1994) Suboptimal schemes for atmospheric data assimilation based on the Kalman filter. Mon Wea Rev 122:2530–2557
University of Maryland (2009) Simple Ocean Data Assimilation (soda). http://www.atmos.umd.edu/~ocean/
Utke J, Hascoet L, Heimbach P, Hill C, Hovland P, Naumann U (2009) Toward adjoinable MPI. Proceedings of the 10th IEEE International Workshop on Parallel and Distributed Scientific and Engineering, PDSEC-09. http://doi.ieeecomputersociety.org/10.1109/IPDPS.2009.5161165
Wahba G (1990) Spline models for observational data. SIAM publications, Philadelphia, p 169
Wahba G, Johnson DR, Gao F, Gong J (1995) Adaptive tuning of numerical weather prediction models: randomized GCV in three- and four-dimensional data assimilation. Mon Wea Rev 123:3358–3369
Weaver A, Courtier P (2001) Correlation modelling on the sphere using a generalized diffusion equation. Q J Roy Meteorol Soc 127:1815–1846
Wunsch C (1996) The Ocean Circulation Inverse Problem. Cambridge University Press, New York
Zaron ED (2006) A comparison of data assimilation methods using a planetary geostrophic model. Mon Wea Rev 134:1316–1328
Zhang S, Harrison MJ, Rosati A, Wittenberg A (2007) System design and evaluation of coupled ensemble data assimilation for global oceanic climate studies. Mon Wea Rev 135:3541–3564
Zou X, Navon IM, Berger M, Phua KH, Schlick T, LeDimet FX (1993) Numerical experience with limited-memory, quasi-newton methods for large-scale unconstrained nonlinear minimization. SIAM J Optimization 3:582–608
Acknowledgements
Partial support for this work was provided by the U.S. National Science Foundation, award OCE-0623540, and the Naval Research Laboratory, award N00173-08-C015. Additional support from the National Oceanic and Atmospheric Administration to attend the GODAE/BlueLink Summer School is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix
Appendix
1.1 Software and WWW Resources
The Inverse Ocean Model (IOM) is a software toolkit designed to produce a custom variational data assimilation system from basic modeling components provided by the user (Bennett et al. 2008). The software features a graphical user interface (GUI) which is used to select assimilation or analysis algorithms and monitor program execution. The IOM has been used successfully with parallel and serial codes, including structured and unstructured grid finite-differece models, and finite-element models (Muccino et al. 2008). The website, http://iom.asu.edu, contains pedagogical material as well as software.
Another software system, the Data Assimilation Research Testbed (DART), provides a framework for developing, testing, and distributing ensemble data assimilation methodologies (Anderson et al. 2009). The DART system uses algorithms which do not require adjoint codes, so it has been used by a relatively large number of researchers and educators.
The Tangent linear and Adjoint Model Compiler (TAMC) was developed by Giering and Kaminski (1998) as a source-to-source Fortran translator for the generation of tangent-linear and adjoint codes needed in variational data assimilation and sensitivity studies. The company, FastOpt, maintains an active presence in this field, and is a good source of information on latest developments and conferences (http://fastopt.com/).
Another source of information and software is the ACTS-Adjoint Compiler project, which has created OpenAD, a tool for automatic differentiation of C and Fortran code (http://ww.mcs. anl.gov/OpenAD/). A recent highlight of their work is the development of adjoint codes from models which use domain decomposition via the parallel MPI library (Utke et al. 2009).
A brief search for “data assimilation” on the web will uncover many course materials and tutorials on data assimilation. One notable source is the European Center for Medium Range Weather Forecasting (ECMWF), which publishes online an excellent series of lecture notes on data assimilation and the use of satellite data. See http://www.ecmwf.int/newsevents/training/rcourse\_notes/ for their Meteorological Training Course Lecture Notes.
Glossary
- Analysis
-
The analysis is the end-point or result of a data assimilation. It is the best estimate of the true state of the ocean at a given time, or within a given time interval, and, ideally, it is accompanied by an estimate of its errors. If the analysis is retrospective, i.e., it is the best estimate of the oceanic state at some past time conditioned upon measurements both before and after the analysis time, it is called a “re-analysis.” Typically the analysis is presented as a set of uniformly gridded oceanic state variables (sea-surface height, current vectors, temperature, salinity, etc.), on the same discrete grid as the ocean model. The analysis may be the end result of a forecast system, or it may provide input for the computation of other diagnostics, such as the computation of transport across transects. Sometimes the analysis is compared with new observations to either verify the analysis or assess the quality of the new observations.
- Analysis increment
-
The analysis increment is the difference between the analysis field and the background. Equivalently, the analysis increment is the correction to the background field which results in the optimal analysis.
- Background
-
The background state, sometimes called the “first guess,” is the prediction of the oceanic state prior to the assimilation of data. In the absence of other information, a climatology or other dynamics-free estimate of the ocean may serve as the background.
- Control variables
-
The control variables, sometimes simply called “the controls,” are the independent quantities to be estimated in the data assimilation. The dynamical model consists of a set of diagnostic or prognostic relations which relate the control variables to the state variables. There is not a unique partition between control variables and state variables, but the controls are generally regarded as inputs while the state is regarded as an output. For example, in the 4D-Var algorithm, the model’s initial conditions are regarded as the control variable; although, these same initial conditions and the resulting forecast may be regarded as state variables. In the Kalman Filter, the system noise is regarded as the control variable.
- Data assimilation
-
Data assimilation is the systematic methodology of incorporating information from an observing system into a dynamical model in such a manner that an optimality criterion is satisfied. Optimality criteria typically express a maximum likelihood or minimum mean square error criterion. In practice, many data assimilation systems find analysis states which only approximately satisfy the stated optimality criterion. This is usually considered acceptable because the optimality criteria are based on error models which are themselves approximate.
- Dynamical model
-
It is assumed that the state of the ocean is predicted or modeled by a set of dynamics, e.g., Newton’s Laws expressed in the usual formulations of continuum mechanics such as the Navier-Stokes equations or the shallow water equations. The dynamical model is assumed to be formulated as a mathematically well-posed initial-boundary-value problem.
- Error model
-
An error model is a description of the probability distribution of some possibly multivariate or field quantity. For example, an error model for a measurement of temperature might minimally declare that the errors have zero mean (are unbiased), known variance, σ, and are Gaussian distributed. An error model for an observing system would minimally consist of error models for the individual observations. An error model for a set of dynamics would minimally consist of error sub-models for the initial conditions, boundary conditions, and other model inhomogeneities. Each of these sub-models would be characterized by its own space-time covariance structure, as appropriate.
- Generalized inversion
-
Because the oceanic state is, in principle, uniquely determined by the ocean dynamics, the addition of observational data in data assimilation makes the oceanic state an over-determined quantity. Alternately, if we consider the measurement error and the dynamics errors to be unknown quantities, which ought to be determined by the data assimilation, the problem of identifying both the oceanic state together with the error fields is an under-determined problem. From this perspective, data assimilation may be regarded as a generalized inversion of the ocean model dynamics. The generalized inverse of the dynamical model consists of the analysis fields, as well as estimates of the error fields, the statistics of which were specified a priori by the error models. Bennett (1992, 2002) uses this language to describe data assimilation, thus highlighting a unifying theme of mathematical inverse theory, statistical estimation, control theory, and non-parametric estimation methods.
- Innovation vector or residual vector
-
The innovation vector is the difference between the observation vector and an observation of the ocean state, written as y − Hx in the notation of this article. Sometimes the background innovations, y − Hx b, may be distinguished from the analysis innovations, y − Hx a.
- Objective analysis
-
The technique of objective analysis—called optimal interpolation, statistical interpolation, and Gauss-Markov smoothing—was originally applied to create a set of consistently gridded fields from sparse observations (Bretherton et al. 1976). When a background field is present, the corrections applied to the background may be called analysis increments. The technique has a close relationship with multivariate smoothing splines (Wahba 1990; Bennett 1992).
- Observing system
-
An observing system produces observations or measurements of some subset of variables characterizing the ocean. Observing systems are defined by a set of observation operators, also called measurement kernels, one per measurement, which mathematically represent the mapping from the oceanic state to a finite set of real values.
- State variables
-
State variables are those fields or quantities which characterize the oceanic state to be estimated. More abstractly, state variables are elements in the domain of the observation operators.
- State vector
-
A state vector is a finite-dimensional state variable. Even when the dynamics are represented by a set of partial differential equations, the computational implementation usually requires projection onto a finite-dimensional vector.
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media B.V.
About this chapter
Cite this chapter
Zaron, E.D. (2011). Introduction to Ocean Data Assimilation. In: Schiller, A., Brassington, G. (eds) Operational Oceanography in the 21st Century. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0332-2_13
Download citation
DOI: https://doi.org/10.1007/978-94-007-0332-2_13
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-0331-5
Online ISBN: 978-94-007-0332-2
eBook Packages: Earth and Environmental ScienceEarth and Environmental Science (R0)