Recommended practices in global sensitivity analysis
Practices for global sensitivity analysis of model output are described in a recent textbook (Saltelli et al., 2007). These include (i) variance based techniques for general use in modelling, (ii) the elementary effect method for factor screening for factors-rich models and (iii) Monte Carlo filtering. In the present work we try to put the practices into the context of their usage. We start by describing the present debate on the use of scientific models, and how uncertainty and sensitivity analysis can assist is testing model quality. We discuss Type I, II and III errors in the context of sensitivity analysis and what are the requirements for a good analysis. We also present sensitivity analysis in relation to post normal science (PNS) and model pedigrees.
Keywordsuncertainty analysis sensitivity analysis impact assessment Monte Carlo post normal science
Unable to display preview. Download preview PDF.
- Baudrillard, J., 1999, Revenge of the Crystal, Pluto Press, London, UK, p. 92.Google Scholar
- Beven, K. J., 2001, Rainfall-Runoff Modelling: The Primer. John Wiley and Sons, Ltd, Chichester. See also (31), pp. 151–192, 2004.Google Scholar
- Crichton, M., 2004, State of Fear, Harper Collins, New York, New York.Google Scholar
- Dunn, W. N., 1997, Cognitive Impairment and Social Problem Solving: Some Tests for Type III Errors in Policy Analysis, Graduate School of Public and International Affairs, University of Pittsburgh, Pittsburgh.Google Scholar
- European Commission SEC, 2005, 791 IMPACT ASSESSMENT GUIDELINES, 15 June 2005, http://ec.europa.eu/governance/docs/index en.htm
- Environmental Protection Agency, Models Guidance Draft — November 2003 Draft Guidance on the Development, Evaluation, and Application of Regulatory Environmental Models Prepared by: The Council for Regulatory Environmental Modeling, http://cfpub.epa.gov/crem/cremlib.cfm.
- Funtowicz, S. O. and Ravetz, J. R., 1990, Uncertainty and Quality in Science for Policy, Kluwer Academic, Dordrecht, NL.Google Scholar
- Funtowicz, S., O'Connor, M., Faucheux, S., Froger, G., and Munda, G., 1996, Emergent complexity and procedural rationality: post-normal science for sustainability, In: Costanza R, Segura O, Martinez-Alier J, editors. Getting down to earth: practical applications of ecological economics. Washington (D.C.): Island Press, 1996:223–48.Google Scholar
- Hoeting, J. A., Madigan, D., Raftery A. E., and Volinsky C. T., 1999, Bayesian model averaging: a tutorial, Statistical Science, 14(4), 382417.Google Scholar
- Kennedy, P., 2007, A Guide to Econometrics, Fifth edition, Blackwell, Oxford, UK.Google Scholar
- Leamer, E. E., 1990, “Let's take the con out of econometrics” and “sensitivity analysis would help”, in Modelling Economic Series (ed. Granger, C. W. J.), Clarendon, Oxford.Google Scholar
- Office of Management and Budget (OMB), 2002, Guidelines for Ensuring and Maximizing the Quality, Objectivity, Utility, and Integrity of Information Disseminated by Federal Agencies; Notice; Republication, http://www.whitehouse.gov/omb/inforeg/, February 22, 2002.
- Office of Management and Budget (OMB), 2006, Proposed Risk Assessment Bulletin (January 9, 2006), http://www.whitehouse.gov/omb/inforeg/
- Pilkey, O. and Pilkey-Jarvis, L., 2007, Useless Arithmetic: Why Environmental Scientists Can't Predict the Future, Columbia University Press, Irvington, New York.Google Scholar
- Rosen, R., 1991, Life Itself – A Comprehensive Inquiry into Nature, Origin, and Fabrication of Life. Columbia University Press, Irvington, New York.Google Scholar
- Saltelli, A., Andres, T., Campolongo, F., Cariboni J., Gatelli D., Ratto, M., Saisana, M., and Tarantola, S., 2007, Sensitivity Analysis of Scientific Models, John Wiley and Sons, to appear in winter 2007. (forthcoming)Google Scholar
- Saltelli, K., Chan, A., and Scott, M., Editors, 2000, Sensitivity Analysis, Probability and Statistics series, John Wiley and Sons. (forthcoming)Google Scholar
- Saltelli, A., Tarantola, S., Campolongo, F., and Ratto, M., 2004, Sensitivity Analysis in Practice. A Guide to Assessing Scientific Models, John Wiley and Sons, Chichester, New York.Google Scholar
- Taleb, N., 2007, The Black Swan, Penguin, London.Google Scholar
- Van der Sluijs, J. P., Craye, M., Funtowicz, S., Kloprogge, P., Ravetz, J., and Risbey, J., 2005, Combining quantitative and qualitative measures of uncertainty in model-based environmental assessment: the NUSAP system, Risk Analysis, 25(2), 481–492.Google Scholar