Abstract
As more and more high-consequence applications such as aerospace systems leverage computational models to support decisions, the importance of assessing the credibility of these models becomes a high priority. Two elements in the credibility assessment are verification and validation. The former focuses on convergence of the solution (i.e. solution verification) and the “pedigree” of the codes used to evaluate the model. The latter assess the agreement of the model prediction to real data.
The outcome of these elements should map to a statement of credibility on the predictions. As such this credibility should be integrated into the decision making process. In this paper, we present a perspective as to how to integrate these element into a decision making process. The key challenge is to span the gap between physics-based codes, quantitative capability assessments (V&V/UQ), and qualitative risk-mitigation concepts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Abbreviations
- V&V:
-
Verification and validation
- UQ:
-
Uncertainty quantification
- M&S:
-
Modeling and simulation
References
Mayes RL (2009) Developing adequacy criterion for model validation based on requirements. In: IMAC-XXVII, Society for Experimental Mechanics, Orlando
Hubbard DW (2009) The failure of risk management: why it’s broken and how to fix it, 1st edn. Wiley, New York
Elele JN (2009) Assessing risk levels of verification, validation, and accreditation of models and simulations. In: Proceedings of modeling and simulation for military operations IV, SPIE, Orlando
Elele JN, Smith J (2010) Risk-based verification, validation, and accreditation process. In: Proceedings of modeling and simulation for defense systems and applications V, SPIE, Orlando
Youngblood SM et al (2011) Risk based methodology for verification, validation, and accreditation (VV&A) M&S use risk methodology (MURM). Johns Hopkins University Applied Physics Laboratory, Laurel. Report NSAD-R-2011-011
Nitta CK, Logan RW (2004) Qualitative and quantitative linkages from V&V to adequacy, certification, risk, and benefit/cost ratio. Lawrence Livermore National Laboratory, Livermore. Report UCRL-TR-205809
Blattnig SR et al (2009) Towards a credibility assessment of models and simulations. American Institute of Aeronautics and Astronautics, 2009002E
Pilch M et al (2006) Ideas underlying quantitative margins and uncertainty (QMU): a white paper. Sandia National Laboratories, SAND2006-5001, Unlimited Distribution
Oberkampf WL et al (2007) Predictive capability maturity model for computational modeling and simulation. Sandia National Laboratories, SAND2007-5948
Mullins J, Mahadevan S (2014) Variable-fidelity model selection for stochastic simulation. Reliab Eng Syst Saf 131:40–52. doi:10.1016/j.ress.2014.06.011
Mullins J, Li C, Mahadevan S, Urbina A (2014) Optimal selection of calibration and validation test samples under uncertainty. In: Conference proceedings of the society for experimental mechanics. Model validation and uncertainty quantification, vol 3. Orlando, pp 391–401
Acknowledgments
The authors thank Simone Youngblood at JHU Applied Physics Laboratory, and Jason Jarosz at Sandia for many helpful discussions. Sandia is a multi-program laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy’s National Nuclear Security Administration under Contract DE-AC04-94AL85000.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 The Society for Experimental Mechanics, Inc.
About this paper
Cite this paper
Hu, K.T., Urbina, A., Mullins, J. (2015). A Perspective on the Integration of Verification and Validation into the Decision Making Process. In: Atamturktur, H., Moaveni, B., Papadimitriou, C., Schoenherr, T. (eds) Model Validation and Uncertainty Quantification, Volume 3. Conference Proceedings of the Society for Experimental Mechanics Series. Springer, Cham. https://doi.org/10.1007/978-3-319-15224-0_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-15224-0_28
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-15223-3
Online ISBN: 978-3-319-15224-0
eBook Packages: EngineeringEngineering (R0)