Abstract
Statistical extrapolation is the estimation of rare, extreme responses from data sets that consist primarily, if not entirely, of lower (non-rare) values. The validation of statistical extrapolation involves elements common to all validation efforts with the additional difficulty of needing to determine the true value and its uncertainty. The determination of the true value requires an extensive amount of data in order to observe multiple rare events. In some cases, the desired extreme events may be so rare that validation is forced to accept a less rare event such as a lower threshold value. This paper reviews the basics of simulation validation and focuses on the challenges of the validation of statistical extrapolation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ammeen, E., 1994, “Evaluation of Correlation Measures,” CRDKNSWC-HD-0406, March.
American Society of Mechanical Engineers, 2009, “Standard for Verification and Validation in Computational Fluid Dynamics and Heat Transfer,” American Society of Mechanical Engineers, New York.
American Institute for Aeronautics and Astronautics, 1998, Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, AIAA-G-077-1998, Reston, VA.
Anastopoulos, P.A., Spyrou, K.J., Bassler, C.C. and V. Belenky, 2015, “Towards an Improved Critical Wave Groups Method for the Probabilistic Assessment of Large Ship Motions in Irregular Sea” Probabilistic Engineering Mechanics Vol. 44, pp 18–27.
Bales, N.K., 1980, “Optimizing the Seakeeping Performance of Destroyer-Type Hulls,” Proc. 13th Symp. Naval Hydrodynamics, Tokyo, Japan.
Belenky, V. and K.M. Weems, 2012, “Probabilistic Properties of Parametric Roll”, Chapter 6 of Parametric Resonance in Dynamical Systems, Fossen, T. I. and H. Nijmeijer, eds., Springer, ISBN 978-1-4614-10423-0, pp. 129–146.
Belenky, V., Pipiras, V., Kent, C., Hughes, M., Campbell, B. and Smith, T., 2013, “On the Statistical Uncertainties of Time-domain-based Assessment of Stability Failures: Confidence Interval for the Mean and Variance of a Time Series,” Proc. 13th Intl. Ship Stability Workshop, Brest, France, pp. 251–258.
Belenky, V., Pipiras, V. and Weems, K., 2015, “Statistical Uncertainty of Ship Motion Data,” Proc. 12th Intl. Conf. on Stability of Ships and Ocean Vehicles, Glasgow, UK
Belenky, V., Weems, K. and Lin, W.M. 2016, “Split-time Method for Estimation of Probability of Capsizing Caused by Pure Loss of Stability” Ocean Engineering, Vol. 122, pp. 333–343.
Belknap, W.F., Smith, T.C., Campbell, B.L., 2011, “Addressing Challenges in the Validation of Dynamic Stability Simulation Tools,” Proc. 12th Intl. Ship Stability Workshop, Washington, DC., USA pp 81–90.
Belknap, W, Belenky, V., Campbell, B. and Smith, T., 2012, “A Guide for Validation of Simulation-Based Approach for Predicting Ship Stability Failure Probabilities” Proc. 29th Symp. Naval Hydrodynamics, Gothenburg, Sweden
Bendat, J. and Piersol, 1966, Measurement and Analysis of Random Data, John Wiley & Sons.
Campbell, B., Belenky, V. and Pipiras, V., 2016, “Application of the Envelope Peaks over Threshold (EPOT) Method for Probabilistic Assessment of Dynamic Stability,” Ocean Engineering, Vol. 120, pp. 298–304.
Coleman, H. W. and Steele, W. G., 1989, Experimentation and Uncertainty Analysis for Engineers, John Wiley & Sons.
Coles, S., 2001, An Introduction to Statistical Modeling of Extreme Values. Springer-Verlag, London.
de Kat, J. O. and Paulling, J. R., 1989, “The Simulation of Ship Motions and Capsizing in Severe Seas,” Trans. SNAME vol. 97.
DoD, 2009, DoD Modeling and Simulation, (M&S) Verification, Validation, and Accreditation, (VVA), Instruction 5000.61, 9 Dec 2009.
DoN, 2004, Department of the Navy Modeling and Simulation, (M&S) VVA Implementation Handbook, 30 March 2004.
IEEE, 2012, Standard for System and Software Verification and Validation, 1012–2012, Rev o.
International Towing Tank Conference, 2011, “Loads and Responses Seakeeping Verification and Validation of Linear and Weakly Nonlinear Seakeeping Computer Codes,” 26th ITTC Seakeeping Committee Procedure 7.5 – 02 07-02.5 rev 1.
ITTC Specialist Committee on Stability in Waves, 2011, Final Report and Recommendations to the 26th ITTC, Proc. 26th International Towing Tank Conference, Vol II, Rio de Janeiro, Brazil.
Glotzer, D., Pipiras, V., Belenky, V., Campbell, B., Smith, T., 2017, “Confidence Interval for Exceedance Probabilities with Application to Extreme Ship Motions,” REVSTAT Statistical J. Vol. 15, No 4, pp. 537–563.
Griffith, A. A. and Locke, W. M., 2006, An Analysis of the U.S. Navy Verification, Validation, and Accreditation, (VVA) Process for Modeling and Simulation, M(&S) Used for Operation Test (OT) of Surface Ships and Weapons, Thesis Naval Post Graduate School, June 2006.
Lee, E., Fullerton, A., Geiser, J., Schleicher, C., Merril, C., Weil, C., Jiang, M., Stern, F., and Mousaviraad, M., 2016, “Experimental and Computation Comparisons of the R/V Athena in Calm Water,” Proc. 31st Symp. Naval Hydrodynamics, Monterey, California, USA.
Lin, W.M., Yue, D.K.P., 1990, “Numerical Solutions for Large Amplitude Ship Motions in the Time-Domain.” Proc. 18th Symp. Naval Hydrodynamics, Ann Arbor, Michigan, USA. pp. 41–66.
Oberkampf, W., Blottner, F., 1997, Issues in Computational Fluid Dynamics Code Verification and Validation, Sandia National Laboratories Report SAND95-1352.
Priestley, M. B., 1981, Spectral Analysis and Time Series, Vol. 1, Academic Press, New York.
Reed, A. M., 2011, “26th ITTC Parametric Roll Benchmark Study,” Proc. 12th Intl Ship Stability Workshop, Washington DC., USA
Reed, A. M. and Zuzick, A., 2015, “Direct Assessment Will Require Accreditation - What This Means,” Proc. 12th Intl. Conf. on the Stability of Ships and Ocean Vehicles, Glasgow, UK, pp. 51–78
Sec. of Navy, 1999, “Verification, Validation, and Accreditation (VVA) of Models and Simulations,” SECNAVINST 5200.40, 19 April 1999.
Shin, Y.S., Belenky, V., Lin, W.M. Weems, K.M. and Engle, A.H., 2003, “Nonlinear Time Domain Simulation Technology for Seakeeping and Wave-Load Analysis for Modern Ship Design,” Trans. SNAME, Vol. 111.
Smith, T.C., 2011, “Statistical Data Set Comparison for Continuous, Dependent Data” Proc. 12th Intl. Ship Stability Workshop, Washington DC, USA, pp. 75–80.
Smith, T.C., 2012, “Approaches to Ship Motion Simulation Acceptance Criteria” Proc. of 11th Intl Conference of the Stability of Ships and Ocean Vehicles, Athens, Greece. pp. 101–114.
Smith, T. and Campbell, B. 2013, “On the Validation of Statistical Extrapolation for Stability Failure Rate,” Proc. 13th Intl. Ship Stability Workshop, Brest, France.
Smith, T., Campbell, B., Zuzick, A., Belknap, W., and Reed, A., 2014, “Approaches to Validation of Ship Motion Prediction Tools and Extrapolation Procedures for Large Excursion of Ship Motions in Irregular Seas” Proc. 7th Intl. Conf. of Computational Stochastic Mechanics, Santorini, Greece. ISBN: 978-981-09-5347-8
Smith, T. C., 2014, “Example of Validation of Statistical Extrapolation Example of Validation of Statistical Extrapolation,” Proc. 14th Intl. Ship Stability Workshop, Kuala Lumpur, Malaysia.
Smith, T. and Zuzick, A., 2015, “Validation of Statistical Extrapolation Methods for Large Motion Prediction,” Proc. 12th Intl. Conf. on Stability of Ships and Ocean Vehicles, Glasgow, UK.
Stern, F., Wilson, R., Coleman, H., Paterson, E., 1999, Verification and Validation of CFD Simulations, Iowa Institute of Hydraulic Research Report No. 407.
Stern. F., Wilson, R., and Shao, J., 2005, “Quantitative V&V of CFD Simulations and Certification of CFD Codes,” Intl. J. Numerical Methods in Fluid. Vol 50: pp 1335–1355.
Weems, K. and Wundrow, D., 2013, “Hybrid Models for Fast Time-Domain Simulation of Stability Failures in Irregular Waves with Volume-Based Calculations for Froude Krylov and Hydrostatic Force”, Proc. 13th Intl. Ship Stability Workshop, Brest, France.
Weems, K. and Belenky, V., 2015, “Fast Time-Domain Simulation in Irregular Waves With Volume-Based Calculations for Froude Krylov and Hydrostatic Force” Proc. 12th Intl Conference on Stability of Ships and Ocean Vehicles, Glasgow, UK.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Smith, T.C. (2019). Validation Approach for Statistical Extrapolation. In: Belenky, V., Spyrou, K., van Walree, F., Almeida Santos Neves, M., Umeda, N. (eds) Contemporary Ideas on Ship Stability. Fluid Mechanics and Its Applications, vol 119. Springer, Cham. https://doi.org/10.1007/978-3-030-00516-0_34
Download citation
DOI: https://doi.org/10.1007/978-3-030-00516-0_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00514-6
Online ISBN: 978-3-030-00516-0
eBook Packages: EngineeringEngineering (R0)