Skip to main content
SpringerLink
Log in

Model Assisted Probability of Detection Curves: New Statistical Tools and Progressive Methodology

  • Published:
Journal of Nondestructive Evaluation Aims and scope Submit manuscript

Abstract

The probability of detection curve is a standard tool in several industries to evaluate the performance of non destructive testing (NDT) procedures for the detection of harmful defects for the inspected structure. Due to new capabilities of NDT process numerical simulation, model assisted probability of detection (MAPOD) approaches have also been recently developed. In this paper, a generic and progressive MAPOD methodology is proposed. Limits and assumptions of the classical methods are enlightened, while new metamodel-based methods are proposed. They allow to access to relevant information based on sensitivity analysis of MAPOD inputs. Applications are performed on eddy current non destructive examination numerical data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Aldrin, J., Knopp, J., Sabbagh, H.: Bayesian methods in probability of detection estimation and model-assisted probability of detection evaluation. In: AIP Conference Proceedings vol. 1511, pp. 1733–1744 (2013)

  2. Baudin, M., Dutfoy, A., Iooss, B., Popelin, A.: Open TURNS: an industrial software for uncertainty quantification in simulation. In: Ghanem, R., Higdon, D., Owhadi, H. (eds.) Handbook of Uncertainty Quantification. Springer, Berlin (2017)

    Google Scholar 

  3. Bayarri, M., Berger, J., Paulo, R., Sacks, J., Cafeo, J., Cavendish, J., Lin, C.H., Tu, J.: A framework for validation of computer models. Technometrics 49, 138–154 (2007)

    Article  MathSciNet  Google Scholar 

  4. Berens, A.: NDE reliability data analysis. In: Higdon, D., Owhadi, H. (eds.) Metals Handbook, pp. 689–701. ASM International, Materials Park (1988)

    Google Scholar 

  5. Blatman, G., Sudret, B.: Adaptive sparse polynomial chaos expansion based on Least Angle Regression. J. Comp. Phys. 230(6), 2345–2367 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  6. Box, G., Cox, D.: An analysis of transformations. J. R.Stat. Soc. 26, 211–252 (1964)

    MATH  Google Scholar 

  7. Browne, T., Fort, J.C.: Redéfinition de la POD comme fonction de répartition aléatoire. Actes des 47èmes Journées de Statistiques de la SFdS, Lille, France (2015)

  8. Calmon, P.: Trends and stakes of NDT simulation. J. Non Destruct. Eval. 31, 339–341 (2012)

    Article  Google Scholar 

  9. Christensen, R.: Linear Models for Multivariate, Time Series and Spatial Data. Springer, New York (1990)

    Google Scholar 

  10. de Rocquigny, E., Devictor, N., Tarantola, S.: (eds) Uncertainty in industrial practice. Wiley, Chichester (2008)

  11. Demeyer, S., Jenson, F, Dominguez, N.: Modélisation d’un code numérique par un processus gaussien - Application au calcul d’une courbe de probabilité de dépasser un seuil. Actes des 44èmes Journées de Statistiques de la SFdS, Bruxelles, Belgique (2012)

  12. DoD.: Department of Defense Handbook - Nondestructive evaluation system reliability assessment. Technical Report MIL-HDBK-1823A, US Department of Defense (DoD), Washington, DC (2009)

  13. Dominguez, N., Jenson, F., Feuillard, V., Willaume, P.: Simulation assisted POD of a phased array ultrasonic inspection in manufacturing. In: AIP Conference Proceedings, vol. 1430, pp. 1765–1772 (2012)

  14. Fang, K.T., Li, R., Sudjianto, A.: Design and Modeling for Computer Experiments. Chapman & Hall/CRC, London (2006)

    MATH  Google Scholar 

  15. Gandosi, L., Annis, C.: Probability of detection curves: statistical best-practice. Technical Report 41, European Network for Inspection and Qualification (ENIQ), Luxembourg (2010)

  16. Iooss, B., Le Gratiet, L.: Uncertainty and sensitivity analysis of functional risk curves based on Gaussian processes. Preprint paper http://www.gdr-mascotnum.fr/media/uai2016_iooss (2016)

  17. Iooss, B., Lemaître, P.: A review on global sensitivity analysis methods. In: Dellino, G., Meloni, C. (eds.) Uncertainty management in Simulation-Optimization of Complex Systems, Algorithms and Applications. Springer, New York (2015)

    Google Scholar 

  18. Lemaître, P., Sergienko, E., Arnaud, A., Bousquet, N., Gamboa, F., Iooss, B.: Density modification based reliability sensitivity analysis. J. Stat. Comput. Simul. 85, 1200–1223 (2015)

    Article  MathSciNet  Google Scholar 

  19. Marrel, A., Iooss, B., Van Dorpe, F., Volkova, E.: An efficient methodology for modeling complex computer codes with Gaussian processes. Comput. Stat. Data Anal. 52, 4731–4744 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  20. Maurice, L., Costan, V., Guillot, E., Thomas, P.: Eddy current NDE performance demonstrations using simulation tools. In: AIP Conference Proceedings, vol. 1511, pp. 464–471 (2013a)

  21. Maurice, L., Costan, V., Thomas, P.: Axial probe eddy current inspection of steam generator tubes near anti-vibration bars: performance evaluation using finite element modeling. In: Proceedings of JRC-NDE, Cannes, pp. 638–644 (2013b)

  22. Meyer, R., Crawford, S., Lareau, J., Anderson, M.: Review of literature for Model Assisted Probability of Detection. Technical Report PNNL-23714, Pacific Northwest National Laboratory (2014)

  23. Oberkampf, W., Roy, C.: Verification and Validation in Scientific Computing. Cambridge University Press, Cambridge (2010)

    Book  MATH  Google Scholar 

  24. Rosell, A., Persson, G.: Model based capability assessment of an automated eddy current inspection procedure on flat surfaces. Res. Nondestruct. Eval. 24, 154–176 (2013)

  25. Rupin, F., Blatman, G., Lacaze, S., Fouquet, T., Chassignole, B.: Probabilistic approaches to compute uncertainty intervals and sensitivity factors of ultrasonic simulations of a weld inspection. Ultrasonics 54, 1037–1046 (2014)

    Article  Google Scholar 

  26. Sacks, J., Welch, W., Mitchell, T., Wynn, H.: Design and analysis of computer experiments. Stat. Sci. 4, 409–435 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  27. Sobol, I.: Sensitivity estimates for non linear mathematical models. Math. Model. Comput. Exp. 1, 407–414 (1993)

    MATH  Google Scholar 

  28. Soize, C., Ghanem, R.: Physical systems with random uncertainties: chaos representations with arbitrary probability measure. SIAM J. Sci. Comput. 26(2), 395–410 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  29. Thomas, P., Goursaud, B., Maurice, L., Cordeiro, S.: Eddy-current non destructive testing with the finite element tool Code_Carmel3D. In: 11th International Conference on Non destructive Evaluation, Jeju (2015)

  30. Thompson, R.: A unified approach to the Model-Assisted determination of Probability of Detection. In: 34th Annual Review of Progress in Quantitative Nondestructive evaluation, July 2007, pp. 1685–1692. Golden, American Institute of Physics, Melville, New-York (2008)

  31. Walter, E., Pronzato, L.: Identification of Parametric Models from Experimental Data. Springer, New York (1997)

    MATH  Google Scholar 

Download references

Acknowledgements

Part of this work has been backed by French National Research Agency (ANR) through project ByPASS ANR-13-MONU-0011. All the calculations were performed by using the OpenTURNS software [2]. We are grateful to Léa Maurice for initial works on this subject, as Pierre-Emile Lhuillier, Pierre Thomas, François Billy, Pierre Calmon, Vincent Feuillard and Nabil Rachdi for helpful discussions. Thanks to Dominique Thai-Van who provided a first version of Fig. 14.

Author information

Authors and Affiliations

  1. EDF R&D, EDF Lab Chatou, 6 Quai Watier, 78401, Chatou, France

    Loïc Le Gratiet, Bertrand Iooss & Thomas Browne

  2. EDF R&D, EDF Lab les Renardières, Écuelles, France

    Géraud Blatman

  3. EDF CEIDRE, Saint Denis, France

    Sara Cordeiro

  4. EDF R&D, EDF Lab Paris-Saclay, Palaiseau, France

    Benjamin Goursaud

Authors
  1. Loïc Le Gratiet
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bertrand Iooss
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Géraud Blatman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thomas Browne
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sara Cordeiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Benjamin Goursaud
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bertrand Iooss.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Le Gratiet, L., Iooss, B., Blatman, G. et al. Model Assisted Probability of Detection Curves: New Statistical Tools and Progressive Methodology. J Nondestruct Eval 36, 8 (2017). https://doi.org/10.1007/s10921-016-0387-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10921-016-0387-z

Keywords

Search

Navigation