Skip to main content

Clustering Environmental Conditions of Historical Accident Data to Efficiently Generate Testing Sceneries for Maritime Systems

  • Conference paper
  • First Online:
Model-Based Safety and Assessment (IMBSA 2019)

Abstract

Vessels are getting more and more equipped with highly-automated assistant systems that benefit from the use of machine learning. Such trained safety-critical systems demand for new means of Verification and Validation (V+V). Their complex decision making process is hidden and traditional system analysis and functional testing is no longer possible as the testing space becomes too large to test. Scenario-based V+V performed in a simulation environment is a promising approach to tackle these challenges, triggering potential system malfunctions and covering as much as possible of the problem space.

The authors propose a data-driven method to identify relevant sceneries, which describe states of a system in a scenario by a set of parameters. These states are derived from accident reports, summarizing the most critical situations a vessel and its automated assistant systems might be confronted with. By a chain of several methods, such as Principal Component Analysis and K-Mean Clustering the authors show that the value space of scenery parameters to be tested can be reduced and clusters can be identified that define equivalence classes of accidents. These clusters can then be partitioned depending on their probability distributions and open up a (reduced) space for random sampling of testing sceneries.

The authors tested the method focusing on a weather-related parameter set of 1700 accidents in 2016 and 2017 that were retrieved from three different sources. Results show, that the first three principal components of the environmental parameters explain over 90% of the original variance and can be divided into 13 clusters. The authors then manually identified those accidents of a different data pool from 2013–2015 for that weather conditions were reported as the main cause of the accident and found the majority of them (61%) within the clusters and further 23% already in close distance. The more accidents are considered as input for the method the better would be the cluster fitting.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    helcom.fi, last checked 5/15/19.

  2. 2.

    bst-tsb.gc.ca, last checked 5/15/19.

  3. 3.

    gisis.imo.org, last checked 5/15/19.

References

  1. Maurer, M., Gerdes, J.C., Lenz, B., Winner, H.: Autonomes Fahren: Technische, rechtliche und gesellschaftliche Aspekte. Springer, Heidelberg (2015). (in German). https://doi.org/10.1007/978-3-662-45854-9

    Google Scholar 

  2. Brinkmann, M., Böde, E., Lamm, A., Maelen, S.V., Hahn, A.: Learning from automotive: testing maritime assistance systems up to autonomous vessels. In: OCEANS 2017 – Aberdeen, pp. 1–8 (2017). https://doi.org/10.1109/oceanse.2017.8084951

  3. Lamm, A., Hahn, A.: Detecting maneuvers in maritime observation data with CUSUM. In: 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 122–127. IEEE, Bilbao (2017). https://doi.org/10.1109/isspit.2017.8388628

  4. Ulbrich, S., Menzel, T., Reschka, A., Schuldt, F., Maurer, M.: Defining and substantiating the terms scene, situation, and scenario for automated driving. In: 2015 IEEE 18th International Conference on Intelligent Transportation Systems, pp. 982–988. IEEE, Gran Canaria (2015). https://doi.org/10.1109/itsc.2015.164

  5. Shahir, H.Y., Glässer, U., Farahbod, R., Jackson, P., Wehn, H.: Generating test cases for marine safety and security scenarios: a composition framework. Secur. Inform. 1 (2012). https://doi.org/10.1186/2190-8532-1-4

  6. Schuldt, F., Reschka, A., Maurer, M.: A method for an efficient, systematic test case generation for advanced driver assistance systems in virtual environments. In: Winner, H., Prokop, G., Maurer, M. (eds.) Automotive Systems Engineering II, pp. 147–175. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-61607-0_7

    Chapter  Google Scholar 

  7. Lamm, A., Hahn, A.: Towards critical-scenario based testing with maritime observation data. In: 2018 OCEANS - MTS/IEEE Kobe Techno-Oceans (OTO), pp. 1–10. IEEE, Kobe (2018). https://doi.org/10.1109/oceanskobe.2018.8559045

  8. Pütz, A., Zlocki, A., Bock, J., Eckstein, L.: System validation of highly automated vehicles with a database of relevant traffic scenarios. In: 12th ITS European Congress, p. 8 (2017)

    Google Scholar 

  9. Youssef, S.A.M., Paik, J.K.: Hazard identification and scenario selection of ship grounding accidents. Ocean Eng. 153, 242–255 (2018). https://doi.org/10.1016/j.oceaneng.2018.01.110

    Article  Google Scholar 

  10. Esnaf, S., Koldemir, B., Küçükdeniz, T., Akten, N.: Fuzzy cluster analysis of shipping accidents in the bosporus. Eur. J. Navig. 6 (2008)

    Google Scholar 

  11. Lema, E., Papaioannou, D., Vlachos, G.P.: Investigation of coinciding shipping accident factors with the use of partitional clustering methods. In: Proceedings of the 7th International Conference on Pervasive Technologies Related to Assistive Environments - PETRA 2014, pp. 1–4. ACM Press, Rhodes (2014). https://doi.org/10.1145/2674396.2674461

  12. Zhang, Z., Li, X.-M.: Global ship accidents and ocean swell-related sea states. Nat. Hazards Earth Syst. Sci. 17, 2041–2051 (2017). https://doi.org/10.5194/nhess-17-2041-2017

    Article  Google Scholar 

  13. Guedes, S.C., Bitner-Gregersen, E.M., Antão, P.: Analysis of the frequency of ship accidents under severe North Atlantic weather conditions. In: Conference: Design and Operation for Abnormal Conditions, vol. 2, pp. 221–230 (2001)

    Google Scholar 

  14. Tamura, H., Waseda, T., Miyazawa, Y.: Freakish sea state and swell-windsea coupling: numerical study of the Suwa-Maru incident. Geophys. Res. Lett. 36, L01607 (2009). https://doi.org/10.1029/2008GL036280

    Article  Google Scholar 

  15. Bruns, T., Lehner, S., Li, X.-M., Hessner, K., Rosenthal, W.: Analysis of an event of “Parametric Rolling” onboard RV “Polarstern” based on shipborne wave radar and satellite data. IEEE J. Ocean. Eng. 36, 364–372 (2011). https://doi.org/10.1109/JOE.2011.2129630

    Article  Google Scholar 

  16. Ueno, M., Kitamura, F., Sogihnara, N., Fujiwara, T.: A simple method to estimate wind loads on ships. In: Advances in Civil, Environmental, and Materials Research, pp. 26–30 (2012)

    Google Scholar 

  17. Heij, C., Knapp, S.: Effects of wind strength and wave height on ship incident risk: regional trends and seasonality. Transp. Res. Part D: Transp. Environ. 37, 29–39 (2015). https://doi.org/10.1016/j.trd.2015.04.016

    Article  Google Scholar 

  18. Gluver, H.: Ship Collision Analysis: Proceedings of the International Symposium on Advances in Ship Collision Analysis, Copenhagen, Denmark, 10–13 May 1998. Routledge, London (2017)

    Google Scholar 

  19. Simonsen, B.C., Hansen, P.F.: Theoretical and statistical analysis of ship grounding accidents. J. Offshore Mech. Arct. Eng. 122, 200 (2000). https://doi.org/10.1115/1.1286075

    Article  Google Scholar 

  20. Erol, S., Demir, M., Çetişli, B., Eyüboğlu, E.: Analysis of ship accidents in the Istanbul Strait using neuro-fuzzy and genetically optimised fuzzy classifiers. J. Navig. 71, 419–436 (2018). https://doi.org/10.1017/S0373463317000601

    Article  Google Scholar 

  21. Caliendo, C., Parisi, A.: Principal component analysis applied to crash data on multilane roads. In: Proceedings of Third International SIIV Congress, vol. 1, pp. 1–7 (2005)

    Google Scholar 

  22. Golob, T.F., Recker, W.W.: Relationships among urban freeway accidents, traffic flow, weather, and lighting conditions. J. Transp. Eng. 129, 342–353 (2003). https://doi.org/10.1061/(asce)0733-947x(2003)129:4(342)

    Article  Google Scholar 

  23. Steinbach, M., Ertöz, L., Kumar, V.: The challenges of clustering high dimensional data. In: Wille, L.T. (ed.) New Directions in Statistical Physics, pp. 273–309. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-662-08968-2_16

    Chapter  Google Scholar 

  24. Hotelling, H.: Analysis of a complex of variables into principal components. J. Educ. Psychol. 24, 498–520 (1933). https://doi.org/10.1007/978-3-642-04898-2_455

    Article  MATH  Google Scholar 

  25. Thorndike, R.L.: Who belongs in the family? Psychometrika 18, 267–276 (1953). https://doi.org/10.1007/BF02289263

    Article  Google Scholar 

  26. Hartigan, J.A., Wong, M.A.: Algorithm AS 136: a K-Means clustering algorithm. Appl. Stat. 28, 100 (1979). https://doi.org/10.2307/2346830

    Article  MATH  Google Scholar 

  27. Owen, A.B.: Orthogonal arrays for computer experiments, integration and visualization. Stat. Sin. 2, 439–452 (1992)

    MathSciNet  MATH  Google Scholar 

  28. Copernicus Climate Change Service: ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate. Copernicus Climate Change Service Climate Data Store (2017)

    Google Scholar 

  29. Amante, C., Eakins, B.W.: ETOPO1 1 arc-minute global relief model: procedures, data sources and analysis. NOAA Technical Memorandum NESDIS NGDC-24 (2009). https://doi.org/10.7289/v5c8276m

  30. Saha, S., et al.: The NCEP climate forecast system version 2. J. Clim. 27, 2185–2208 (2014). https://doi.org/10.1175/JCLI-D-12-00823.1

    Article  Google Scholar 

  31. Calinski, T., Harabasz, J.: A dendrite method for cluster analysis. Commun. Stat. 3, 1–27 (1974)

    MathSciNet  MATH  Google Scholar 

  32. Reynolds, J.: Ship-turning characteristics in different water depths. Safety at Sea International, no. 90 (1976)

    Google Scholar 

  33. Hair, J.F. (ed.): Multivariate Data Analysis. Pearson, Harlow (2014)

    Google Scholar 

  34. Jolliffe, I.T., Cadima, J.: Principal component analysis: a review and recent developments. Philos. Trans. R. Soc. A: Math. Phys. Eng. Sci. 374 (2016). https://doi.org/10.1098/rsta.2015.0202

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgement

This research is supported by the state of Lower Saxony as part of the project Architecture and Technology – Development – Platform for Realtime Safe and Secure Systems (ACTRESS).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tim Wuellner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wuellner, T., Feuerstack, S., Hahn, A. (2019). Clustering Environmental Conditions of Historical Accident Data to Efficiently Generate Testing Sceneries for Maritime Systems. In: Papadopoulos, Y., Aslansefat, K., Katsaros, P., Bozzano, M. (eds) Model-Based Safety and Assessment. IMBSA 2019. Lecture Notes in Computer Science(), vol 11842. Springer, Cham. https://doi.org/10.1007/978-3-030-32872-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32872-6_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32871-9

  • Online ISBN: 978-3-030-32872-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics