Skip to main content

An Approach for Validating Safety of Perception Software in Autonomous Driving Systems

  • Conference paper
  • First Online:
Model-Based Safety and Assessment (IMBSA 2019)

Abstract

The increasing complexity of Advanced Driver Assistance Systems (ADAS) presents a challenging task to validate safe and reliable performance of these systems under varied conditions. The test and validation of ADAS/AD with real test drives, although important, involves huge costs and time. Simulation tools provide an alternative with the added advantage of reproducibility but often use ideal sensors, which do not reflect real sensor output accurately. This paper presents a new validation methodology using fault injection, as recommended by the ISO 26262 standard, to test software and system robustness. In our work, we investigated and developed a tool capable of inserting faults at different software and system levels to verify its robustness. The scope of this paper is to cover the fault injection test for the Visteon’s DriveCore™ system, a centralized domain controller for Autonomous driving which is sensor agnostic and SoC agnostic. With this new approach, the validation of safety monitoring functionality and its behavior can be tested using real-world data instead of synthetic data from simulation tools resulting in having better confidence in system performance before proceeding with in-vehicle testing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ziade, H., Ayoubi, R., Velazco, R.: A survey on fault injection techniques. Int. Arab J. Inf. Technol. 1, 171–186 (2004)

    Google Scholar 

  2. Reway, F., Huber, W., Ribeiro, E.P.: Test methodology for vision-based ADAS/AD algorithms with an automotive camera-in-the-loop. In: International Conference on Vehicular Electronics and Safety (ICVES), pp. 1–7. IEEE, Madrid (2018)

    Google Scholar 

  3. Uriagereka, G.J., Lattarulo, R., Rastelli, J.P., Calonge, E.A., Ruiz Lopez, A., Espinoza Ortiz, H.: Fault injection method for safety and controllability evaluation of automated driving. In: Intelligent Vehicles Symposium (IV), pp. 1867–1872. IEEE, Los Angeles (2017)

    Google Scholar 

  4. ISO website for automotive ISO 26262 standard. https://www.iso.org/standard/68383.html. Accessed 02 Apr 2019

  5. Pintard, L., Fabre, J.-C., Kanoun, K., Leeman, M., Roy, M.: Fault injection in the automotive standard ISO 26262: an initial approach. In: Vieira, M., Cunha, J.C. (eds.) EWDC 2013. LNCS, vol. 7869, pp. 126–133. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-38789-0_11

    Chapter  Google Scholar 

  6. Koopman, P., Wagner, M.: Challenges in autonomous vehicle testing and validation. SAE Int. J. Transp. Saf. 4, 15–24 (2016)

    Article  Google Scholar 

  7. ISO website for SOTIF standard. https://www.iso.org/standard/70939.html. Accessed 02 Apr 2019

  8. Mikołajczyk, A., Grochowski, M.: Data augmentation for improving deep learning in image classification problem. In: International Interdisciplinary Ph.D. Workshop (IIPhDW), Swinoujście, pp. 117–122 (2018)

    Google Scholar 

  9. Boncelet, C.: The Essential Guide to Image Processing. Academic Press, Inc., Orlando (2009)

    Google Scholar 

  10. Geiger, A., Lenz, P., Urtasun, R.: Are we ready for Autonomous Driving? In: The KITTI Vision Benchmark Suite. Conference on Computer Vision and Pattern Recognition (CVPR) (2012)

    Google Scholar 

  11. Fawcett, T.: Introduction to ROC analysis. Pattern Recogn. Lett. 27, 861–874 (2006). https://doi.org/10.1016/j.patrec.2005.10.010

    Article  Google Scholar 

  12. Article for Jaccard Index, Science Direct. https://www.sciencedirect.com/topics/computer-science/jaccard-coefficient. Accessed 17 May 2019

  13. Wen, L.: UA-DETRAC: new benchmark and protocol for multi-object detection and tracking. arXiv CoRR, abs/1511.04136 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Plato Pathrose .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rao, D., Pathrose, P., Huening, F., Sid, J. (2019). An Approach for Validating Safety of Perception Software in Autonomous Driving Systems. In: Papadopoulos, Y., Aslansefat, K., Katsaros, P., Bozzano, M. (eds) Model-Based Safety and Assessment. IMBSA 2019. Lecture Notes in Computer Science(), vol 11842. Springer, Cham. https://doi.org/10.1007/978-3-030-32872-6_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32872-6_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32871-9

  • Online ISBN: 978-3-030-32872-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics