Skip to main content

Automated Assessment and Evaluation of Digital Test Drives

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Mobility ((LNMOB))

Abstract

Within the last decade, several innovations in the automotive domain were introduced in the field of driver-assistance systems (DAS). As technology rapidly advances toward automated driving this trend further continues, integrating more intelligent, interconnected, and complex functionality. This results in a constantly expanding space of system states that need to be validated and verified. Approaches for virtualization of test drives such as X-in-the-loop (XiL) are in focus of current research and development. In this contribution, we introduce a concept for automated quality assessment within a randomized digital test drive. Our aim is to analyze and assess the continuous behavior of automotive systems during multiple realistic traffic scenarios within a simulated environment. Therefore an analysis and comparison of current test approaches and their verification and validation goals are conducted. These results are utilized to derive requirements and constraints for an automated assessment. In comparison to established systematic test approaches, our concept based on a continuous assessment of the entire test drive constituting multiple driving scenarios. To consider the continuous behavior and parallel assessment of different functionality, a distinction between activation conditions and test conditions is conducted. Additionally, the hierarchization of conditions allows identification and evaluation on different abstraction levels. We include general assessments in addition to system and function-specific behavioral assessments. The approach is elaborated on an example use case of an Adaptive Cruise Control (ACC) system.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.openscenario.org.

References

  • Bach J, Otten S, Sax E (2016) A model-based scenario specification method to support development and test of automated driving functions. In: IEEE Intelligent vehicles symposium (IV)

    Google Scholar 

  • Bach J, Otten S, Sax E (2017) A taxonomy and systematic approach for automotive system architectures: From functional chains to functional network. In: 3rd International conference on vehicle technology and intelligent transport systems

    Google Scholar 

  • Bengler K et al (2014) Three decades of driver assistance systems. IEEE Intell Transp Syst Mag 6(4):6–22

    Article  Google Scholar 

  • Bogenrieder R, Fehring M, Bachmann R (2009) Pre-safe in rear-end collision situations. In: 21st International technical conference on enhanced safety of vehicles

    Google Scholar 

  • Broekman B, Notenboom E (2002) Testing embedded software. Addison-Wesley

    Google Scholar 

  • Helmer T et al. (2015) Safety performance assessment of assisted and automated driving by virtual experiments: Stochastic microscopic traffic simulation as knowledge synthesis. In: IEEE International conference on intelligent transportation systems (ITSC)

    Google Scholar 

  • International Organization for Standardization (2017) ISO 29119, Software and systems engineering—Software testing—Part 2: Test processes

    Google Scholar 

  • Khalil HK (2002) Nonlinear systems. Prentice Hall, Upper Saddle River NJ 07458

    Google Scholar 

  • Krajzewicz D et al. (2012) Recent development and applications of sumo simulation of urban mobility. Int J Adv Syst Meas

    Google Scholar 

  • Sax E (2008) Automatisiertes Testen eingebetteter Systeme in der Automobilindustrie. münchen. Carl Hanser Verlag, München Wien

    Book  Google Scholar 

  • Schäuffele J, Zurawka T (2012) Automotive software engineering—grundlagen, prozesse, methoden und werkzeuge effizient einsetzen. Springer, Wiesbaden

    Google Scholar 

  • Shokry H, Hinchey M (2009) Model-based verification of embedded software. Computer 42(4):53–59

    Article  Google Scholar 

  • VDA QMC Working Group 13 and Automotive SIG (2015) Automotive SPICE Process Assessment/ Reference Model, 3rd edn. Berlin, Germany. http://www.automotivespice.com

  • Wachenfeld W, Winner H (2016) The release of autonomous vehicles. In: Autonomous Driving. Springer, pp 425–449

    Google Scholar 

  • Weber J (2009) Automotive development process. Springer-Verlag

    Google Scholar 

  • Wohlfahrt C et al. (2016) Von Systematischer Absicherung zur ‚Digitalen Erprobungsfahrt, 6. Fachkonferenz AUTOTEST Stuttgart

    Google Scholar 

  • Von Neumann-Cosel K, Dupuis M, Weiss C (2009) Virtual test drive–provision of a consistent toolset for [d, h, s, v]-in-the-loop. In: Driving simulation conference Europe

    Google Scholar 

  • Zofka M et al. (2014) Semivirtual simulations for the evaluation of vision-based adas. Intelligent Vehicles Symposium

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stefan Otten .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Otten, S. et al. (2018). Automated Assessment and Evaluation of Digital Test Drives. In: Zachäus, C., Müller, B., Meyer, G. (eds) Advanced Microsystems for Automotive Applications 2017. Lecture Notes in Mobility. Springer, Cham. https://doi.org/10.1007/978-3-319-66972-4_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-66972-4_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-66971-7

  • Online ISBN: 978-3-319-66972-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics