Efficient Guiding Strategies for Testing of Temporal Properties of Hybrid Systems

  • Tommaso DreossiEmail author
  • Thao Dang
  • Alexandre Donzé
  • James Kapinski
  • Xiaoqing Jin
  • Jyotirmoy V. Deshmukh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9058)


Techniques for testing cyberphysical systems (CPS) currently use a combination of automatic directed test generation and random testing to find undesirable behaviors. Existing techniques can fail to efficiently identify bugs because they do not adequately explore the space of system behaviors. In this paper, we present an approach that uses the rapidly exploring random trees (RRT) technique to explore the state-space of a CPS. Given a Signal Temporal Logic (STL) requirement, the RRT algorithm uses two quantities to guide the search: The first is a robustness metric that quantifies the degree of satisfaction of the STL requirement by simulation traces. The second is a metric for measuring coverage for a dense state-space, known as the star discrepancy measure. We show that our approach scales to industrial-scale CPSs by demonstrating its efficacy on an automotive powertrain control system.


Temporal Logic Star Discrepancy Guide Strategy Simulation Trace Goal Cell 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ahmadyan, S.N., Kumar, J.A., Vasudevan, S.: Runtime verification of nonlinear analog circuits using incremental time-augmented rrt algorithm. In: Design, Automation Test in Europe Conference Exhibition (DATE), pp. 21–26, March 2013Google Scholar
  2. 2.
    Annpureddy, Y., Liu, C., Fainekos, G., Sankaranarayanan, S.: S-TaLiRo: a tool for temporal logic falsification for hybrid systems. In: Abdulla, P.A., Leino, K.R.M. (eds.) TACAS 2011. LNCS, vol. 6605, pp. 254–257. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  3. 3.
    Beck, J., Chen, W.: Irregularities of Distribution. Cambridge Studies in Social and Emotional Development. Cambridge University Press (1987)Google Scholar
  4. 4.
    Bhatia, A., Maly, M., Kavraki, E., Vardi, M.: Motion planning with complex goals. IEEE Robotics Automation Magazine 18(3), 55–64 (2011)CrossRefGoogle Scholar
  5. 5.
    Dang, T., Donzé, A., Maler, O., Shalev, N.: Sensitive state-space exploration. In: CDC, pp. 4049–4054 (2008)Google Scholar
  6. 6.
    Dang, T., Nahhal, T.: Coverage-guided test generation for continuous and hybrid systems. Formal Methods in System Design 34(2), 183–213 (2009)CrossRefzbMATHGoogle Scholar
  7. 7.
    Donzé, A.: Breach, a toolbox for verification and parameter synthesis of hybrid systems. In: Touili, T., Cook, B., Jackson, P. (eds.) CAV 2010. LNCS, vol. 6174, pp. 167–170. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  8. 8.
    Donzé, A., Maler, O.: Robust satisfaction of temporal logic over real-valued signals. In: Chatterjee, K., Henzinger, T.A. (eds.) FORMATS 2010. LNCS, vol. 6246, pp. 92–106. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  9. 9.
    Donzé, A., Ferrère, T., Maler, O.: Efficient robust monitoring for STL. In: Sharygina, N., Veith, H. (eds.) CAV 2013. LNCS, vol. 8044, pp. 264–279. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  10. 10.
    Fainekos, G., Sankaranarayanan, S., Ueda, K., Yazarel, H.: Verification of automotive control applications using s-taliro. In: ACC (2012)Google Scholar
  11. 11.
    Jin, X., Deshmukh, J.V., Kapinski, J., Ueda, K., Butts, K.: Powertrain control verification benchmark. In: HSCC (2014)Google Scholar
  12. 12.
    Jin, X., Donzé, A., Deshmukh, J., Seshia, S.: Mining requirements from closed-loop control models. In: HSCC (2013)Google Scholar
  13. 13.
    Karaman, S., Frazzoli, E.: Linear temporal logic vehicle routing with applications to multi-UAV mission planning. Int. J. of Robust and Nonlinear Control 21(12), 1372–1395 (2011)CrossRefzbMATHMathSciNetGoogle Scholar
  14. 14.
    Karaman, S., Frazzoli, E.: Sampling-based algorithms for optimal motion planning. Int. J. of Robotics Research 30(7), 846–894 (2011)CrossRefGoogle Scholar
  15. 15.
    Kim, J., Esposito, J.M., Kumar, V.: An rrt-based algorithm for testing and validating multi-robot controllers. In: RSS, pp. 249–256 (2005)Google Scholar
  16. 16.
    Kloetzer, M., Belta, C.: A fully automated framework for control of linear systems from temporal logic specifications. IEEE Trans. Auto. Control 53(1), 287–297 (2008)CrossRefMathSciNetGoogle Scholar
  17. 17.
    Kong, Z., Jones, A., Ayala, A.M., Gol, E.A., Belta, C.: Temporal logic inference for classification and prediction from data. In: HSCC (2014)Google Scholar
  18. 18.
    LaValle, S.M.: Planning Algorithms, chap. 5. Cambridge University Press, Cambridge, U.K. (2006).
  19. 19.
    Lavalle, S.M., Kuffner, J.J., Jr.: Rapidly-exploring random trees: progress and prospects. In: Algorithmic and Computational Robotics: New Directions. pp. 293–308 (2000)Google Scholar
  20. 20.
    Maler, O., Nickovic, D.: Monitoring temporal properties of continuous signals. In: Lakhnech, Y., Yovine, S. (eds.) FORMATS 2004 and FTRTFT 2004. LNCS, vol. 3253, pp. 152–166. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  21. 21.
    Mathworks, T.: Simulink design verifier.
  22. 22.
    Mount, D.M., Arya, S.: Ann: a library for approximate nearest neighbor searching.
  23. 23.
    Plaku, E., Kavraki, L., Vardi, M.: Hybrid systems: from verification to falsification by combining motion planning and discrete search. Formal Methods in System Design 34(2), 157–182 (2009)CrossRefzbMATHGoogle Scholar
  24. 24.
    Systems, R.: Model based testing and validation with reactis, reactive systems inc.
  25. 25.
    Yang, H., Hoxha, B., Fainekos, G.: Querying parametric temporal logic properties on embedded systems. In: Nielsen, B., Weise, C. (eds.) ICTSS 2012. LNCS, vol. 7641, pp. 136–151. Springer, Heidelberg (2012) CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Tommaso Dreossi
    • 1
    Email author
  • Thao Dang
    • 1
  • Alexandre Donzé
    • 2
  • James Kapinski
    • 3
  • Xiaoqing Jin
    • 3
  • Jyotirmoy V. Deshmukh
    • 3
  1. 1.VerimagGièresFrance
  2. 2.University of CaliforniaBerkeleyUSA
  3. 3.Toyota Technical CenterAnn ArborUSA

Personalised recommendations