Evaluating Model-Based Testing in an Industrial Project: An Experience Report

  • Rebeca Obando VásquezEmail author
  • Christian Quesada-López
  • Alexandra Martínez
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 918)


Model-based testing (MBT) is an approach that automates the design and generation of test cases based on a model that represents the system under test. MBT can reduce the cost of software testing and improve the quality of systems in the industry. The goal of this study is to evaluate the use of MBT in an industrial project with the purpose of analyzing its efficiency, efficacy and acceptance by software engineers. A case study was conducted where six software engineers modeled one module of a system, and then generated and executed the test cases using an MBT tool. Our results show that participants were able to model at least four functional requirements each, in a period of 20 to 60 min, reaching a code coverage between 39% and 59% of the system module. We discussed relevant findings about the completeness of the models and common mistakes made during the modeling and concretization phases. Regarding the acceptance of MBT by participants, our results suggest that while they saw value in the MBT approach, they were not satisfied with the tool used (MISTA), because it did not support key industry needs.


Model-based testing Automation Industry Experience report 


  1. 1.
    Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Softw. Test. Verification Reliab. 22, 297–312 (2012)CrossRefGoogle Scholar
  2. 2.
    Biswas, S., Kaiser, M.S., Mamun, S.: Applying ant colony optimization in software testing to generate prioritized optimal path and test data. In: 2015 International Conference on Electrical Engineering and Information Communication Technology (ICEEICT), pp. 1–6 (2015)Google Scholar
  3. 3.
    Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach (2006)Google Scholar
  4. 4.
    Villalobos-Arias, L., Quesada-López, C., Martinez, A.: A tertiary study on model-based testing areas, tools and challenges: preliminary results (2018)Google Scholar
  5. 5.
    Weißleder, S., Schlingloff, H.: An evaluation of model-based testing in embedded applications. In: IEEE International Conference on Software Testing, Verification, and Validation (2014)Google Scholar
  6. 6.
    Ergun, B., Gebizli, C., Sozer, H.: Format: a tool for adapting test models based on feature models. In: IEEE 41st Annual Computer Software and Applications Conference (2017)Google Scholar
  7. 7.
    Herpel, H.J., et al.: Model based testing of satellite on-board software — an industrial use case. In: Aerospace Conference (2016)Google Scholar
  8. 8.
    Gebizli, C.S., Sözer, H.: Automated refinement of models for model-based testing using exploratory testing. Softw. Qual. J. 25(3), 979–1005 (2017)CrossRefGoogle Scholar
  9. 9.
    Schulze, C., et al.: Model generation to support model-based testing applied on the NASA DAT web-application - an experience report (2015)Google Scholar
  10. 10.
    Bettiga, D., Lamberti, L.: Exploring the adoption process of personal technologies: a cognitive-affective approach. J. High Technol. Manag. Res. 28(2), 179–187 (2017)CrossRefGoogle Scholar
  11. 11.
    Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13, 319–340 (1989)CrossRefGoogle Scholar
  12. 12.
    Wohlin, C., et al.: Experimentation in Software Engineering (2012)CrossRefGoogle Scholar
  13. 13.
    Runeson, P., et al.: Case Study Research in Software Engineering: Guidelines and Examples (2012)CrossRefGoogle Scholar
  14. 14.
    Xu, D.: A tool for automated test code generation from high-level petri nets (2011)CrossRefGoogle Scholar
  15. 15.
    SeleniumHQ: SeleniumHQ. Accessed 07 Mar 2018
  16. 16.
    Masri, W., Zaraket, F.A.: Coverage-based software testing: beyond basic test requirements. In: Advances in Computers, chap. 4, pp. 79–142 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Rebeca Obando Vásquez
    • 1
    Email author
  • Christian Quesada-López
    • 1
  • Alexandra Martínez
    • 1
  1. 1.Universidad de Costa RicaSan JoséCosta Rica

Personalised recommendations