Skip to main content
SpringerLink
Log in

Automated Testing of Systems of Systems

  • Conference paper
  • First Online:
Testing Software and Systems (ICTSS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14131))

Included in the following conference series:

  • 316 Accesses

Abstract

There are various kinds of software applications like mobile and Web applications. These applications have different types of user interfaces and user interaction methods. Hence, test automation tools are either dedicated or configured for a particular kind of application. Test scenarios can be implemented in the form of scripts and test execution can be automated separately for each type of application. However, there are systems of systems that embody multiple types of applications deployed on various platforms. Test scenarios might cross-cut these applications to be controlled collectively in the test script. In this paper, we propose an approach for testing cross-platform systems of systems. We present an application of it on a real system that involves a mobile and a Web application that are supposed to work in coordination. Our approach integrates a set of existing tools to facilitate test automation. It provides testers with a unified interface for developing test scripts that involve both mobile and Web applications. We conduct an industrial case study and show that our tool can reduce the testing effort significantly.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://github.com/ozgeakat4/toss.

  2. 2.

    http://vestelinternational.com/en/ev-charging-stations.

References

  1. Alegroth, E., Feldt, R., Ryrholm, L.: Visual GUI testing in practice: challenges, problems and limitations. Empir. Softw. Eng. 20, 694–744 (2015)

    Article  Google Scholar 

  2. Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Co., New York (1990)

    MATH  Google Scholar 

  3. Berner, S., Weber, R., Keller, R.K.: Observations and lessons learned from automated testing. In: Proceedings of the 27th International Conference on Software Engineering, pp. 571–579 (2005)

    Google Scholar 

  4. Biagiola, M., Stocco, A., Ricca, F., Tonella, P.: Dependency-aware web test generation. In: Proceedings of the IEEE 13th International Conference on Software Testing, Validation and Verification, pp. 175–185 (2020)

    Google Scholar 

  5. Bruns, A., Kornstadt, A., Wichmann, D.: Web application tests with selenium. IEEE Softw. 26(5), 88–91 (2009)

    Article  Google Scholar 

  6. Choudhary, S.: Cross-platform testing and maintenance of web and mobile applications. In: Proceedings of the 36th International Conference on Software Engineering, pp. 642–645 (2014)

    Google Scholar 

  7. Choudhary, S., Prasad, M., Orso, A.: Cross-platform feature matching for web applications. In: Proceedings of the International Symposium on Software Testing and Analysis, pp. 82–92 (2014)

    Google Scholar 

  8. Choudhary, S., Prasad, M., Orso, A.: X-PERT: a web application testing tool for cross-browser inconsistency detection. In: Proceedings of the International Symposium on Software Testing and Analysis, pp. 417–420 (2014)

    Google Scholar 

  9. Das, K.: Creating Android, iOS, and Web Drivers on Demand, pp. 45–60. Apress, Berkeley (2022)

    Google Scholar 

  10. Fazzini, M., Orso, A.: Automated cross-platform inconsistency detection for mobile apps. In: Proceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering, pp. 308–318 (2017)

    Google Scholar 

  11. Gamma, E., Helm, R., Johnson, R., Vlissides, J.M.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional, Boston (1994)

    MATH  Google Scholar 

  12. Kong, P., Li, L., Gao, J., Liu, K., Bissyandé, T., Klein, J.: Automated testing of android apps: a systematic literature review. IEEE Trans. Reliab. 68(1), 45–66 (2019)

    Article  Google Scholar 

  13. Lawrence, R., Rayner, P.: Behavior-Driven Development with Cucumber. Addison-Wesley Professional, Boston (2019)

    Google Scholar 

  14. Menegassi, A., Endo, A.: Automated tests for cross-platform mobile apps in multiple configurations. IET Softw. 14(1), 27–38 (2020)

    Article  Google Scholar 

  15. Mesbah, A., van Deursen, A., Roest, D.: Invariant-based automatic testing of modern Web applications. IEEE Trans. Softw. Eng. 38(1), 35–53 (2012)

    Article  Google Scholar 

  16. Myers, G., Badgett, T., Sandler, C.: The Art of Software Testing, 3rd edn. John Wiley and Sons Inc., Hoboken (2012)

    Book  Google Scholar 

  17. Rafi, D., Moses, K., Petersen, K., Mäntylä, M.: Benefits and limitations of automated software testing: systematic literature review and practitioner survey. In: Proceedings of the 7th International Workshop on Automation of Software Test, pp. 36–42 (2012)

    Google Scholar 

  18. Sunman, N., Soydan, Y., Sözer, H.: Automated web application testing driven by pre-recorded test cases. J. Syst. Softw. 193, 111441 (2022)

    Article  Google Scholar 

Download references

Acknowledgment

We would like to thank software developers and test engineers at Vestel for supporting our case study.

Author information

Authors and Affiliations

  1. Vestel Electronics, Manisa, Turkey

    Özge Akat

  2. Ozyegin University, İstanbul, Turkey

    Özge Akat & Hasan Sözer

Authors
  1. Özge Akat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hasan Sözer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hasan Sözer .

Editor information

Editors and Affiliations

  1. University of Bergamo, Dalmine, Italy

    Silvia Bonfanti

  2. University of Bergamo, Dalmine, Italy

    Angelo Gargantini

  3. Salvaneschi & Partners, Bergamo, Italy

    Paolo Salvaneschi

Rights and permissions

Reprints and permissions

Copyright information

© 2023 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Akat, Ö., Sözer, H. (2023). Automated Testing of Systems of Systems. In: Bonfanti, S., Gargantini, A., Salvaneschi, P. (eds) Testing Software and Systems. ICTSS 2023. Lecture Notes in Computer Science, vol 14131. Springer, Cham. https://doi.org/10.1007/978-3-031-43240-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43240-8_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43239-2

  • Online ISBN: 978-3-031-43240-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation