Efficient Distributed Test Architectures for Large-Scale Systems

  • Eduardo Cunha de Almeida
  • Jõao Eugenio Marynowski
  • Gerson Sunyé
  • Yves Le Traon
  • Patrick Valduriez
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6435)


Typical testing architectures for distributed software rely on a centralized test controller, which decomposes test cases in steps and deploy them across distributed testers. The controller also guarantees the correct execution of test steps through synchronization messages. These architectures are not scalable while testing large-scale distributed systems due to the cost of synchronization management, which may increase the cost of a test and even prevent its execution. This paper presents a distributed architecture to synchronize the test execution sequence. This approach organizes the testers in a tree, where messages are exchanged among parents and children. The experimental evaluation shows that the synchronization management overhead can be reduced by several orders of magnitude. We conclude that testing architectures should scale up along with the distributed system under test.


Test Step Distribute Hash Table System Under Test Tree Order Physical Node 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Foster, I.T., Iamnitchi, A.: On death, taxes, and the convergence of peer-to-peer and grid computing. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 118–128. Springer, Heidelberg (2003)Google Scholar
  2. 2.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenkern, S.: A scalable content-addressable network. ACM SIGCOMM (2001)Google Scholar
  3. 3.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peertopeer lookup service for internet applications. ACM, New York (2001)Google Scholar
  4. 4.
    Jagatheesan, A., Rajasekar, A.: Data grid management systems. In: SIGMOD 2003: Proceedings of the 2003 ACM SIGMOD international conference on Management of data, pp. 683–683. ACM, New York (2003)CrossRefGoogle Scholar
  5. 5.
    Kapfhammer, G.M.: Automatically and transparently distributing the execution of regression test suites. In: Proceedings of the 18th International Conference on Testing Computer Software, Washington, D.C. (2001)Google Scholar
  6. 6.
    Long, B., Strooper, P.A.: A case study in testing distributed systems. In: Proceedings 3rd International Symposium on Distributed Objects and Applications (DOA 2001), pp. 20–30 (2001)Google Scholar
  7. 7.
    Ulrich, A., Zimmerer, P., Chrobok-Diening, G.: Test architectures for testing distributed systems. In: Proceedings of the 12th International Software Quality Week (1999)Google Scholar
  8. 8.
    Dean, J., Ghemawat, S.: Mapreduce: Simplified data processing on large clusters. In: OSDI, pp. 137–150 (2004)Google Scholar
  9. 9.
    Dragan, F., Butnaru, B., Manolescu, I., Gardarin, G., Preda, N., Nguyen, B., Pop, R., Yeh, L.: P2ptester: a tool for measuring P2P platform performance. In: BDA conference (2006)Google Scholar
  10. 10.
    Zhou, Z., Wang, H., Zhou, J., Tang, L., Li., K.: Pigeon: A framework for testing peer-to-peer massively multiplayer online games over heterogeneous network. In: 3rd IEEE Consumer Communications and Networking Conference, CCNC (2006)Google Scholar
  11. 11.
    Schieferdecker, I., Li, M., Hoffmann, A.: Conformance testing of tina service components - the ttcn/ corba gateway. In: IS&N, pp. 393–408 (1998)Google Scholar
  12. 12.
    Chen, W.H., Ural, H.: Synchronizable test sequences based on multiple uio sequences. IEEE/ACM Trans. Netw. 3, 152–157 (1995)CrossRefGoogle Scholar
  13. 13.
    Hierons, R.M.: Testing a distributed system: generating minimal synchronised test sequences that detect output-shifting faults. Information and Software Technology 43, 551–560 (2001)CrossRefGoogle Scholar
  14. 14.
    Chen, K., Jiang, F.: A new method of generating synchronizable test sequences that detect output-shifting faults based on multiple uio sequences. In: Biham, E., Youssef, A.M. (eds.) SAC 2006. LNCS, vol. 4356, pp. 1791–1797. Springer, Heidelberg (2007)Google Scholar
  15. 15.
    Jard, C.: Principles of distribute test synthesis based on true-concurrency models. Technical report, IRISA/CNRS (2001)Google Scholar
  16. 16.
    Pickin, S., Jard, C., Le Traon, Y., Jéron, T., Jézéquel, J.M., Le Guennec, A.: System test synthesis from UML models of distributed software. ACM - 22nd IFIP WG 6.1 International Conference Houston on Formal Techniques for Networked and Distributed Systems (2002)Google Scholar
  17. 17.
    Jard, C., Jéron, T.: TGV: theory, principles and algorithms: A tool for the automatic synthesis of conformance test cases for non-deterministic reactive systems. Int. J. Softw. Tools Technol. Transf. (2005)Google Scholar
  18. 18.
    9646-1, I.: Conformance Testing Methodology and Framework—Part 1: General Concepts (1994)Google Scholar
  19. 19.
    Li, Q., Wang, J., Sun, J.G.: Gfs-btree: A scalable peer-to-peer overlay network for lookup service. In: Li, M., Sun, X.-H., Deng, Q.-n., Ni, J. (eds.) GCC 2003. LNCS, vol. 3032, pp. 340–347. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  20. 20.
    de Almeida, E.C., Sunyé, G., Traon, Y.L., Valduriez, P.: A framework for testing peer-to-peer systems. In: 19th International Symposium on Software Reliability Engineering (ISSRE 2008). IEEE Computer Society Press, Redmond (November 2008)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2010

Authors and Affiliations

  • Eduardo Cunha de Almeida
    • 1
  • Jõao Eugenio Marynowski
    • 1
  • Gerson Sunyé
    • 2
  • Yves Le Traon
    • 3
  • Patrick Valduriez
    • 4
  1. 1.Universidade Federal do ParanáBrazil
  2. 2.INRIAUniversity of NantesFrance
  3. 3.SnTUniversity of LuxembourgLuxembourg
  4. 4.INRIA - LIRMMontpellierFrance

Personalised recommendations