CaPTIF: Comprehensive Performance TestIng Framework

  • Daniel A. Mayer
  • Orie Steele
  • Susanne Wetzel
  • Ulrike Meyer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7641)


In this paper we present the design and implementation of a framework for comprehensive performance evaluation of algorithms, modules, and libraries. Our framework allows for the definition of well-defined test inputs and the subsequent scheduling and execution of structured tests. In addition, the framework provides a web-based interface for user interaction and allows for the convenient browsing, plotting, and statistical analysis of test results. We furthermore report on our experience in using the new framework in the development of cryptographic protocols and algorithms—specifically in the context of secure multi-party computation.


Mobile Device Application Program Interface Test Input Test Execution Input Type 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Yao, A.: Protocols for Secure Computations. In: Foundations of Computer Science, vol. 23, pp. 160–164. IEEE (1982)Google Scholar
  2. 2.
    Goldreich, O.: Foundations of Cryptography. Basic Applications, vol. 2. Cambridge University Press (2009)Google Scholar
  3. 3.
    Molyneaux, I.: The Art of Application Performance Testing, vol. 1. O’Reilly Media (2009)Google Scholar
  4. 4.
  5. 5.
  6. 6.
    Apache Software Foundation: Apache JMeter,
  7. 7.
    Aston, P.: The Grinder, a Java Load Testing Framework,
  8. 8.
    Chen, S., Moreland, D., Nepal, S., Zic, J.: Yet Another Performance Testing Framework. In: Australian Conference on Software Engineering (ASWEC), pp. 170–179 (2008)Google Scholar
  9. 9.
    Zhang, L., Chen, Y., Tang, F., Ao, X.: Design and Implementation of Cloud-based Performance Testing System for Web Services. In: Conference on Communications and Networking in China (CHINACOM), pp. 875–880 (2011)Google Scholar
  10. 10.
    Amazon Web Services LLC: Amazon Elastic Compute Cloud (Amazon EC2) (2012),
  11. 11.
    Cramer, R., Damgård, I., Nielsen, J.: Multiparty Computation, an Introduction (2009)Google Scholar
  12. 12.
    Freedman, M., Nissim, K., Pinkas, B.: Efficient Private Matching and Set Intersection. In: Cachin, C., Camenisch, J.L. (eds.) EUROCRYPT 2004. LNCS, vol. 3027, pp. 1–19. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  13. 13.
    De Cristofaro, E., Tsudik, G.: Practical Private Set Intersection Protocols with Linear Complexity. In: Sion, R. (ed.) FC 2010. LNCS, vol. 6052, pp. 143–159. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  14. 14.
    Micciancio, D.: A First Glimpse of Cryptography’s Holy Grail. Commun. ACM 53(3), 96–96 (2010)CrossRefGoogle Scholar
  15. 15.
    Paillier, P.: Public-Key Cryptosystems Based on Composite Degree Residuosity Classes. In: Stern, J. (ed.) EUROCRYPT 1999. LNCS, vol. 1592, pp. 223–238. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  16. 16.
    Damgard, I., Jurik, M.: A Generalisation, a Simplification and Some Applications of Paillier’s Probabilistic Public-Key System. In: Kim, K.-C. (ed.) PKC 2001. LNCS, vol. 1992, pp. 119–136. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  17. 17.
    IEEE: Standard for System and Software Verification and Validation (2012)Google Scholar
  18. 18.
    Reenskaug, T.: Model-Viewer-Controller. Technical report, XEROX PARC (1978)Google Scholar
  19. 19.
    The Pylons Project: Pyramid (2012),
  20. 20.
    SQLAlchemy Authors and Contributors: SQLAlchemy,
  21. 21.
    Mako Authors and Contributors: Mako Templates for Python,
  22. 22.
    MySQL AB: MySQL - The World’s Most Popular Open Source Database (2011),
  23. 23.
    Crockford, D.: The application/json Media Type for JavaScript Object Notation (JSON). RFC 4627 (Informational) (July 2006)Google Scholar
  24. 24.
    Hunter, J.: Matplotlib (2011),

Copyright information

© IFIP International Federation for Information Processing 2012

Authors and Affiliations

  • Daniel A. Mayer
    • 1
  • Orie Steele
    • 1
  • Susanne Wetzel
    • 1
  • Ulrike Meyer
    • 2
  1. 1.Department of Computer ScienceStevens Institute of TechnologyHobokenUSA
  2. 2.UMIC Research CenterRWTH Aachen UniversityAachenGermany

Personalised recommendations