Empirical Analysis of the Test Maturity Model Integration (TMMi)

  • Kerli Rungi
  • Raimundas Matulevičius
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 403)


Testing is an essential part of the software development lifecycle for gaining trust in the quality of the delivered product. Concerns have been raised over the maturity of existing test processes and techniques, and the desire to improve has been acknowledged. Even though there are test process improvement models available on the market, the guidelines on how to use them are unsatisfactory. This paper describes the empirical analysis of Test Maturity Model integration (TMMi) through a single-object case study of test process assessment and improvement planning conducted in Playtech Estonia’s Casino unit. An evaluation on the performance of TMMi is presented, raising also some concerns over its applicability in agile environments. Improvement possibilities for TMMi are described, which contribute to the potential enhancement of the framework.


Test Process Improvement TMMi Quality Assurance Testing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Black, R.: Critical Testing Processes: An Open Source, Business Driven Framework for Improving the Testing Process. Rex Black Consulting Services, (last visited June 19, 2013)
  2. 2.
    Daughtrey, T.: Fundamental Concepts for the Software Quality Engineer. ASQ Quality Press (2001)Google Scholar
  3. 3.
    Eldh, S., Punnekkat, S., Hansson, H.: Experiments with Component Tests to Improve Software Quality. ISSRE, Industrial Track (2007)Google Scholar
  4. 4.
    Ericson, T., Subotic, A., Ursing, S.: TIM – A Test Improvement Model (1997), (last visited June 19, 2013)
  5. 5.
    Gelperin, D., Hetzel, B.: The Growth of Software Testing. Communications of the ACM 31(6) (1988)Google Scholar
  6. 6.
    Gerrard Consulting: Test Organisation Maturity Questionnaire v2 (2013), (last visited June 19, 2013)
  7. 7.
    ISO/IEC 15504-2:2003 Information Technology – Process Assessment, Part 2 – Performing an Assessment (2003)Google Scholar
  8. 8.
    International Software Testing Qualification Board: Standard Glossary of Terms Used in Software Testing Version 2.2, (last visited June 19, 2013)
  9. 9.
    International Software Testing Qualification Board: Certified Tester Expert Level Syllabus – Improving the Testing Process (2011), (last visited June 19, 2013)
  10. 10.
    Rungi, K.: Empirical Analysis of Test Maturity Model Integration (TMMi). Master thesis, University of Tartu (2013)Google Scholar
  11. 11.
    Software Engineering Institute: CMMI – Capability Maturity Model Integrated (2012), (last visited June 19, 2013)
  12. 12.
    Sogeti Netherland, B.V.: TPI Next – Business Driven Test Process Improvement. UTN Publishers (2009)Google Scholar
  13. 13.
    Swinkels, R.: A Comparison of TMM and other Test Process Improvement Models. Technical Report, Frits Philips Institute (2000)Google Scholar
  14. 14.
    TMMi Foundation: TMMi Assessment Method Application Requirements (TAMAR) Version 2.0 (2009), (last visited June 19, 2013)
  15. 15.
    TMMi Foundation: Test Maturity Model Integration (TMMi) Release 1.0 (2012), (last visited June 19, 2013)
  16. 16.
    van der Ven, R.: Models to Improve your Test Process. Capgemini (2012), (last visited June 19, 2013)
  17. 17.
    Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer, Heidelberg (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Kerli Rungi
    • 1
  • Raimundas Matulevičius
    • 2
  1. 1.Playtech Estonia OÜTartuEstonia
  2. 2.Institute of Computer ScienceUniversity of TartuTartuEstonia

Personalised recommendations