Skip to main content
SpringerLink
Log in

Gamified Requirements Engineering: Model and Experimentation

  • Conference paper
  • First Online:
Requirements Engineering: Foundation for Software Quality (REFSQ 2016)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 9619))

Abstract

[Context & Motivation] Engaging stakeholders in requirements engineering (RE) influences the quality of the requirements and ultimately of the system to-be. Unfortunately, stakeholder engagement is often insufficient, leading to too few, low-quality requirements. [Question/problem] We aim to evaluate the effectiveness of gamification to improve stakeholder engagement and ultimately performance in RE. We focus on agile requirements that are expressed as user stories and acceptance tests. [Principal ideas/results] We develop the gamified requirements engineering model (GREM) that relates gamification, stakeholder engagement, and RE performance. To evaluate GREM, we build an online gamified platform for requirements elicitation, and we report on a rigorous controlled experiment where two independent teams elicited requirements for the same system with and without gamification. The findings show that the performance of the treatment group is significantly higher, and their requirements are more numerous, have higher quality, and are more creative. [Contribution] The GREM model paves the way for further work in gamified RE. Our evaluation provides promising initial empirical insights, and leads us to the hypothesis that competitive game elements are advantageous for RE elicitation, while social game elements are favorable for RE phases where cooperation is demanded.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.wordpress.com.

  2. 2.

    https://captainup.com/.

  3. 3.

    http://www.maibornwolff.de/en.

References

  1. Abdullah, N.N.B., Honiden, S., Sharp, H., Nuseibeh, B., Notkin, D.: Communication patterns of agile requirements engineerings. In: Proceedings of the 1st Workshop on Agile Requirements Engineering (AREW), pp. 1:1–1:4 (2011)

    Google Scholar 

  2. Attfield, S., Kazai, G., Lalmas, M., Piwowarski, B.: Towards a science of user engagement (position paper). In: Proceedings of the Workshop on User Modelling for Web Applications (IWUM) (2011)

    Google Scholar 

  3. Bano, M., Zowghi, D.: A systematic review on the relationship between user involvement and system success. Inf. Softw. Technol. 58, 148–169 (2015)

    Article  Google Scholar 

  4. Bhattacherjee, A.: Social Science Research: Principles, Methods, and Practices (2012)

    Google Scholar 

  5. Charette, R.N.: Why software fails [software failure]. IEEE Spectr. 42(9), 42–49 (2005)

    Article  Google Scholar 

  6. Cohn, M.: User Stories Applied: For Agile Software Development. Addison-Wesley, Redwood City (2004)

    Google Scholar 

  7. Cohn, M.: Agile Estimating and Planning. Pearson Education, Upper Saddle River (2005)

    Google Scholar 

  8. Csikszentmihalyi, M.: Flow: The Psychology of Optimal Experience, vol. 41. Harper Perennial, New York (1991)

    Google Scholar 

  9. Deci, E.L., Koestner, R., Ryan, R.M.: A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychol. Bull. 125(6), 627–668 (1999)

    Article  Google Scholar 

  10. Deci, E.L., Ryan, R.M.: Self-Determination. Wiley Online Library (2010)

    Google Scholar 

  11. Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining gamification. In: Proceedings of the International Academic MindTrek Conference, pp. 9–15. ACM (2011)

    Google Scholar 

  12. Fernandes, J., Duarte, D., Ribeiro, C., Farinha, C., Pereira, J.M., da Silva, M.M.: iThink: a game-based approach towards improving collaboration and participation in requirement elicitation. Procedia Comput. Sci. 15, 66–77 (2012)

    Article  Google Scholar 

  13. Fisher, R.A.: Statistical Methods for Research Workers. No. 5. Genesis Publishing Pvt Ltd., Delhi (1936)

    Google Scholar 

  14. Glinz, M.: Improving the quality of requirements with scenarios. In: Proceedings of the World Congress on Software Quality (WCSQ), pp. 55–60 (2000)

    Google Scholar 

  15. Granic, I., Lobel, A., Engels, R.: The benefits of playing video games. Am. Psychol. Assoc. 69, 66–78 (2013)

    Article  Google Scholar 

  16. Havercamp, S.M., Steven Reiss, S.: A comprehensive assessment of human strivings: test-retest reliability and validity of the reiss profile. J. Pers. Assess. 81(2), 123–132 (2003)

    Article  Google Scholar 

  17. Kano, N., Seraku, N., Takahashi, F., Tsuji, S.: Attractive quality and must-be quality. J. Jpn. Soc. Qual. Control 14(2), 147–156 (1984)

    Google Scholar 

  18. Kappelman, L.A., McKeeman, R., Zhang, L.: Early warning signs of IT project failure: the dominant dozen. Inf. Syst. Manage. 23(4), 31–36 (2006)

    Article  Google Scholar 

  19. Koopmans, L., Bernaards, C.M., Hildebrandt, V.H., Schaufeli, W.B., de Vet Henrica, C.W., van der Beek, A.J.: Conceptual frameworks of individual work performance: a systematic review. J. Occup. Environ. Med. 53(8), 856–866 (2011)

    Article  Google Scholar 

  20. Lazzaro, N.: Why we play games: four keys to more emotion without story. In: Proceedings of the Game Developers Conference (GDC) (2004)

    Google Scholar 

  21. Lombriser, P.: Engaging Stakeholders in Scenario-Based Requirements Engineering with Gamification. M.Sc. thesis, Utrecht University (2015). http://dspace.library.uu.nl/handle/1874/317766

  22. Lucassen, G., Dalpiaz, F., van der Werf, J.M., Brinkkemper, S.: Forging high-quality user stories: towards a discipline for agile requirements. In: Proceedings of the International Requirements Engineering Conference (RE), pp. 126–135. IEEE (2015)

    Google Scholar 

  23. Lucassen, G., Dalpiaz, F., van der Werf, J.M., Brinkkemper, S.: The use and effectiveness of user stories in practice. In: Proceedings of the International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ) (2016)

    Google Scholar 

  24. Maslow, A.H.: A theory of human motivation. Psychol. Rev. 50(4), 370–396 (1943)

    Article  Google Scholar 

  25. North, D.: Introducing behaviour driven development. Better Softw. Mag. (2006)

    Google Scholar 

  26. O’Brien, H.L., Toms, E.G.: What is user engagement? a conceptual framework for defining user engagement with technology. J. Am. Soc. Inform. Sci. Technol. 59(6), 938–955 (2008)

    Article  Google Scholar 

  27. Radoff, J., Kidhardt, E.: Game On: Energize Your Business with Social Media Games. Wiley, New York (2011)

    Google Scholar 

  28. Reiss, S.: Who Am I?: 16 Basic Desires that Motivate Our Actions Define Our Persona. Penguin, New York (2002)

    Google Scholar 

  29. Rheinberg, F., Vollmeyer, R., Engeser, S.: Die Erfassung des Flow-Erlebens. Hogrefe, Göttingen (2003)

    Google Scholar 

  30. Rupp, C., Simon, M., Hocker, F.: Requirements-Engineering und -Management, 5th edn. Hanser Fachbuchverlag, Nürnberg (2009)

    Google Scholar 

  31. Snijders, R., Dalpiaz, F., Brinkkemper, S., Hosseini, M., Ali, R., Özüm, A.: REfine: a gamified platform for participatory requirements engineering. In: Proceedings of the International Workshop on Crowd-Based Requirements Engineering (CrowdRE) (2015)

    Google Scholar 

  32. Snijders, R., Dalpiaz, F., Hosseini, M., Shahri, A., Ali, R.: Crowd-centric requirements engineering. In: Proceedings of the International Workshop on Crowdsourcing and Gamification in the Cloud (CGCloud 2014) (2014)

    Google Scholar 

  33. Stroebe, W., Nijstad, B.A.: Warum brainstorming in gruppen kreativität vermindert. Psychologische Rundsch. 55(1), 2–10 (2004)

    Article  Google Scholar 

  34. Sutcliffe, A.: Scenario-based requirements engineering. Requirements Eng. 3(1), 48–65 (1998)

    Article  Google Scholar 

  35. Wake, B.: Invest in Good Stories, and SMART Tasks (2003). http://xp123.com/articles/invest-in-good-stories-and-smart-tasks. Accessed 20 Jan 2015

  36. Watson, D., Clark, L.A., Tellegen, A.: Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54(6), 1063 (1988)

    Article  Google Scholar 

  37. Werbach, K., Hunter, D.: For the Win: How Game Thinking Can Revolutionize Your Business. Wharton Digital Press, Philadelphia (2012)

    Google Scholar 

  38. Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer, Heidelberg (2012)

    Book  MATH  Google Scholar 

Download references

Acknowledgments

We thank everyone at MaibornWolff for hosting our research; in particular, we are grateful to Franziska Metzger for her support throughout the project and to all the participants in the experiment.

Author information

Authors and Affiliations

  1. Department of Information and Computing Sciences, Utrecht University, Princetonplein 5, De Uithof, 3584 CC, Utrecht, The Netherlands

    Philipp Lombriser, Fabiano Dalpiaz, Garm Lucassen & Sjaak Brinkkemper

Authors
  1. Philipp Lombriser
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fabiano Dalpiaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Garm Lucassen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sjaak Brinkkemper
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fabiano Dalpiaz .

Editor information

Editors and Affiliations

  1. University of Twente, Enschede, The Netherlands

    Maya Daneva

  2. Universidad Politècnica de Valencia, Valencia, Spain

    Oscar Pastor

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Lombriser, P., Dalpiaz, F., Lucassen, G., Brinkkemper, S. (2016). Gamified Requirements Engineering: Model and Experimentation. In: Daneva, M., Pastor, O. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2016. Lecture Notes in Computer Science(), vol 9619. Springer, Cham. https://doi.org/10.1007/978-3-319-30282-9_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-30282-9_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-30281-2

  • Online ISBN: 978-3-319-30282-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation