Skip to main content
SpringerLink
Log in

Assessing the Performance of Agile Teams

  • Conference paper
  • First Online:
Beyond Interactions (INTERACT 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11930))

Included in the following conference series:

  • 480 Accesses

Abstract

Selecting a well performing agile software development team to develop a particular software is a complex issue for public authorities. This selection is often based on the estimated total cost of the project in an official request for proposals. In this paper we describe an alternative approach where three performance factors and the estimated cost were assessed and weighted to find the best agile team for a particular project. Five agile software development teams that fulfilled predefined technical requirements were invited to take part in one day workshops. The public authority involved wanted to assess both how each team performed during the workshops and the quality of the deliverables they handed in. The three performance factors were: (1) team collaboration and user experience focus, (2) user stories delivery and (3) the quality of the code. We describe the process of assessing the three performance factors during and after the workshops and the results of the assessments. The team that focused on one user story during the workshop and emphasized the three different quality factors, user experience, accessibility and security, got the highest rating from the assessment and were selected for the project. We also describe the lessons learned after concluding the assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baggem, R., Correia, J.P., Schill, K., Visser, J.: Standardized code quality benchmarking for improving software maintainability. Software Qual. J. 20(2), 287–307 (2012). https://doi.org/10.1007/s11219-011-9144-9

    Article  Google Scholar 

  2. Billestrup, J., Stage, J., Larusdottir, M.: A case study of four IT companies developing usable public digital self-service solutions. In: The Ninth International Conference on Advances in Computer-Human Interactions (2016)

    Google Scholar 

  3. Caldwell, B., Cooper, M., Guarino Reid, L., Vanderheiden, G.: Web Content Accessibility Guidelines (WCAG) 2.0. W3C (2008)

    Google Scholar 

  4. Cohn, M.: User Stories Applied. O’Reilly Media, Sebastopol (2004)

    Google Scholar 

  5. Curtis, B., Dickenson, B., Kinsey, C.: CISQ Recommendation Guide (2015). https://www.it-cisq.org/adm-sla/CISQ-Rec-Guide-Effective-Software-Quality-Metrics-for-ADM-Service-Level-Agreements.pdf. Accessed 27 June 2019

  6. Directive (EU) 2016/2102 of the European Parliament: Directive (EU) 2016/2102 of the European Parliament and of the Council of 26 October 2016 on the accessibility of the websites and mobile applications of public sector bodies (Text with EEA relevance). http://data.europa.eu/eli/dir/2016/2102/oj. Accessed 27 June 2019

  7. European Telecommunications Standards Institute: Accessibility requirements suitable for public procurement of ICT products and services in Europe, EN 301 549 V1.1.2 (2015). https://www.etsi.org/deliver/etsi_en/301500_301599/301549/01.01.02_60/en_301549v010102p.pdf

  8. Hassenzahl, M.: User experience and experience design. In: Soegaard, M., Dam, R.F. (eds.) The Encyclopedia of Human–Computer Interaction, 2nd edn. The Interaction Design Foundation, Århus (2013)

    Google Scholar 

  9. Heitlager, I., Kuipers, T., Visser, J.: A practical model for measuring maintainability. In: 6th International Conference on the Quality of Information and Communications Technology (QUATIC 2007), pp. 30–39. IEEE Computer Society (2007)

    Google Scholar 

  10. International organisation for standardisation: ISO 9241-210: 2010. Ergonomics of human-system interaction - Part 210: Human-centred design process for interactive systems (2010)

    Google Scholar 

  11. Jia, Y., Larusdottir, M.K., Cajander, Å.: The usage of usability techniques in scrum projects. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds.) HCSE 2012. LNCS, vol. 7623, pp. 331–341. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34347-6_25

    Chapter  Google Scholar 

  12. Jokela, T., Laine, J., Nieminen, M.: Usability in RFP’s: the current practice and outline for the future. In: Kurosu, M. (ed.) HCI 2013. LNCS, vol. 8005, pp. 101–106. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39262-7_12

    Chapter  Google Scholar 

  13. Kelly, B., Sloan, D., Phipps, L., Petrie, H., Hamilton, F.: Forcing standardization or accommodating diversity?: A framework for applying the WCAG in the real world. In: Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A), pp. 46–54. ACM (2005). https://doi.org/10.1145/1061811.1061820

  14. Lallemand, C., Guillaume, G., Vincent, K.: User experience: a concept without consensus? Exploring practitioners’ perspectives through an international survey. Comput. Hum. Behav. 43, 35–48 (2015)

    Google Scholar 

  15. Law, E.L., Lárusdóttir, M.K.: Whose experience do we care about? Analysis of the fitness of Scrum and Kanban to user experience. International Journal of Human-Computer Interaction 31(9), 584–602 (2015)

    Google Scholar 

  16. Manifesto for Agile Software Development homepage. https://agilemanifesto.org/. Accessed 27 June 2019

  17. Ohno, T.: The Toyota Production System: Beyond Large-Scale Production. Productivity Press, Portland (1988)

    Google Scholar 

  18. OWASP Homepage, https://www.owasp.org, last accessed 27th June, 2019

  19. Preece, J., Rogers, Y., Sharp, H.: Interaction Design: Beyond Human-Computer Interaction, 5th edn. Wiley, New York (2019)

    Google Scholar 

  20. Sjøberg, D.I.K.: The relationship between software process, context and outcome. In: Abrahamsson, P., Jedlitschka, A., Nguyen Duc, A., Felderer, M., Amasaki, S., Mikkonen, T. (eds.) PROFES 2016. LNCS, vol. 10027, pp. 3–11. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-49094-6_1

    Chapter  Google Scholar 

  21. Schwaber, K.: Scrum development process. In: SIGPLAN Notices, vol. 30, no. 10 (1995)

    Google Scholar 

  22. Tarkkanen, K., Harkke, V.: Evaluation for evaluation: usability work during tendering process. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2015), pp. 2289–2294. ACM, New York (2015). https://doi.org/10.1145/2702613.2732851

  23. Version One: 13th Annual State of Agile survey (2019). https://www.stateofagile.com/#ufh-i-521251909-13th-annual-state-of-agile-report/473508. Accessed 27 June 2019

Download references

Author information

Authors and Affiliations

  1. Reykjavik University, Menntavegur 1, 102, Reykjavik, Iceland

    Marta Kristin Larusdottir & Marcel Kyas

Authors
  1. Marta Kristin Larusdottir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marcel Kyas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marta Kristin Larusdottir .

Editor information

Editors and Affiliations

  1. University of West London, London, UK

    José Abdelnour Nocera

  2. Cyprus University of Technology, Limassol, Cyprus

    Antigoni Parmaxi

  3. Nice Sophia Antipolis University, Sophia Antipolis, France

    Marco Winckler

  4. Cardiff University, Cardiff, UK

    Fernando Loizides

  5. Polythecnic University of Bari, Bari, Italy

    Carmelo Ardito

  6. Vishwakarma Institute of Technology, Pune, India

    Ganesh Bhutkar

  7. RheinMain University of Applied Sciences, Wiesbaden, Germany

    Peter Dannenmann

Rights and permissions

Reprints and permissions

Copyright information

© 2020 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Larusdottir, M.K., Kyas, M. (2020). Assessing the Performance of Agile Teams. In: Abdelnour Nocera, J., et al. Beyond Interactions. INTERACT 2019. Lecture Notes in Computer Science(), vol 11930. Springer, Cham. https://doi.org/10.1007/978-3-030-46540-7_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-46540-7_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-46539-1

  • Online ISBN: 978-3-030-46540-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation