Usability Work in Agile Systems Development Practice: A Systematic Review

  • Adeola Wale-Kolade
  • Peter Axel Nielsen
  • Tero Päivärinta
Conference paper


In this chapter we present the results of a systematic literature review of the recommendations in the existing research literature on usability work in agile systems development. The review contributes by summarizing the literature in light of seven claims about how to integrate usability work into an agile development project. By analyzing the claims we show how the previous literature provides grounds, warrants, backing, rebuttal, and qualification with regard to each of them. From this comprehensive overview of the literature we then discuss a research agenda with a particular focus on how situational factors for the claims must be researched and how this must encompass identified rebuttals and qualifications.


Fatigue Posit 


  1. 1.
    Adikari S, McDonald C et al (2009) Little design up-front: a design science approach to integrating usability into agile requirements engineering. In: Jacko J (ed) Human-computer interaction. New trends, vol 5610. Springer, Berlin/Heidelberg, pp 549–558CrossRefGoogle Scholar
  2. 2.
    Albisetti M (2010) Launchpad’s quest for a better and agile user interface. Agile processes in software engineering and extreme programming, pp 244–250Google Scholar
  3. 3.
    Ambler SW (2008) Tailoring usability into agile software development projects. In: Law EL-C, Hvannberg ET, Cockton G (eds) Maturing usability. Springer, London, pp 75–95CrossRefGoogle Scholar
  4. 4.
    Armitage J (2004) Are agile methods good for design? Interactions 11(1):14–23CrossRefGoogle Scholar
  5. 5.
    Balázs Polgár P, Biró M (2011) The usability approach in software process improvement systems, software and service process improvement. In: O’Connor RV, Pries-Heje J, Messnarz R (eds) Springer, Berlin/Heidelberg, vol 172. pp 133–142Google Scholar
  6. 6.
    Barksdale JT, McCrickard DS (2010) Concept mapping in agile usability: a case study. In: Proceedings of the 28th of the international conference extended abstracts on human factors in computing systems. ACM, Atlanta, Georgia, USA, pp 4691–4694Google Scholar
  7. 7.
    Belchev B, Baker P (2009) Improving obama campaign software: learning from users. IEEEGoogle Scholar
  8. 8.
    Benigni G, Gervasi O et al (2010) USABAGILE_Web: a web agile usability approach for web site design computational science and its applications—ICCSA 2010. In: Taniar D, Gervasi O, Murgante B, Pardede E, Apduhan B (eds) vol 6017. Springer, Berlin/Heidelberg, pp 422–431Google Scholar
  9. 9.
    Bevan N (2009) What is the difference between the purpose of usability and user experience evaluation methods. In: Proceedings of the workshop UXEM’09 (INTERACT’09), Uppsala, SwedenGoogle Scholar
  10. 10.
    Beyer H, Holtzblatt K et al (2004) An agile customer-centered method: rapid contextual design. In: Zannier C, Erdogmus H, Lindstrom L (eds) Extreme programming and agile methods—XP/Agile Universe 2004, vol 3134. Springer, Berlin/Heidelberg, pp 527–554Google Scholar
  11. 11.
    Blomkvist S (2005) Towards a model for bridging agile development and user-centered design. In: Seffah A, Gulliksen J, Desmarais MC (eds) Human-centered software engineering—integrating usability in the software development lifecycle, vol 8. Springer, Netherlands, pp 219–244CrossRefGoogle Scholar
  12. 12.
    Bonacin R, Baranauskas MCC et al (2009) An agile process model for inclusive software development. In: Filipe J, Cordeiro J (eds) Enterprise information systems, vol 24. Springer, Berlin/Heidelberg, pp 807–818CrossRefGoogle Scholar
  13. 13.
    Broschinsky D, Baker L (2008) Using persona with XP at LANDesk software, an avocent company. Agile Conference, 2008. Agile ’08. IEEEGoogle Scholar
  14. 14.
    Budwig M, Jeong S et al (2009) When user experience met agile: a case study. In: Proceedings of the 27th international conference extended abstracts on human factors in computing systems. ACM, Boston, MA, USA, pp 3075–3084Google Scholar
  15. 15.
    Chamberlain S, Sharp H et al (2006) Towards a framework for integrating agile development and user-centred design. In: Abrahamsson P, Marchesi M, Succi G (eds) Extreme programming and agile processes in software engineering, vol 4044. Springer, Berlin/Heidelberg, pp 143–153CrossRefGoogle Scholar
  16. 16.
    Cho L (2009) Adopting an agile culture a user experience team’s journey. Agile conference, 2009. AGILE ’09. IEEEGoogle Scholar
  17. 17.
    Clarke P, O’Connor RV (2012) The situational factors that affect the software development process: towards a comprehensive reference framework. Inform Software Technol 54(5):433–447CrossRefGoogle Scholar
  18. 18.
    Conboy K (2009) Agility from first principles: reconstructing the concept of agility in information systems development. Inform Syst Res 20(3):329–354CrossRefGoogle Scholar
  19. 19.
    Constantine LL, Lockwood LAD (2002) Usage-centered engineering for Web applications. IEEE Software 19(2):42–50CrossRefGoogle Scholar
  20. 20.
    Detweiler M (2007) Managing UCD within agile projects. Interactions 14(3):40–42CrossRefGoogle Scholar
  21. 21.
    Düchting M, Zimmermann D et al (2007) Incorporating user centered requirement engineering into agile software development. In: Jacko J (ed) Human-computer interaction. Interaction design and usability, vol 4550. Springer, Berlin/Heidelberg, pp 58–67CrossRefGoogle Scholar
  22. 22.
    Esteves M, Andrade V (2011) Designing interaction concepts, managing customer expectation and mastering agile development in rich application product development. In: Jacko J (ed) Human-computer interaction design and development approaches, vol 6761. Springer, Berlin/Heidelberg, pp 54–62CrossRefGoogle Scholar
  23. 23.
    Evnin J, Pries M (2008) Are you sure? Really? A contextual approach to agile user research, agile conference, 2008. Agile ’08. IEEEGoogle Scholar
  24. 24.
    Federoff M, Courage C (2009) Successful user experience in an agile enterprise environment. In: Smith M, Salvendy G (eds) Human interface and the management of information. Designing information environments, vol 5617. Springer, Berlin/Heidelberg, pp 233–242CrossRefGoogle Scholar
  25. 25.
    Ferreira J, Noble J et al (2007) Up-front interaction design in agile development. In: Concas G, Damiani E, Scotto M, Succi G (eds) Agile processes in software engineering and extreme programming, vol 4536. Springer, Berlin/Heidelberg, pp 9–16CrossRefGoogle Scholar
  26. 26.
    Ferreira J, Sharp H et al (2011) User experience design and agile development: managing cooperation through articulation work. Software Pract Ex 41(9):963–974CrossRefGoogle Scholar
  27. 27.
    Fox D, Sillito J et al (2008) Agile methods and user-centered design: how these two methodologies are being successfully integrated in industry. In: Proceedings of the Agile 2008, IEEE Computer Society, pp 63–72Google Scholar
  28. 28.
    Folmer E, Bosch J (2002) Architecting for usability: a survey. J Syst Software 70(1–2):61–78Google Scholar
  29. 29.
    Gonçalves J, Santos C (2011) POLVO-software for prototyping of low-fidelity interfaces in agile development. In: Human-computer interaction. Design and development approaches, pp 63–71Google Scholar
  30. 30.
    Gulliksen J, Göransson B et al (2003) Key principles for user-centred systems design. Behav Inform Technol 22(6):397–409CrossRefGoogle Scholar
  31. 31.
    Haikara J (2007) Usability in Agile software development: extending the interaction design process with personas approach. In: Concas G, Damiani E, Scotto M, Succi G (eds) Agile processes in software engineering and extreme programming, vol 4536. Springer, Berlin/Heidelberg, pp 153–156CrossRefGoogle Scholar
  32. 32.
    Hellmann TD, Hosseini-Khayat A, Maurer F (2010, April) Supporting test-driven development of graphical user interfaces using agile interaction design. In: Software Testing, Verification, and Validation Workshops (ICSTW), 2010 Third International Conference on (pp. 444–447). IEEEGoogle Scholar
  33. 33.
    Hertzum M, Clemmensen T (2012) How do usability professionals construe usability? Int J Hum Comput Stud 70(1):26–42CrossRefGoogle Scholar
  34. 34.
    Hodgetts P (2005) Experiences integrating sophisticated user experience design practices into agile processes, Agile conference, 2005. Agile ’05. IEEEGoogle Scholar
  35. 35.
    Hosseini-Khayat A, Hellmann TD et al (2010) Distributed and automated usability testing of low-fidelity prototypes, Agile conference, 2010. Agile ’10. IEEEGoogle Scholar
  36. 36.
    Hsieh H-F, Shannon SE (2005) Three approaches to qualitative content analysis. Qual Health Res 15(9):1277–1288CrossRefGoogle Scholar
  37. 37.
    Humayoun S, Dubinsky Y et al (2011) A three-fold integration framework to incorporate user–centered design into agile software development. In: Kurosu M (ed) Human centered design, vol 6776. Springer, Berlin/Heidelberg, pp 55–64CrossRefGoogle Scholar
  38. 38.
    Hussain Z, Slany W et al (2009) Investigating Agile user-centered design in practice: a grounded theory perspective. In: Holzinger A, Miesenberger K (eds) HCI and usability for e-inclusion, vol 5889. Springer, Berlin/Heidelberg, pp 279–289CrossRefGoogle Scholar
  39. 39.
    Hussain Z, Milchrahm H et al (2009) Integration of extreme programming and user-centered design: lessons learned. In: Maurer F, Abrahamsson P, Marchesi M et al (eds) Agile processes in software engineering and extreme programming, vol 31. Springer, Berlin/Heidelberg, pp 174–179CrossRefGoogle Scholar
  40. 40.
    Illmensee T, Muff A (2009) 5 users every friday: a case study in applied research. Agile conference, 2009. AGILE ’09Google Scholar
  41. 41.
    Jokela T, Abrahamsson P (2004) Usability assessment of an extreme programming project: close co-operation with the customer does not equal to good usability. In: Bomarius F, Iida H (eds) Product focused software process improvement, vol 3009. Springer, Berlin/Heidelberg, pp 393–407CrossRefGoogle Scholar
  42. 42.
    Kane D (2003) Finding a place for discount usability engineering in agile development: throwing down the gauntlet. Agile development conference, 2003. ADC 2003. Proceedings of the conference on Agile developmentGoogle Scholar
  43. 43.
    Kollmann J, Sharp H et al (2009) The importance of identity and vision to user experience designers on Agile projects. Agile conference, 2009. AGILE ’09Google Scholar
  44. 44.
    Krohn T, Kindsmüller M et al (2009) User-centered design meets feature-driven development: an integrating approach for developing the web application myPIM. In: Kurosu M (ed) Human centered design, vol 5619. Springer, Berlin/Heidelberg, pp 739–748CrossRefGoogle Scholar
  45. 45.
    Lee JC, Scott McCrickard D et al (2009) Examining the foundations of agile usability with eXtreme scenario-based design. Agile conference, 2009. AGILE ’09Google Scholar
  46. 46.
    Losada B, Urretavizcaya M et al (2011) Efficient building of interactive applications guided by requirements models. San Sebastian. 5648 LNCS: 481–484Google Scholar
  47. 47.
    Memmel T, Gundelsweiler F et al (2007) Agile human-centered software engineering. In: Proceedings of the 21st British HCI group annual conference on people and computers: HCI…but not as we know it—volume 1. British Computer Society, University of Lancaster, UK, pp 167–175Google Scholar
  48. 48.
    Meszaros G, Aston J (2006) Adding usability testing to an agile project. Agile conference, 2006Google Scholar
  49. 49.
    Miller L (2005) Case study of customer input for a successful product, agile conference, 2005. Agile ’05. IEEEGoogle Scholar
  50. 50.
    Najafi M, Toyoshiba L (2008) Two case studies of user experience design and agile development, agile conference, 2008. Agile ’08. IEEEGoogle Scholar
  51. 51.
    Norman D (2006) Why doing user observations first is wrong. Interactions 13(4):50CrossRefGoogle Scholar
  52. 52.
    Obendorf H, Finck M (2008) Scenario-based usability engineering techniques in agile development processes. CHI ’08 extended abstracts on human factors in computing systems. ACM, Florence, Italy, pp 2159–2166Google Scholar
  53. 53.
    Paelke V, Nebe K (2009) Dynamic maps for future navigation systems: agile design exploration of user interface concepts. In: Human-computer interaction. Ambient, ubiquitous and intelligent interaction, pp 169–178Google Scholar
  54. 54.
    Patton J (2002) Designing requirements: incorporating usage-centered design into an agile SW development process. In: Wells D, Williams L (eds) Extreme programming and agile methods—XP/agile Universe 2002, vol 2418. Springer, Berlin/Heidelberg, pp 95–102Google Scholar
  55. 55.
    Peixoto CSA, da Silva AEA (2009) A conceptual knowledge base representation for agile design of human-computer interface. Intelligent information technology application, 2009. IITA 2009. Third international symposium onGoogle Scholar
  56. 56.
    Scott KM (2009) FEATURE: is usability obsolete? Interactions 16(3):6–11CrossRefGoogle Scholar
  57. 57.
    Seffah A, Djouab R et al (2001) Comparing and reconciling usability-centered and use case-driven requirements engineering processes. IEEE Software 0, pp 132Google Scholar
  58. 58.
    Silva da Silva T, Martin A et al (2011) User-centered design and agile methods: a systematic review. Agile conference (AGILE) 2011. Salt Lake City, UTGoogle Scholar
  59. 59.
    Singh M (2008) U-SCRUM: an agile methodology for promoting usability. Agile, 2008. AGILE ’08. ConferenceGoogle Scholar
  60. 60.
    Sohaib O, Khan K (2010) Integrating usability engineering and agile software development: a literature review. Computer design and applications (ICCDA), 2010 international conference onGoogle Scholar
  61. 61.
    Sy D (2007) Adapting usability investigations for agile user-centered design. J Usabil Stud 2(3)Google Scholar
  62. 62.
    Toulmin SE, Rieke RD et al (1984) An introduction to reasoning. Macmillan, New YorkGoogle Scholar
  63. 63.
    Ungar J (2008) The design studio: interface design for agile teams, agile conference, 2008. Agile ’08. IEEEGoogle Scholar
  64. 64.
    Webster J, Watson R (2002) Analyzing the past to prepare for the future: writing a literature review. MIS Quarterly 26:13–23Google Scholar
  65. 65.
    Williams H, Ferguson A (2007) The UCD perspective: before and after agile. AGILE 2007Google Scholar
  66. 66.
    Winter J, Rönkkö K et al (2011) Meeting organisational needs and quality assurance through balancing agile and formal usability testing results software engineering techniques. In: Huzar Z, Koci R, Meyer B, Walter B, Zendulka J (eds) vol 4980. Springer, Berlin/Heidelberg, pp 275–289Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2013

Authors and Affiliations

  • Adeola Wale-Kolade
    • 1
  • Peter Axel Nielsen
    • 1
    • 2
  • Tero Päivärinta
    • 3
  1. 1.Department of Information SystemsUniversity of AgderAgderNorway
  2. 2.Research Centre for Socio-Interactive DesignAalborg UniversityAalborgDenmark
  3. 3.Department of Computer Science, Electrical and Space Engineering Computer and Systems ScienceLuleå University of TechnologyLuleåSweden

Personalised recommendations