Improving Usability Evaluation by Automating a Standardized Usability Questionnaire

  • Priscilla Gonçalves da Silva e Souza
  • Edna Dias CanedoEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10918)


Usability is one of the factors that determines the success of a software system. Aiming to improve it’s usability, it is necessary to evaluate the interfaces using scientific evaluation methods, like questionnaires. Often the results of these evaluations are different when performed by different interface designers, indicating lack of sistematicity of evaluation results. Questionnaires can be automated to support usability evaluation, facilitating the collection and summarization of data. This paper analyzes the automating possibility of a standardized usability questionnaire for further automation. A bibliographical research was carried out about Human-Computer Interaction concepts, usability, usability evaluation methods (including questionnaires) and automation. A systematic review was conducted to identify automated usability questionnaires. The Post-Study Systems Usability Questionnaire (PSSUQ) was chosen to be automated because it is small, free and highly reliable. Analysis of the users and specification of the system requirements and architecture were made.


Usability Usability evaluation Usability questionnaire Automation Mobile devices 



The authors would like to thank the usability professionals who provided information on interface designers and evaluated the prototype of the system.


  1. 1.
    Nielsen, J.: Usability Engineering. Elsevier, New York (1993)zbMATHGoogle Scholar
  2. 2.
    Rubin, J., Chisnell, D.: Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests, 2nd edn. Wiley, Hoboken (2008)Google Scholar
  3. 3.
    Sharp, H., Rogers, Y., Preece, J.: Interaction Design: Beyond Human-Computer Interaction, 4th edn. Wiley, Hoboken (2015)Google Scholar
  4. 4.
    Ivory, M.Y., Hearst, M.A.: The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv. 33, 470–516 (2001)CrossRefGoogle Scholar
  5. 5.
    Shneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction, 5th edn. Pearson Education India, Delhi (2010)Google Scholar
  6. 6.
    Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research, 2nd edn. Morgan Kaufman, Burlington (2016)Google Scholar
  7. 7.
    Nielsen, J., Budiu, R.: Mobile Usability. MITP-Verlags GmbH & Co. KG, Blaufelden (2013)Google Scholar
  8. 8.
    Kitchenham, B., Brereton, O.P., Budgen, D., Turner, M., Bailey, J., Linkman, S.: Systematic literature reviews in software engineering-a systematic literature review. Inf. Softw. Tech. 51, 7–15 (2009)CrossRefGoogle Scholar
  9. 9.
    Galster, M., Weyns, D., Tofan, D., Michalik, B., Avgeriou, P.: Variability in software systems—a systematic literature review. IEEE Trans. Softw. Eng. 40, 282–306 (2014)CrossRefGoogle Scholar
  10. 10.
    Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering. Technical report TR-001, MIT Research Lab, Keele University and Durham University (2010)Google Scholar
  11. 11.
    Itakura, F.T.: Towabe: uma ferramenta para avaliação de usabilidade de aplicações para web. Universidade Federal do Paraná (2001)Google Scholar
  12. 12.
    Assila, A., Bouhlel, M.S.: A web questionnaire generating tool to aid for interactive systems quality subjective assessment. In: International Conference on Control, Decision and Information Technologies (CoDIT), pp. 815–821. IEEE (2013)Google Scholar
  13. 13.
    Wich, M., Kramer, T.: Enhanced human-computer interaction for business applications on mobile devices: a design-oriented development of a usability evaluation questionnaire. In: 48th Hawaii International Conference on System Sciences (HICSS), pp. 472–481. IEEE (2015)Google Scholar
  14. 14.
    Kalawsky, R.S.: VRUSE - a computerized diagnostic tool: for usability evaluation of virtual/synthetic environment systems. Appl. Ergon. 30, 11–25 (1999)CrossRefGoogle Scholar
  15. 15.
    Pressman, R., Maxim, B.: Engenharia de Software, 8th edn. McGraw Hill Brasil, São Paulo (2016)Google Scholar
  16. 16.
    Lewis, J.R.: Handbook of Human Factors and Ergonomics. Wiley, Hoboken (2006)Google Scholar
  17. 17.
    Larman, C.: Applying UML and Patterns: An Introduction to Object Oriented Analysis and Design and Interative Development. Pearson Education India, Delhi (2012)Google Scholar
  18. 18.
    Barros, T., Silva, M., Espínola, E.: State MVC: Estendendo o padrão MVC para uso no desenvolvimento de aplicações para dispositivos mõveis. In: Sexta Conferência Latino-Americana em Linguagens de Padrões para Programação (2007)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Priscilla Gonçalves da Silva e Souza
    • 1
  • Edna Dias Canedo
    • 1
    Email author
  1. 1.Computer Science DepartmentUniversity of Brasília (UnB)BrasíliaBrazil

Personalised recommendations