Abstract
Numerous standardized questionnaires like the System Usability Scale and Net Promoter Score have been developed to provide reliable and valid measurement of subjective satisfaction. Few studies, however, examine the perceived usability and preferences of questionnaires by the raters or end users themselves. In this study, 20 participants evaluated different types of questionnaires as well as ranked and discussed their subjective preferences for them. We found that 65 % of participants chose the questionnaire with enhanced design features (e.g., color-coded ratings, user experience examples, and specific/global comments) as well as measurement of user experience beyond usability as the most preferred questionnaire, while 80 % of participants chose the questionnaire that measured user experience with semantic-differential rating scales as the least preferred. Based on participant feedback, we provide several questionnaire design recommendations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brooke, J.: SUS: a “quick and dirty” usability scale. Usabiltiy Eval. Ind. 189–194 (1996)
Reichheld, F.F.: The one number you need to grow. Harvard Bus. Rev. 81, 46–54 (2003)
Lund, A.: Measuring usability with the USE questionnaire. Usability Interface 8(2), 3–6 (2001)
Lewis, J., Sauro, J.: The factor structure of the system usability scale. In: Human Centered Design, HCII 2009, pp. 94–103. Springer, Berlin (2009)
Tullis, T.S., Stetson, J.N.: A comparison of questionnaires for assessing website usability. In: Usability Professional Association Conference, pp. 1–12 (2004)
Sauro, J.: SUPR-Q: a comprehensive measure of the quality of the website user experience. J. Usability Stud. 68–86 (2015)
Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 213–218 (1988)
Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Interact. 6, 574–594 (2008)
Abby Covert.: Does it have legs? Information architecture heuristics for interaction designers. Retrieved 15 June 2015 from http://www.slideshare.net/AbbyCovert/information-architecture-heuristics (2011)
Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256 (1990)
Morville, P.: User experience honeycomb. Retrieved 22 June 2015 from http://semanticstudios.com/user_experience_design (2004)
Resmini, A., Rosati, L.: Pervasive Information Architecture: Designing Cross-Channel User Experiences. Elsevier Inc., Burlington (2011)
Finstad, K.: The system usability scale and non-native English speakers. J. Usability Stud. 185–188 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
“Tina” Lee, S., Ivory, M. (2017). What Makes a Good UX Questionnaire? User-Centered Scorecard Development. In: Chung, W., Shin, C. (eds) Advances in Affective and Pleasurable Design . Advances in Intelligent Systems and Computing, vol 483. Springer, Cham. https://doi.org/10.1007/978-3-319-41661-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-41661-8_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41660-1
Online ISBN: 978-3-319-41661-8
eBook Packages: EngineeringEngineering (R0)