Abstract
The objective of this research is to investigate how many users are needed in usability testing to identify psychophysiological pain points (PPP) experienced by users during a human-computer interaction (HCI). Fifteen subjects were tested in a new user training context and results show that out of 15 participants, 82% of the total PPP were experienced after 9 participants. Calculations using 1000 trials of random orders were then performed to demonstrate the independence of the order. This research provides guidelines about what could be an ideal sample size for user test using psychophysiological measures.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Platzer, D.: Regarding the pain of users: towards a genealogy of the “pain point”. In: Ethnographic Praxis in Industry Conference Proceedings, pp. 301–315 (2018)
Dirican, A.C., Göktürk, M.: Psychophysiological measures of human cognitive states applied in human computer interaction. Procedia Computer Science 3, 1361–1367 (2011)
Bruun, A., Heintz, M., Law, L.C., Alkly, L.H.A.: Understanding the relationship between frustration and the severity of usability problems: what can psychophysiological data (not) tell us? In: Proceedings of the 2016 CHI Conference on Human Factors in Computing System, pp. 3975–3987. ACM, New York (2016)
de Guinea, A.O., Titah, R., Léger, P.M.: Explicit and implicit antecedents of users’ behavioral beliefs in information systems: a neuropsychological investigation. JMIS 30(4), 179–210 (2014)
Giroux-Huppé, C., Sénécal, S., Fredette, M., Chen, S.L., Demolin, B., Léger, P.M.: Identifying psychophysiological pain points in the online user journey: the case of online grocery. In: The HCI International 2019 Conference Proceedings (Forthcoming)
Tullis, T., Albert, W.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics, 2nd edn. Morgan Kaufmann, Burlington (2013)
Lewis, J.R.: Sample sizes for usability tests: mostly math, not magic. Interactions 13, 29–33 (2006)
Nielsen, J., Landauer, T.K.: A mathematical model of the finding of usability problem. In: Proceedings of the INTERCHI 1993 Conference on Human Factors in Computing Systems, pp. 206–213. IOS Press, Amsterdam (1993)
Nielsen, J.: Estimating the number of subjects need for a thinking aloud test. IJHCS 41, 385–397 (1994)
Schmettow, M.: Sample size in usability studies. CACM 55(4), 64–70 (2012)
Rohrer, C.: When to use which user-experience research methods. Nielsen Norman Group (2014)
Vernette, E., Filser, M., Giannelloni, J.L.: Études Marketing Appliquées: De La Stratégie Au Mix: Analyses et Tests Pour Optimiser Votre Action Marketing. Dunod, Malakoff (2008)
Cockburn, A., Quinn, P., Gutwin, C.: Examining the peak-end effects of subjective experience. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2015), pp. 357–366 (2015)
Ganglbauer, E., Schrammel, J., Deutsch, S., Tscheligi, M.: Applying psychophysiological methods for measuring user experience: possibilities, challenges and feasibility. In: User Experience Evaluation Methods in Product Development (UXEM 2009) (2009)
Andreassi, J.L.: Psychophysiology: Human Behavior and Physiological Response. Lawrence Erlbaum Associates Inc, Mahwah (2000)
Maia, C.L.B., Furtado, E.S.: A study about psychophysiological measures in user experience monitoring and evaluation. In: Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, pp. 7:1–7:9. ACM, New York (2016)
Loijens, L., Krips, O.: FaceReader Methodology Note. Wageningen, Noldus (2018)
Dawson, M.E.: The electrodermal system. In: Cacioppo, J.T., Tassinary, L.G., Berntson, G. (eds.) Handbook of Psychophysiology. Cambridge University Press, Cambridge (2007)
Ekman, P., Friesen, W.V.: Manual for the Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1978)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Lamontagne, C. et al. (2020). User Test: How Many Users Are Needed to Find the Psychophysiological Pain Points in a Journey Map?. In: Ahram, T., Taiar, R., Colson, S., Choplin, A. (eds) Human Interaction and Emerging Technologies. IHIET 2019. Advances in Intelligent Systems and Computing, vol 1018. Springer, Cham. https://doi.org/10.1007/978-3-030-25629-6_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-25629-6_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25628-9
Online ISBN: 978-3-030-25629-6
eBook Packages: EngineeringEngineering (R0)