Abstract
An adaptive interaction system, which is aware of the user’s current cognitive load (CL), can change its response, presentation and flow of interaction material accordingly, to improve user’s experience and performance. We present a speech content analysis approach to CL measurement, which employs users’ linguistic features of speech to determine their experienced CL level. We show analyses of several linguistic features, extracted from speech of personnel working in computerized incident control rooms and involved in highly complex bushfire management tasks in Australia. We present the results of linguistic features showing significant differences between the speech from the cognitively low load and high load tasks. We also discuss how the method may be used for user interface evaluation and interaction design improvement.
Chapter PDF
Similar content being viewed by others
Keywords
References
Kramer, A.F.: Physiological metrics of mental workload: a review of recent progress. In: Damos, D.L. (ed.) Multiple-task performance, pp. 279–328. Taylor and Francis, London (1991)
Ark, W., et al.: The Emotion Mouse. In: Bullinger, Ziegler. (eds.) HCI: Ergonomics and User Interfaces 1, vol. 1, pp. 818–823. Lawrence Erlbaum Assoc., London (1999)
Windell, D., Wiebe, E.N.: A Comparison of Two Mental Workload Instruments in Multimedia Instruction. In: Proc. HFES 2006. Human Factors and Ergonomics Society Press, Santa Monica (2006)
Yin, B., Chen, F., Ruiz, N., Ambikairajah, E.: Speech-based Cognitive Load Monitoring System. In: Proc. ICASSP 2008, pp. 2041–2044. IEEE Press, Los Alamitos (2008)
Chandler, P., Sweller, J.: Cognitive load theory and the format of instruction. Cognition and Instruction 8(4), 293–332 (1991)
Paas, F., Tuovinen, J.E., et al.: Cognitive Load Measurement as a Means to Advance Cognitive Load Theory. Educational Psychologist 38(1), 63–71 (2003)
Mayer, R.E.: Multimedia learning. Cambridge University Press, Cambridge (2001)
Berthold, A., Jameson, A.: Interpreting Symptoms of Cognitive Load in Speech Input. In: User Modeling 1999. Springer, Wien (1999)
Khawaja, M.A., Ruiz, N., Chen, F.: Potential Speech Features for Cognitive Load Measurement. In: Proc. OzCHI 2007. ACM Press, New York (2007)
Muller, C., et al.: Recognizing time pressure and cognitive load on the basis of speech: An experimental study. In: Proc. 8th International Conf. User Modeling, pp. 24–33 (2001)
Sexton, J., Helmreich, R.: Analyzing Cockpit Communication: The links between language, performance, error, and workload. University of Texas Team Research Project, Austin, USA (2000)
Stirman, S.W., Pennebaker, J.W.: Word Use in the Poetry of Suicidal and Nonsuicidal Poets. In: Psychosomatic Medicine, vol. 63. American Psychosomatic Society Press (2001)
Kramer, A., Oh, L.M., Fussell, S.R.: Using Linguistic Features to Measure Presence in Computer-Mediated Communication. In: Proc. CHI 2006. ACM Press, New York (2006)
Australasian Fire Authorities Council, The Australasian Inter-service Incident Management System (AIIMS), AFAC Limited, 3rd edn. (2005), http://www.afac.com.au
Transana, University of Wisconsin-Madison Center for Education Research, http://www.transana.org
Pennebaker, J.W., et al.: The Development and Psychometric Properties of LIWC 2007 (2007), www.liwc.net
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Khawaja, M.A., Chen, F., Owen, C., Hickey, G. (2009). Cognitive Load Measurement from User’s Linguistic Speech Features for Adaptive Interaction Design. In: Gross, T., et al. Human-Computer Interaction – INTERACT 2009. INTERACT 2009. Lecture Notes in Computer Science, vol 5726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03655-2_54
Download citation
DOI: https://doi.org/10.1007/978-3-642-03655-2_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03654-5
Online ISBN: 978-3-642-03655-2
eBook Packages: Computer ScienceComputer Science (R0)