Skip to main content
SpringerLink
Log in

Using Mouse and Keyboard Dynamics to Detect Cognitive Stress During Mental Arithmetic

  • Conference paper
  • First Online:
Intelligent Systems in Science and Information 2014 (SAI 2014)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 591))

Included in the following conference series:

Abstract

To build a personalized e-learning system that can deliver adaptive learning content based on student’s cognitive effort and efficiency, it is important to develop a construct that can help measuring perceived mental state, such as stress and cognitive load. The construct must be able to be quantified, computerized and automated. Our research investigates how mouse and keyboard dynamics analyses could be used to detect cognitive stress, which is induced by high mental arithmetic demand with time pressure, without using intrusive and expensive equipment. The research findings suggest that when task demand increased, task error, task duration, passive attempt, stress perception and mouse idle duration may increase, while mouse speed, left mouse click and keystroke speed decreased. The significant effects of task demand and time pressure on mouse and keystroke behaviours suggest that stress evaluation from these input devices is potentially useful for designing an adaptive e-learning system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    MIO was removed later due to inhomogeneous data.

  2. 2.

    MCR was removed later due to no data.

  3. 3.

    EK is removed due to insufficient data for BSK and no data for DK.

References

  1. Beilock, S.L., Ramirez, G.: On the interplay of emotion and cognitive control: implications for enhancing academic achievement. Psychol. Learn. Motiv. Adv. Res. Theory 55, 137 (2011)

    Article  Google Scholar 

  2. Paas, F.G.W.C., Van Merriënboer, J.J.G.: Instructional control of cognitive load in the training of complex cognitive tasks. Educ. Psychol. Rev. 6, 351–371 (1994)

    Article  Google Scholar 

  3. Kirschner, P.A.: Cognitive load theory: implications of cognitive load theory on the design of learning. Learn. Instr. 12, 1–10 (2002)

    Article  Google Scholar 

  4. Chatzara, K., Karagiannidis, C., Stamatis, D.: Students attitude and learning effectiveness of emotional agents. 2010 IEEE 10th international conference on advanced learning technologies (ICALT), pp. 558–559 (2010)

    Google Scholar 

  5. Selye, H.: The Stress in Life. McGraw-Hill, New Jersey (1956)

    Google Scholar 

  6. Setz, C., Arnrich, B., Schumm, J., La Marca, R., Troster, G., Ehlert, U.: Discriminating stress from cognitive load using a wearable EDA device. IEEE Trans. Inf. Technol. Biomed. 14, 410–417 (2010)

    Article  Google Scholar 

  7. Owen, A.M., McMillan, K.M., Laird, A.R., Bullmore, E.: N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Hum. Brain Mapp. 25, 46–59 (2005)

    Article  Google Scholar 

  8. Sloan, R.P., Korten, J.B., Myers, M.M.: Components of heart rate reactivity during mental arithmetic with and without speaking. Physiol. Behav. 50, 1039–1045 (1991)

    Article  Google Scholar 

  9. Imbo, I., Vandierendonck, A.: Do multiplication and division strategies rely on executive and phonological working memory resources? Mem. Cognit. 35, 1759–1771 (2007)

    Article  Google Scholar 

  10. Sweller, J., Ayres, P., Kalyuga, S.: Cognitive Load Theory. Springer, Berlin (2011)

    Book  Google Scholar 

  11. Weinberg, A., Ferri, J., Hajcak, G.: Interactions between attention and emotion. Handb. Cogn. Emot. 35 (2013)

    Google Scholar 

  12. Hajcak, G., Dunning, J.P., Foti, D.: Neural response to emotional pictures is unaffected by concurrent task difficulty: an event-related potential study. Behav. Neurosci. 121, 1156 (2007)

    Article  Google Scholar 

  13. Lim, Y.M., Ayesh, A., Stacey, M.: The effects of menu design on users’ emotions, search performance and mouse behaviour. In: Patel, S., Wang, Y., Kinsner, W., Patel, D., Fariello, G., and Zadeh, L.A. (eds.) IEEE 13th international conference on cognitive informatics & cognitive computing, pp. 541–549. IEEE, London (2014)

    Google Scholar 

  14. Tsoulouhas, G., Georgiou, D., Karakos, A.: Detection of learner’s™ affective state based on mouse movements. J. Comput. 3, 9–18 (2011)

    Google Scholar 

  15. Pusara, M., Brodley, C.E.: User Re-authentication via Mouse Movements. In: Proceedings of the 2004 ACM workshop on visualization and data mining for computer security, pp. 1–8, ACM, New York (2004)

    Google Scholar 

  16. Shen, C., Cai, Z., Guan, X., Du, Y., Maxion, R.: User authentication through mouse dynamics. IEEE Trans. Inf. Forensics Secur. 8(1), 16–30 (2012)

    Article  Google Scholar 

  17. Shen, C., Cai, Z., Guan, X.: Continuous authentication for mouse dynamics: a pattern-growth approach. Dependable systems and networks (DSN). 42nd annual IEEE/IFIP international conference on 2012, pp. 1–12 (2012)

    Google Scholar 

  18. Shen, C., Cai, Z., Guan, X., Sha, H., Du, J.: Feature Analysis of Mouse Dynamics in Identity Authentication and Monitoring. In: Proceedings of the 2009 IEEE international conference on communications, pp. 673–677, IEEE Press, Piscataway (2009)

    Google Scholar 

  19. Vizer, L.M.: Detecting Cognitive and Physical Stress Through Typing Behavior. In: Proceedings of the 27th international conference extended abstracts on human factors in computing systems CHI EA 09. 3113 (2009)

    Google Scholar 

  20. Filho, J.R.M., Freire, E.O.: On the equalization of keystroke timing histograms. Pattern Recogn. Lett. 27, 1440–1446 (2006)

    Article  Google Scholar 

  21. Cavoukian, A.: Privacy by design: origins, meaning, and prospects for assuring privacy and trust in the information era. In: Yee, G. (ed.) Privacy protection measures and technologies in business organizations: aspects and standards, pp. 170–208. IGI Global, Hershey (2012)

    Google Scholar 

  22. IBM: multivariate general linear modeling, http://pic.dhe.ibm.com/infocenter/spssstat/v21r0m0/index.jsp?topic=/com.ibm.spss.statistics.cs/glmm_intro.htm

  23. IBM: GLM univariate analysis, http://pic.dhe.ibm.com/infocenter/spssstat/v20r0m0/index.jsp?topic=/com.ibm.spss.statistics.help/idh_glmu.htm

Download references

Author information

Authors and Affiliations

  1. Faculty of Applied Sciences and Computing, Tunku Abdul Rahman University College, Kuala Lumpur, Malaysia

    Yee Mei Lim

  2. Faculty of Technology, De Montfort University, Leicester, UK

    Aladdin Ayesh & Martin Stacey

Authors
  1. Yee Mei Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aladdin Ayesh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Martin Stacey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yee Mei Lim .

Editor information

Editors and Affiliations

  1. Graduate School of Science and Engineering, Saga University, Saga, Japan

    Kohei Arai

  2. The Science and Information (SAI) Organization, London, United Kingdom

    Supriya Kapoor

  3. The Science and Information (SAI) Organization, London, United Kingdom

    Rahul Bhatia

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Lim, Y.M., Ayesh, A., Stacey, M. (2015). Using Mouse and Keyboard Dynamics to Detect Cognitive Stress During Mental Arithmetic. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems in Science and Information 2014. SAI 2014. Studies in Computational Intelligence, vol 591. Springer, Cham. https://doi.org/10.1007/978-3-319-14654-6_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14654-6_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14653-9

  • Online ISBN: 978-3-319-14654-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation