Recognizing Cognitive Activities Through Eye Tracking
Eye detection and tracking is usually performed by using specific devices that allow to determine the pupil position in many different situations. We propose to use these techniques for recognizing cognitive activities that a potential user is carrying out in front of a computer. We use the images captured by a conventional web camera located over the computer display. Those image are processed and, after the face and facial landmarks are found, the user gaze is analyzed and the ethogram and several statistics associated to the eyes and gaze destination are computed. They are used for determining what is doing the user from a set of predefined activities.
KeywordsNeuroethology Activities recognition Eye tracking Screen-based eye tracker Non-invasive techniques
This work has been partially supported by FEDER funds through MINECO project TIN2017-85827-P.
- 1.Hof, R.: How do you Google? New eye tracking study reveals huge changes. https://www.forbes.com/sites/roberthof/2015/03/03/how-do-you-google-new-eye-tracking-study-reveals-huge-changes/. Accessed 11 Feb 2019
- 3.Weigel, P., Raab, M., Wollny, R.: Tactical decision making in team sports: a model of cognitive processes. Int. J. Sports Sci. 5(49), 128–138 (2015)Google Scholar
- 4.Gidlöf, K., Wallin, A., Dewhurst, R., Holmqvist, K.: Using eye tracking to trace a cognitive process: Gaze behaviour during decision making in a natural environment. J. Eye Mov. Res. 6(1), 1–14 (2013)Google Scholar
- 6.Krafka, K., et al.: Eye tracking for everyone. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2176–2184 (2016)Google Scholar
- 9.Baluja, S., Pomerleau, D.: Non-intrusive gaze tracking using artificial neural networks. Technical report CMU-CS-94-102. Carnegie Mellon University. Pittsburgh, Pennsylvania (1994)Google Scholar
- 10.Sewell, W., Komogortsev, O.: Real-time eye gaze tracking with anunmodified commodity webcam employing a neural network. In: ACM CHI Conference Human Factors in Computing Systems, pp. 3739–3744. Atlanta, Georgia (2010)Google Scholar
- 11.Vora, S., Rangesh, A., Trivedi, M.M.: On generalizing driver gaze zone estimation using convolutional neural networks. In: IEEE Intelligent Vehicles Symposium, pp. 849–854. Redondo Beach, California (2017)Google Scholar
- 14.Cassin, B., Solomon, S.: Dictionary of Eye Terminology. Triad Publishing Company, Gainesville (1990)Google Scholar
- 15.Dalal, N., Triggs, B.: Histogram of Oriented Gradients for Human Detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 886–893 (2005)Google Scholar
- 16.Kazemi, V., Sullivan, J.: One millisecond face alignment with anensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874. Ohio, USA (2014)Google Scholar
- 17.Soukupová, T., Čech, J.: Real-time eye blink detection using facial landmarks. In: 21st Computer Vision Winter Workshop (2016)Google Scholar