Skip to main content
SpringerLink
Log in

Inferring Web Page Relevance Using Pupillometry and Single Channel EEG

  • Conference paper
  • First Online:
Information Systems and Neuroscience

Part of the book series: Lecture Notes in Information Systems and Organisation ((LNISO,volume 25))

Abstract

We continue investigating neuro-physiological correlates of information relevance decisions and report on research-in-progress, in which we study health-related information search tasks conducted on open web. Data was collected using an eye-tracker and a single-channel EEG device. Our findings show significant differences in pupil dilation on visits and revisits to relevant and irrelevant pages. Significant differences in EEG-measured power of alpha frequency band and in EEG-detected attention levels were also found in a few conditions. The results confirm feasibility of using pupil dilation and suggest plausibility of using low-cost EEG devices to infer relevance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.tobiipro.com/product-listing/tobii-pro-tx300/.

  2. 2.

    https://myndplay.com/.

  3. 3.

    http://neurosky.com/.

References

  1. Sonnenwald, D.H.: Theory Development in the Information Sciences. University of Texas Press, Austin, TX (2016)

    Google Scholar 

  2. Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F.E., Jose, J.M., Pasi, G.: When relevance judgement is happening? An EEG-based study. In: Proceedings of SIGIR’2015, pp. 719–722. ACM, New York (2015)

    Google Scholar 

  3. Moshfeghi, Y., Pinto, L.R., Pollick, F.E., Jose, J.M.: Understanding relevance: an fMRI study. In: Serdyukov, P., Braslavski, P., Kuznetsov, S.O., Kamps, J., Rüger, S., Agichtein, E., Segalovich, I., Yilmaz, E. (eds.) Advances in Information Retrieval (ECIR’2013), pp. 14–25. Springer, Berlin (2013)

    Chapter  Google Scholar 

  4. Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M.M., Eugster, M.J.A., Ravaja, N., Kaski, S., Jacucci, G.: Extracting relevance and affect information from physiological text annotation. User Model User-Adapt. Interact. 26, 493–520 (2016)

    Article  Google Scholar 

  5. Eugster, M.J.A., Ruotsalo, T., Spapé, M.M., Barral, O., Ravaja, N., Jacucci, G., Kaski, S.: Natural brain-information interfaces: recommending information by relevance inferred from human brain signals. Sci. Rep. 6, 38580 (2016)

    Article  Google Scholar 

  6. Gwizdka, J.: Looking for information relevance in the brain. In: Gmunden Retreat on NeuroIS 2013, p. 14. Gmunden, Austria (2013)

    Google Scholar 

  7. Gwizdka, J.: Characterizing relevance with eye-tracking measures. In: Proceedings of IiiX’2014, pp. 58–67. ACM, New York (2014)

    Google Scholar 

  8. Gwizdka, J.: Tracking information relevance. In: Gmunden Retreat on NeuroIS 2014, p. 3. Gmunden, Austria (2014)

    Google Scholar 

  9. Gwizdka, J.: Differences in reading between word search and information relevance decisions: evidence from eye-tracking. In: Davis D.F., Riedl R., vom Brocke J., Léger P.-M., Randolph B.A. (eds.) Information Systems and Neuroscience: Gmunden Retreat on NeuroIS 2016, pp. 141–147. Springer, Berlin (2017)

    Google Scholar 

  10. Ajanki, A., Hardoon, D., Kaski, S., Puolamäki, K., Shawe-Taylor, J.: Can eyes reveal interest? Implicit queries from gaze patterns. User Model User-Adapt. Interact. 19, 307–339 (2009)

    Article  Google Scholar 

  11. Buscher, G., Dengel, A., Biedert, R., Elst, L.V.: Attentive documents: eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell Syst. 1, 9:1–9:30 (2012)

    Google Scholar 

  12. Simola, J., Salojärvi, J., Kojo, I.: Using hidden Markov model to uncover processing states from eye movements in information search tasks. Cogn. Syst. Res. 9, 237–251 (2008)

    Article  Google Scholar 

  13. Gwizdka, J., Shouyi, W., Cole, M., Hosseini, R.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inf. Sci. Technol. (in press)

    Google Scholar 

  14. Onorati, F., Barbieri, R., Mauri, M., Russo, V., Mainardi, L.: Characterization of affective states by pupillary dynamics and autonomic correlates. Front Neuroeng. 6, 9 (2013)

    Article  Google Scholar 

  15. Kahneman, D., Beatty, J.: Pupil diameter and load on memory. Science 154, 1583–1585 (1966)

    Article  Google Scholar 

  16. Krugman, H.E.: Some applications of pupil measurement. JMR J. Mark. Res. Pre-1986. 1, 15 (1964)

    Google Scholar 

  17. Preuschoff, K., Hart, B.M. ’t, Einhäuser, W.: Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making. Front. Decis. Neurosci. 5, 115 (2011)

    Google Scholar 

  18. Einhäuser, W., Koch, C., Carter, O.L.: Pupil dilation betrays the timing of decisions. Front Hum. Neurosci. 4, 18 (2010)

    Google Scholar 

  19. Hoeks, B., Levelt, W.J.M.: Pupillary dilation as a measure of attention: a quantitative system analysis. Behav. Res. Methods Instrum. Comput. 25, 16–26 (1993)

    Article  Google Scholar 

  20. Wierda, S.M., van Rijn, H., Taatgen, N.A., Martens, S.: Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. PNAS 109, 8456–8460 (2012)

    Article  Google Scholar 

  21. Oliveira, F.T.P., Aula, A., Russell, D.M.: Discriminating the relevance of web search results with measures of pupil size. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 2209–2212. ACM, Boston, MA (2009)

    Google Scholar 

  22. Gwizdka, J., Zhang, Y.: Differences in eye-tracking measures between visits and revisits to relevant and irrelevant web pages. In: Proceedings of SIGIR’2015, pp. 811–814. ACM, New York (2015)

    Google Scholar 

  23. Abbott, W.W., Faisal, A.A.: Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces. J. Neural Eng. 9, 046016 (2012)

    Article  Google Scholar 

  24. Bobrov, P., Frolov, A., Cantor, C., Fedulova, I., Bakhnyan, M., Zhavoronkov, A.: Brain–computer interface based on generation of visual images. PLoS ONE 6, e20674 (2011)

    Article  Google Scholar 

  25. Khushaba, R.N., Greenacre, L., Kodagoda, S., Louviere, J., Burke, S., Dissanayake, G.: Choice modeling and the brain: a study on the electroencephalogram (EEG) of preferences. Expert Syst. Appl. 39, 12378–12388 (2012)

    Article  Google Scholar 

  26. Ramirez, R., Palencia-Lefler, M., Giraldo, S., Vamvakousis, Z.: Musical neurofeedback for treating depression in elderly people. Audit. Cogn. Neurosci. 354 (2015)

    Google Scholar 

  27. Wang, S., Gwizdka, J., Chaovalitwongse, W.A.: Using wireless EEG signals to assess memory workload in the n-back task. IEEE Trans. Hum.–Mach. Syst. 46, 424–435 (2016)

    Google Scholar 

  28. Wal, C.N. van der, Irrmischer, M.: Myndplay: measuring attention regulation with single dry electrode brain computer interface. In: Guo, Y., Friston, K., Aldo, F., Hill, S., and Peng, H. (eds.) Brain Informatics and Health. pp. 192–201. Springer, Berlin (2015)

    Google Scholar 

  29. Gwizdka, J., Hosseini, R., Cole, M., Wang, S.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inform. Sci. Tech. 68(10), 2299−2312 (2017)

    Google Scholar 

  30. Borlund, P.: The concept of relevance in IR. J. Am. Soc. Inf. Sci. Technol. 54, 913–925 (2003)

    Article  Google Scholar 

  31. Gwizdka, J.: I can and so I search more: effects of memory span on search behavior. In: Proceedings of CHIIR’2017, pp. 341–344. ACM, New York (2017)

    Google Scholar 

  32. Wei, X., Zhang, Y., Gwizdka, J.: YASFIIRE: yet another system for IIR evaluation. In: Proceedings of IiiX’2014, pp. 316–319. ACM, New York (2014)

    Google Scholar 

  33. O’Connell, R.G., Dockree, P.M., Robertson, I.H., Bellgrove, M.A., Foxe, J.J., Kelly, S.P.: Uncovering the neural signature of lapsing attention: electrophysiological signals predict errors up to 20 s before they occur. J. Neurosci. 29, 8604–8611 (2009)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported, in part, by IMLS Career award to Jacek Gwizdka # RE-04-11-0062-11.

Author information

Authors and Affiliations

  1. School of Information, University of Texas at Austin, Austin, TX, USA

    Jacek Gwizdka

Authors
  1. Jacek Gwizdka
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jacek Gwizdka .

Editor information

Editors and Affiliations

  1. Information Systems and Quantitative Sciences (ISQS), Texas Tech University, Lubbock, Texas, USA

    Fred D. Davis

  2. University of Applied Sciences Upper Austria, Steyr, Oberösterreich, Austria

    René Riedl

  3. Department of Information Systems, University of Liechtenstein, Vaduz, Liechtenstein

    Jan vom Brocke

  4. Department of Information Technology, HEC Montréal, Montreal, Québec, Canada

    Pierre-Majorique Léger

  5. Department of Information Systems, Kennesaw State University, Kennesaw, Georgia, USA

    Adriane B. Randolph

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gwizdka, J. (2018). Inferring Web Page Relevance Using Pupillometry and Single Channel EEG. In: Davis, F., Riedl, R., vom Brocke, J., Léger, PM., Randolph, A. (eds) Information Systems and Neuroscience. Lecture Notes in Information Systems and Organisation, vol 25. Springer, Cham. https://doi.org/10.1007/978-3-319-67431-5_20

Download citation

Publish with us

Policies and ethics

Search

Navigation