Skip to main content

The Drive to Explore: Physiological Computing in a Cultural Heritage Context

  • Chapter
  • First Online:
Book cover Advances in Physiological Computing

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

Contemporary heritage institutions model installations and artefacts around a passive receivership where content is consumed but not influenced by visitors. Increasingly, heritage institutions are incorporating ubiquitous technologies to provide visitors with experiences that not only transfer knowledge but also entertain. This poses the challenge of how to incorporate technologies into exhibits to make them more approachable and memorable, whilst preserving cultural salience. We present work towards an adaptive interface which responds to a museum visitor’s level of interest, in order to deliver a personalised experience through adaptive curation within a cultural heritage installation. The interface is realised through the use of psychophysiological measures, physiological computing and a machine learning algorithm. We present studies which serve to illustrate how entertainment, education, aesthetic experience and immersion, identified as four factors of visitor experience, can be operationalised through a psychological construct of “interest”. Two studies are reported which take a subject-dependent experimental approach to record and classify psychophysiological signals using mobile physiological sensors and a machine learning algorithm. The results show that it is possible to reliably infer a state of interest from cultural heritage material, informing future work for the development of a real-time physiological computing system for use within an adaptive cultural heritage experience. We propose a framework for a potential adaptive system for cultural heritage based upon story telling principles and an operationalised model of the “knowledge emotion” interest.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    EEG alpha activation has a converse relationship with brain activity (Goldman et al. 2002), i.e. higher alpha activity is associated with reduced brain activation.

References

  • Augustin MD, Defranceschi B, Fuchs HK, Carbon CC, Hutzler F (2011) The neural time course of art perception: an ERP study on the processing of style versus content in art. Neuropsychologia 49(7):2071–2081

    Google Scholar 

  • Berlyne DE (1960) Conflict, arousal, and curiosity. McGraw-Hill Book Company, London

    Book  Google Scholar 

  • Boucsein W (1992) Electrodermal activity. Plenum Press, New York

    Book  Google Scholar 

  • Boehle K, Coenen C, Decker M, Rader M (2013) Biocybernetic adaptation and privacy. Innov: Eur J Soc Sci Res 26(1–2)

    Google Scholar 

  • Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Knowl Disc Data Min 2(2):121–167

    Google Scholar 

  • Cacioppo JT, Bush LK, Tassinary LG (1990) Microexpressive facial actions as a function of affective stimuli: replication and extension. Pers Soc Psychol Bull 18:515–526

    Article  Google Scholar 

  • Campell J (1999) Der Heros in tausend Gestalten. Insel Verlag, Frankfurt am Main und Leipzig

    Google Scholar 

  • Cela-Conde CJ, Marty G, Maestú F, Ortiz T, Munar E, Fernández A, Roca M, Rosselló J, Quesney F (2004) Activation of the prefrontal cortex in the human visual aesthetic perception. Proc Natl Acad Sci USA 101(16):6321–6325

    Article  Google Scholar 

  • Coan JA, Allen JJB (2004) Frontal EEG asymmetry as a moderator and mediator of emotion. Biol Psychol 67(1–2):7–49

    Article  Google Scholar 

  • Cupchik GC, Vartanian O, Crawley A, Mikulis DJ (2009) Viewing artworks: contributions of cognitive control and perceptual facilitation to aesthetic experience. Brain Cogn 70(1):84–91

    Article  Google Scholar 

  • Davidson RJ (2004) What does the prefrontal cortex “do” in affect: perspectives in frontal EEG asymmetry research. Biol Psychol 67:219–234

    Article  Google Scholar 

  • De Rojas C, Camarero C (2008) Visitors’ experience, mood and satisfaction in a heritage context: evidence from an interpretation center. Tour Manag 29:525–537

    Article  Google Scholar 

  • Ekman P (1992) An argument for basic emotions. Cogn Emot 6:169–200

    Article  Google Scholar 

  • Fairclough SH (2009) Fundamentals of physiological computing. Interact Comput 21:133–145

    Article  Google Scholar 

  • Fairclough SH, Gilleade K (2012) Construction of the biocybernetic loop: a case study. In: Proceedings of the 14th ACM international conference on multimodal interaction, Santa Monica

    Google Scholar 

  • Goldman RI, Stern JM, Engel J Jr, Cohen MS (2002) Simultaneous EEG and fMRI of the alpha rhythm. NeuroReport 13:2487–2494

    Article  Google Scholar 

  • Graugaard L (2005) The SoundGlove II: using sEMG data for intuitive audio and video affecting in real-time. In: Proceedings of the 3rd annual conference in computer game design and technology, Liverpool, pp 119–128

    Google Scholar 

  • Hahn B, Ross TJ, Stein EA (2006) Neuroanatomical dissociation between bottom-up and top-down processes of visuospatial selective attention. Neuroimage 32:842–853

    Article  Google Scholar 

  • Hidi S, Renninger KA (2006) The four-phase model of interest development. Educ Psychol 41(2):111–127

    Article  Google Scholar 

  • Isaksson A, Wallman M, Göransson H, Gustafsson MG (2008) Cross-validation and bootstrapping are unreliable in small sample classification. Pattern Recogn Lett 29(14):1960–1965

    Article  Google Scholar 

  • Jennett C, Cox AL, Cairns P, Dhoparee S, Epps A, Tijs T, Walton A (2008) Measuring and defining the experience of immersion in games. Int J Hum Comput Stud 66:641–661

    Article  Google Scholar 

  • Johnsson E, Adler C (2006) A guide to developing effective storytelling programmes for museums. London Museums Hub

    Google Scholar 

  • Karran AJ, Fairclough SH, Gilleade K (2013) Towards an adaptive cultural heritage experience using physiological computing. In Proceeding of: CHI 2013 “changing perspectives”, Extended Abstracts, Paris, April 27–May 2, 2013

    Google Scholar 

  • Leder H, Belke B, Oeberst A, Augustin D (2004) A model of aesthetic appreciation and aesthetic judgments. Br J Psychol 95(Pt 4):489–508

    Article  Google Scholar 

  • Lee CK, Yoo SK, Park YJ (2005) Using neural network to recognize human emotions from heart rate variability and skin resistance. In: 27th annual international conference of the engineering in medicine and biology society (IEEE-EMBS 2005), pp 5523–5525, 17–18 Jan 2006

    Google Scholar 

  • Liew CL (2005) Online cultural heritage exhibitions: a survey of information retrieval features. Program Electron Libr Inf Syst 39(1):4–24

    Google Scholar 

  • Louvre Paris (2013) http://www.louvre.fr/en/media-en-ligne?criteria-keywords=&criteria-year=&tab=1153#tabs; Accessed 5 Sept 2013

  • Mandryk R, Atkins M (2007) A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int J Hum Comput Stud 65(4):329–347

    Article  Google Scholar 

  • McIntosh A, Prentice R (1999) Affirming authenticity: consuming cultural heritage. Ann Tour Res 26(3):589–612

    Article  Google Scholar 

  • McLean K (1993) Planning for people in museum exhibitions. Association of Science-Technology Centres, Michigan

    Google Scholar 

  • Nadal M, Pearce MT (2011) The Copenhagen neuroaesthetics conference: prospects and pitfalls for an emerging field. Brain Cogn 76:172–183

    Article  Google Scholar 

  • Parasuraman R, Sheridan TB, Wickens C (2000) A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern Part A Syst Humans 30(3):273–285

    Google Scholar 

  • Petrantonakis PC, Hadjileontiadis LJ (2010) Emotion recognition from EEG using higher order crossings. IEEE Trans Inf Technol Biomed. A publication of the IEEE engineering in medicine and biology society 14(2):186–197

    Google Scholar 

  • Picard RW (2000) Toward computers that recognize and respond to user emotion. IBM Syst J 39(3 and 4):705–719

    Google Scholar 

  • Picard RW, Klein J (2002) Computers that recognise and respond to user emotion: theoretical and practical implications. Interact Comput 14(2):141–169

    Article  Google Scholar 

  • Pine B, Gilmore J (1998) Welcome to the experience economy. Harvard Bus Rev 76(4):97–105

    Google Scholar 

  • Platt JC (1999) Fast training of support vector machines using sequential minimal optimization. In: Schlkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods, MIT Press, Cambridge, pp 185–208

    Google Scholar 

  • Rani P, Sarkar N, Liu C, (2005) Maintaining optimal challenge in computer games through realtime physiological feedback. In: Proceedings of the 11th international conference on human computer interaction, pp 184–192

    Google Scholar 

  • Russell JA (1980) A circumplex model of affect. Pers Soc Psychol 39:1161–1178

    Article  Google Scholar 

  • Sakr GE, Elhajj IH, Huijer HA-S (2010) Support vector machines to define and detect agitation transition. IEEE Trans Affect Comput 1(2):98–108

    Google Scholar 

  • Serbedzija N, Fairclough SH (2009) Biocybernetic loop: from awareness to evolution. In: IEEE congress on evolutionary computation, Trondheim, May 2009

    Google Scholar 

  • Silvia PJ (2008) Interest—the curious emotion. Curr Dir Psychol Sci 17(1):57–60

    Article  Google Scholar 

  • Silvia PJ (2010) Confusion and interest: the role of knowledge emotions in aesthetic experience. Psychol Aesthet Creativity Arts 4(2):75–80

    Article  MathSciNet  Google Scholar 

  • Tschacher W, Greenwood S, Kirchberg V, Wintzerith S, van den Berg K, Trondle M (2011) Physiological correlates of aesthetic perception of artworks in a museum. Psychol Aesthet Creativity Arts 6(1):96–103

    Google Scholar 

  • Tung VWS, Ritchie JRB (2011) Exploring the essence of memorable tourism experiences. Ann Tour Res 38(4):1367–1386

    Article  Google Scholar 

  • Uysal M, Noe F (2003) Satisfaction in outdoor recreation and tourism settings. In: Laws E (ed) Case studies in tourism marketing. Continuum Publisher, London, pp 140–158

    Google Scholar 

  • Vessel EA, Starr GG, Rubin N (2012) The brain on art: intense aesthetic experience activates the default mode network. Frontiers in Hum Neurosci 6:66

    Article  Google Scholar 

  • Villon O, Lisetti C (2007) toward recognizing individual’s subjective emotion from physiological signals in practical application. In: 20th IEEE international symposium on computer-based medical systems (CBMS’07), pp 357–362

    Google Scholar 

  • Wang N (1999) Rethinking authenticity in tourism experience. Ann Tour Res 2(1):349–370

    Article  Google Scholar 

  • Wilhelm FH, Grossman P (2010) Emotions beyond the laboratory: theoretical fundaments, study design, and analytic strategies for advanced ambulatory assessment. Biol Psychol 84:552–569

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by EU FP7 project No.270318 (ARtSENSE).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander J. Karran .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag London

About this chapter

Cite this chapter

Karran, A.J., Kreplin, U. (2014). The Drive to Explore: Physiological Computing in a Cultural Heritage Context. In: Fairclough, S., Gilleade, K. (eds) Advances in Physiological Computing. Human–Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-4471-6392-3_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-6392-3_8

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-6391-6

  • Online ISBN: 978-1-4471-6392-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics