Abstract
Contemporary heritage institutions model installations and artefacts around a passive receivership where content is consumed but not influenced by visitors. Increasingly, heritage institutions are incorporating ubiquitous technologies to provide visitors with experiences that not only transfer knowledge but also entertain. This poses the challenge of how to incorporate technologies into exhibits to make them more approachable and memorable, whilst preserving cultural salience. We present work towards an adaptive interface which responds to a museum visitor’s level of interest, in order to deliver a personalised experience through adaptive curation within a cultural heritage installation. The interface is realised through the use of psychophysiological measures, physiological computing and a machine learning algorithm. We present studies which serve to illustrate how entertainment, education, aesthetic experience and immersion, identified as four factors of visitor experience, can be operationalised through a psychological construct of “interest”. Two studies are reported which take a subject-dependent experimental approach to record and classify psychophysiological signals using mobile physiological sensors and a machine learning algorithm. The results show that it is possible to reliably infer a state of interest from cultural heritage material, informing future work for the development of a real-time physiological computing system for use within an adaptive cultural heritage experience. We propose a framework for a potential adaptive system for cultural heritage based upon story telling principles and an operationalised model of the “knowledge emotion” interest.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
EEG alpha activation has a converse relationship with brain activity (Goldman et al. 2002), i.e. higher alpha activity is associated with reduced brain activation.
References
Augustin MD, Defranceschi B, Fuchs HK, Carbon CC, Hutzler F (2011) The neural time course of art perception: an ERP study on the processing of style versus content in art. Neuropsychologia 49(7):2071–2081
Berlyne DE (1960) Conflict, arousal, and curiosity. McGraw-Hill Book Company, London
Boucsein W (1992) Electrodermal activity. Plenum Press, New York
Boehle K, Coenen C, Decker M, Rader M (2013) Biocybernetic adaptation and privacy. Innov: Eur J Soc Sci Res 26(1–2)
Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Knowl Disc Data Min 2(2):121–167
Cacioppo JT, Bush LK, Tassinary LG (1990) Microexpressive facial actions as a function of affective stimuli: replication and extension. Pers Soc Psychol Bull 18:515–526
Campell J (1999) Der Heros in tausend Gestalten. Insel Verlag, Frankfurt am Main und Leipzig
Cela-Conde CJ, Marty G, Maestú F, Ortiz T, Munar E, Fernández A, Roca M, Rosselló J, Quesney F (2004) Activation of the prefrontal cortex in the human visual aesthetic perception. Proc Natl Acad Sci USA 101(16):6321–6325
Coan JA, Allen JJB (2004) Frontal EEG asymmetry as a moderator and mediator of emotion. Biol Psychol 67(1–2):7–49
Cupchik GC, Vartanian O, Crawley A, Mikulis DJ (2009) Viewing artworks: contributions of cognitive control and perceptual facilitation to aesthetic experience. Brain Cogn 70(1):84–91
Davidson RJ (2004) What does the prefrontal cortex “do” in affect: perspectives in frontal EEG asymmetry research. Biol Psychol 67:219–234
De Rojas C, Camarero C (2008) Visitors’ experience, mood and satisfaction in a heritage context: evidence from an interpretation center. Tour Manag 29:525–537
Ekman P (1992) An argument for basic emotions. Cogn Emot 6:169–200
Fairclough SH (2009) Fundamentals of physiological computing. Interact Comput 21:133–145
Fairclough SH, Gilleade K (2012) Construction of the biocybernetic loop: a case study. In: Proceedings of the 14th ACM international conference on multimodal interaction, Santa Monica
Goldman RI, Stern JM, Engel J Jr, Cohen MS (2002) Simultaneous EEG and fMRI of the alpha rhythm. NeuroReport 13:2487–2494
Graugaard L (2005) The SoundGlove II: using sEMG data for intuitive audio and video affecting in real-time. In: Proceedings of the 3rd annual conference in computer game design and technology, Liverpool, pp 119–128
Hahn B, Ross TJ, Stein EA (2006) Neuroanatomical dissociation between bottom-up and top-down processes of visuospatial selective attention. Neuroimage 32:842–853
Hidi S, Renninger KA (2006) The four-phase model of interest development. Educ Psychol 41(2):111–127
Isaksson A, Wallman M, Göransson H, Gustafsson MG (2008) Cross-validation and bootstrapping are unreliable in small sample classification. Pattern Recogn Lett 29(14):1960–1965
Jennett C, Cox AL, Cairns P, Dhoparee S, Epps A, Tijs T, Walton A (2008) Measuring and defining the experience of immersion in games. Int J Hum Comput Stud 66:641–661
Johnsson E, Adler C (2006) A guide to developing effective storytelling programmes for museums. London Museums Hub
Karran AJ, Fairclough SH, Gilleade K (2013) Towards an adaptive cultural heritage experience using physiological computing. In Proceeding of: CHI 2013 “changing perspectives”, Extended Abstracts, Paris, April 27–May 2, 2013
Leder H, Belke B, Oeberst A, Augustin D (2004) A model of aesthetic appreciation and aesthetic judgments. Br J Psychol 95(Pt 4):489–508
Lee CK, Yoo SK, Park YJ (2005) Using neural network to recognize human emotions from heart rate variability and skin resistance. In: 27th annual international conference of the engineering in medicine and biology society (IEEE-EMBS 2005), pp 5523–5525, 17–18 Jan 2006
Liew CL (2005) Online cultural heritage exhibitions: a survey of information retrieval features. Program Electron Libr Inf Syst 39(1):4–24
Louvre Paris (2013) http://www.louvre.fr/en/media-en-ligne?criteria-keywords=&criteria-year=&tab=1153#tabs; Accessed 5 Sept 2013
Mandryk R, Atkins M (2007) A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int J Hum Comput Stud 65(4):329–347
McIntosh A, Prentice R (1999) Affirming authenticity: consuming cultural heritage. Ann Tour Res 26(3):589–612
McLean K (1993) Planning for people in museum exhibitions. Association of Science-Technology Centres, Michigan
Nadal M, Pearce MT (2011) The Copenhagen neuroaesthetics conference: prospects and pitfalls for an emerging field. Brain Cogn 76:172–183
Parasuraman R, Sheridan TB, Wickens C (2000) A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern Part A Syst Humans 30(3):273–285
Petrantonakis PC, Hadjileontiadis LJ (2010) Emotion recognition from EEG using higher order crossings. IEEE Trans Inf Technol Biomed. A publication of the IEEE engineering in medicine and biology society 14(2):186–197
Picard RW (2000) Toward computers that recognize and respond to user emotion. IBM Syst J 39(3 and 4):705–719
Picard RW, Klein J (2002) Computers that recognise and respond to user emotion: theoretical and practical implications. Interact Comput 14(2):141–169
Pine B, Gilmore J (1998) Welcome to the experience economy. Harvard Bus Rev 76(4):97–105
Platt JC (1999) Fast training of support vector machines using sequential minimal optimization. In: Schlkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods, MIT Press, Cambridge, pp 185–208
Rani P, Sarkar N, Liu C, (2005) Maintaining optimal challenge in computer games through realtime physiological feedback. In: Proceedings of the 11th international conference on human computer interaction, pp 184–192
Russell JA (1980) A circumplex model of affect. Pers Soc Psychol 39:1161–1178
Sakr GE, Elhajj IH, Huijer HA-S (2010) Support vector machines to define and detect agitation transition. IEEE Trans Affect Comput 1(2):98–108
Serbedzija N, Fairclough SH (2009) Biocybernetic loop: from awareness to evolution. In: IEEE congress on evolutionary computation, Trondheim, May 2009
Silvia PJ (2008) Interest—the curious emotion. Curr Dir Psychol Sci 17(1):57–60
Silvia PJ (2010) Confusion and interest: the role of knowledge emotions in aesthetic experience. Psychol Aesthet Creativity Arts 4(2):75–80
Tschacher W, Greenwood S, Kirchberg V, Wintzerith S, van den Berg K, Trondle M (2011) Physiological correlates of aesthetic perception of artworks in a museum. Psychol Aesthet Creativity Arts 6(1):96–103
Tung VWS, Ritchie JRB (2011) Exploring the essence of memorable tourism experiences. Ann Tour Res 38(4):1367–1386
Uysal M, Noe F (2003) Satisfaction in outdoor recreation and tourism settings. In: Laws E (ed) Case studies in tourism marketing. Continuum Publisher, London, pp 140–158
Vessel EA, Starr GG, Rubin N (2012) The brain on art: intense aesthetic experience activates the default mode network. Frontiers in Hum Neurosci 6:66
Villon O, Lisetti C (2007) toward recognizing individual’s subjective emotion from physiological signals in practical application. In: 20th IEEE international symposium on computer-based medical systems (CBMS’07), pp 357–362
Wang N (1999) Rethinking authenticity in tourism experience. Ann Tour Res 2(1):349–370
Wilhelm FH, Grossman P (2010) Emotions beyond the laboratory: theoretical fundaments, study design, and analytic strategies for advanced ambulatory assessment. Biol Psychol 84:552–569
Acknowledgements
This work was supported by EU FP7 project No.270318 (ARtSENSE).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Karran, A.J., Kreplin, U. (2014). The Drive to Explore: Physiological Computing in a Cultural Heritage Context. In: Fairclough, S., Gilleade, K. (eds) Advances in Physiological Computing. Human–Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-4471-6392-3_8
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6392-3_8
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6391-6
Online ISBN: 978-1-4471-6392-3
eBook Packages: Computer ScienceComputer Science (R0)