Skip to main content
SpringerLink
Log in

Combining Experimental Observations and Modelling in Investigating Feedback and Emotions in Repeated Selection Tasks

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

People seem to learn tasks even without formal training. This can be modelled as the outcome of a feedback system that accumulates experience. In this paper we investigate such a feedback system, following an iterative research approach. A feedback loop is specified that is detailed using contemporary ideas on human behaviour. The resulting model is investigated in an empirical study. Finally, we consider a computational mechanism to explain the results. This approach is aimed at understanding how a feedback mechanism might work rather than at observing its outcomes. In this paper, we study the approach through adjustments in card selections in a game consisting of repeated card choices. Playing this game, participants do not know what rules determine gains and losses. Therefore there is some tension between exploring the options and achieving immediate profit. To decide in such situations it is argued that often evaluations below the level of conscious awareness, such as affect, play an important role. The results support the hypothesis that participants would draw better cards as the game progressed. There is some evidence that emotions are involved, since the hypothesis that profit and emotions are correlated is confirmed. Further evidence that formal logic is not sufficient follows from the observed effects of music on card selections. In the second part of the paper the aim is to understand the results from a computational point of view. Four possible ways of integrating feedback into a decision criterion are compared. Using one of these mechanisms, a computational model is investigated that might describe the role of music in card selection. Although there are limitations to both the empirical and computational findings, the chosen approach indicates that computational modelling of experiential appraisal, at a preconscious level, and the effect of external factors, such as music, is in principle feasible, and can lead to a research agenda aimed at understanding such phenomena.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • C.A. Anderson N.L. Carnagey J. Eubanks (2003) ArticleTitleExposure to violent media: The effects of songs with violent lyrics on aggressive thoughts and feelings Journal of Personality and Social Psychology 84 IssueID5 960–971

    Google Scholar 

  • C. Barr-Zisowitz (2000) “Sadness”- is there such a thing? M. Lewis J.M. Haviland-Jones (Eds) Handbook of emotions EditionNumbersecond edition Guilford Press London 607–622

    Google Scholar 

  • A. Bechara A.R. Damasio H. Damasio S.W. Anderson (1994) ArticleTitleInsensitivity to future consequences following damage to human prefrontal cortex Cognition 50 IssueID1–3 7–15

    Google Scholar 

  • A. Bechara H. Damasio D. Tranel A.R. Damasio (1997) ArticleTitleDeciding advantageously before knowing the advantageous strategy Science 275 IssueID5304 1293–1294 Occurrence Handle10.1126/science.275.5304.1293

    Article  Google Scholar 

  • S.H. Blumberg C.E. Izard (1986) ArticleTitleDiscriminating patterns of emotions in 10- and 11- year-old children’s anxiety and depression Journal of personality and social psychology 51 852–857 Occurrence Handle10.1037/0022-3514.51.4.852

    Article  Google Scholar 

  • V. Braitenberg (1984) Vehicles: Experiments in synthetic psychology The MIT Press Cambridge MA

    Google Scholar 

  • M. Cabanac (1992) ArticleTitlePleasure: The common currency Journal of Theoretical Biology 155 IssueID2 173–200

    Google Scholar 

  • C.S. Carver M.F. Scheier (1998) On the self-regulation of behavior Cambridge University Press New York, NY, US

    Google Scholar 

  • C.S. Carver M.F. Scheier (2000) ArticleTitleScaling back goals and recalibration of the affect system are processes in normal adaptive self-regulation: Understanding “response shift” phenomena Social Science and Medicine 50 IssueID12 1715–1722

    Google Scholar 

  • G.L. Clore A. Ortony (2000) Cognition in Emotion, Always, Sometimes, or Never? R.D. Lane L. Nadel (Eds) Cognitive Neuroscience of Emotion Oxford University Press Oxford UK 24–61

    Google Scholar 

  • H.A. Cohen (1974) The art of snaring dragons MIT Artificial Intelligence Laboratory Cambridge MA

    Google Scholar 

  • A.R. Damasio (1994) Descartes Error, emotion, reason, and the human brain Putnam New York, NY

    Google Scholar 

  • D.C. Dennett (1994) Cognitive science as reverse engineering: Several meanings of “top-down” and “bottom-up” D. Prawitz B. Skyrms D. Westerståhl (Eds) Logic, methodology and philosophy of science IX, a companion to the philosophy of mind Blackwell Press Oxford UK 236–244

    Google Scholar 

  • D.C. Dennett (1995) Darwin’s dangerous idea: evolution and the meaning of life Simon and Schuster New York, NY

    Google Scholar 

  • S. Epstein (1994) ArticleTitleIntegration of the cognitive and the psychodynamic unconscious American Psychologist 49 IssueID8 709–724 Occurrence Handle10.1037/0003-066X.49.8.709

    Article  Google Scholar 

  • D. Evans (2002) Emotion: The science of sentiment Oxford University Press Oxford, UK

    Google Scholar 

  • A.R.H. Fischer (2004) User adaptation in user-system-interaction Eindhoven University of Technology Eindhoven, the Netherlands

    Google Scholar 

  • Fischer A. R. H., Blommaert, F. J. J. and Midden, C. J. H.: 2004a, Monitoring and evaluation of time delay. International Journal of Human Computer Interaction, In Press.

  • Fischer, A. R. H., Blommaert, F. J. J., and Midden, C. J. H.: 2004b, The role of accumulating experiences in adjusting interaction: Evaluation of visual search tasks. Manuscript submitted for publication.

  • N.H. Frijda (1986) The emotions Cambridge University Press Cambridge, UK

    Google Scholar 

  • K. Gasper G.L. Clore (2000) ArticleTitleDo you have to pay attention to your feelings to be influenced by them? Personality and Social Psychology Bulletin 26 IssueID6 698–711

    Google Scholar 

  • A.M. Isen (2000) Positive affect and decision making M. Lewis J.M. Haviland-Jones (Eds) Handbook of emotions EditionNumbersecond edition Guilford New York NY 417–435

    Google Scholar 

  • C.E. Izard B.P. Ackerman (2000) Motivational, organizational, and regulatory functions of discrete emotions M. Lewis J.M. Haviland-Jones (Eds) Handbook of emotions EditionNumbersecond edition Guilford Press London 253–264

    Google Scholar 

  • V.S. Johnston (1999) Why we feel: The science of human emotions Perseus Publishing Cambridge, MA

    Google Scholar 

  • R.S. Lazarus (1991) Emotion and Adaptation Oxford University Press New York

    Google Scholar 

  • J.S. Lerner D. Keltner (2001) ArticleTitleFear, anger, and risk Journal of Personality and Social Psychology 81 IssueID1 146–159 Occurrence Handle10.1037/0022-3514.81.1.146

    Article  Google Scholar 

  • L.M. Lewis W.N. Dember B.K. Schefft R.A. Radenhausen (1995) ArticleTitleCan experimentally induced mood affect optimism and pessimism scores? Current Psychology: Developmental, Learning, Personality, Social 14 IssueID1 29–41

    Google Scholar 

  • D. Marr (1982) Vision: a computational investigation into the human representation and processing of visual information Freeman San Francisco

    Google Scholar 

  • B.A. Mellers (2000) ArticleTitleChoice and the relative pleasure of consequences Psychological Bulletin 126 IssueID6 910–924 Occurrence Handle10.1037/0033-2909.126.6.910

    Article  Google Scholar 

  • B.A. Mellers A. Schwartz I. Ritov (1999) ArticleTitleEmotion-based choice Journal of Experimental Psychology: General 128 IssueID3 332–345 Occurrence Handle10.1037/0096-3445.128.3.332

    Article  Google Scholar 

  • G.A. Miller G. Eugene K.H. Pribram (1960) Plans and the structure of behavior Holt Oxford, England

    Google Scholar 

  • A. Newell (1990) Unified theories of cognition Harvard University Press Cambridge, MA

    Google Scholar 

  • A. Newell H.A. Simon (1972) Human problem solving Prentice-Hall Oxford UK

    Google Scholar 

  • K. Oatley J.M. Jenkins (1996) Understanding emotions Blackwell Publishers Malden, MA

    Google Scholar 

  • K. Oatley P.N. Johnson-Laird (1987) ArticleTitleTowards a cognitive theory of emotions Cognition and Emotion 1 IssueID1 29–50

    Google Scholar 

  • R.E. Petty J.T. Cacioppo (1981) Attitudes and persuasion: classic and contemporary approaches Westview Oxford UK

    Google Scholar 

  • W.A. Schmitt C.A. Brinkley J.P. Newman (1999) ArticleTitleTesting Damasio’s somatic marker hypothesis with psychopathic individuals: Risk takers or risk averse? Journal of Abnormal Psychology 108 IssueID3 538–543 Occurrence Handle10.1037/0021-843X.108.3.538

    Article  Google Scholar 

  • N. Schwarz G.L. Clore (1983) ArticleTitleMood, misattribution, and judgments of well-being: Informative and directive functions of affective states Journal of Personality and Social Psychology 45 IssueID3 513–523

    Google Scholar 

  • N. Schwarz G.L. Clore (2003) ArticleTitleMood as information: 20 years later Psychological Inquiry 14 294–301 Occurrence Handle10.1207/S15327965PLI1403&4_20

    Article  Google Scholar 

  • E. Shafir A. Tversky (1995) Decision making E.E. Smith D.N. Osherson (Eds) An invitation to cognitive science EditionNumbersecond edition NumberInSeriesVol. 3 MIT Press Cambridge, MA 77–100

    Google Scholar 

  • H.A. Simon (1967) ArticleTitleMotivational and Emotional Controls of Cognition Psychological Review 74 IssueID1 29–39

    Google Scholar 

  • Sloman, A.: 1999, Beyond shallow models of emotion. Paper presented at the I3 spring days workshop on behaviour planning for life-like characters and avatars.

  • S.A. Sloman (1996) ArticleTitleThe empirical case for two systems of reasoning Psychological Bulletin 119 IssueID1 3–22

    Google Scholar 

  • P. Slovic M.L. Finucane E. Peters D.G. MacGregor (2004) ArticleTitleRisk as analysis and risk as feelings: Some thoughts about affect, reason, risk, and rationality Risk Analysis 24 IssueID2 311–322 Occurrence Handle10.1111/j.0272-4332.2004.00433.x

    Article  Google Scholar 

  • A. Tversky D. Kahneman (1974) ArticleTitleJudgment under uncertainty: Heuristics and biases Science 185 1124–1131

    Google Scholar 

  • Vaa, T.: 2001, Cognition and emotions in driver behaviour models: some critical viewpoints. Paper presented at the 14th ICTCT workshop, Caserta.

  • Velásquez, J. D.: 1998, Modelling Emotion-Based Decision-Making. Paper presented at the the 1998 AAAI fall symposium: Emotional and Intelligent: The tangled knot of cognition, Orlando, FL.

  • D. Watson L.A. Clark A. Tellegen (1988) ArticleTitleDevelopment and validation of brief measures of positive and negative affect: The PANAS scales Journal of Personality and Social Psychology 54 IssueID6 1063–1070

    Google Scholar 

  • P.H. Winston (1992) Artificial intelligence EditionNumberThird edition Addison-Wesley Amsterdam

    Google Scholar 

  • R.B. Zajonc (1980) ArticleTitleFeeling and thinking: Preferences need no inferences American Psychologist 35 IssueID2 151–175

    Google Scholar 

  • R.B. Zajonc D.W. Rajecki (1969) ArticleTitleExposure and affect: A field experiment Psychonomic Science 17 IssueID4 216–217

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Human-Technology-Interaction (MTI), Eindhoven University of Technology and Marketing and Consumer Behaviour Group, Wageningen University, Hollandseweg 1, 6706, Wageningen, KN, The Netherlands

    Arnout R. H. Fischer

  2. Department of Human-Technology-Interaction (MTI), Eindhoven University of Technology, Building IPO 1.23, P.O. Box 513, 5600, Eindhoven, MB, The Netherlands

    Frans J. J. Blommaert

  3. Department of Human-Technology-Interaction (MTI), Eindhoven University of Technology, Building IPO 1.23, P.O. Box 513, 5600, Eindhoven, MB, The Netherlands

    Cees J. H. Midden

Authors
  1. Arnout R. H. Fischer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Frans J. J. Blommaert
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cees J. H. Midden
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arnout R. H. Fischer.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fischer, A.R.H., Blommaert, F.J.J. & Midden, C.J.H. Combining Experimental Observations and Modelling in Investigating Feedback and Emotions in Repeated Selection Tasks. User Model User-Adap Inter 15, 389–424 (2005). https://doi.org/10.1007/s11257-005-1868-4

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-005-1868-4

Keywords

Search

Navigation