Cognitive Process of Emotion Under Uncertainty
One of the missions of the cognitive process of animals, including humans, is to make reasonable judgments and decisions in the presence of uncertainty. The balance between exploration and exploitation investigated in the reinforcement-learning paradigm is one of the key factors in this process. Recently, following the pioneering work in behavioral economics, growing attention has been directed to human behaviors exhibiting deviations from simple maximization of re-ward. Here we study the nature of human decision making under the existence of reward uncertainty, employing a condition where the reward expectancy is constant (flat reward condition). The characteristic behavioral patterns exhibited by subjects reveal the underlying reward-related neural mechanism. The relevance of this result to the functions of dopamine neurons is discussed.
KeywordsDopamine Neuron Behavioral Economic Ultimatum Game Differential Behavior Safe Base
Unable to display preview. Download preview PDF.
- 1.Graham, G., Neisser, J.: Probing for relevance: what metacognition tells us about the power of consciousness. Conscious Cogn. 9(2 Pt 1), 172–7 (2000)Google Scholar
- 4.Koriat, A.: The feeling of knowing: some metatheoretical implications for consciousness and control. Conscious Cogn. 9(2 Pt 1), 149–71 (2000)Google Scholar
- 5.Sutton, R.S., Barto, A.: Reinforcement learning. MIT Press, Cambridge (1998)Google Scholar
- 7.Bowlby, J.: Attachment. Perseus Books (1982)Google Scholar
- 8.Fiorillo, C.D., Tobler, P.N., Schultz, W.: Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299(5614), 1898–902 (2003)Google Scholar
- 10.Schultz, W., Dayan, P., Montague, P.: A neural substrate of prediction and reward. Science 275(5306), 1593–9 (1997)Google Scholar
- 11.Shizgal, P., Arvanitogiannis, A.: Neuroscience. Gambling on dopamine. Science 299(5614), 1856–8 (2003)Google Scholar
- 12.Kahneman, D., Slovic, P., Tversky, A.: Judgment under uncertainty. Cambridge University Press, Cambridge (1982)Google Scholar
- 13.Kahneman, D., Tversky, A.: Choices, Values, and Flames. Cambridge University Press, Cambridge (2000)Google Scholar
- 14.Sanfey, A.G., Rilling, J.K., Aronson, J.A., Nystrom, L.E., Cohen, J.D.: The neural basis of economic decision-making in the Ultimatum Game. Science 300(5626), 1755–8 (2003)Google Scholar
- 15.Milinski, M., Wedekind, C.: Working memory constraints human cooperation in the prisoner’s dilemma. Proc Natl Acad Sci U S A 95(23), 13755–8 (1998)Google Scholar