Skip to main content

Metacognition and Confidence in Value-Based Choice

  • Chapter
  • First Online:
Book cover The Cognitive Neuroscience of Metacognition

Abstract

Basic psychophysics tells us that decisions are rarely perfect: even with identical stimuli choice accuracy fluctuates and errors are often made. Metacognition allows appraisal of this uncertainty and correction of errors. For more complex value-based choices, however, metacognitive processes are poorly understood. In particular, how subjective confidence and valuation of choice options interact at the level of brain and behaviour is unknown. In this chapter, we summarise and discuss the results of a study designed to investigate this relationship. Subjects were asked to choose between pairs of snack items and subsequently provide a confidence rating in their choice. As predicted by a computational model of the decision process, confidence reflected the evolution of a decision variable over time, explaining the observed relation between confidence, value, accuracy and reaction time (RT). Furthermore, fMRI signal in human ventromedial prefrontal cortex (vmPFC) reflected both value comparison and confidence in the value comparison process. In contrast, individuals’ metacognitive ability was predicted by a measure of functional connectivity between vmPFC and rostrolateral prefrontal cortex (rlPFC), a region that responded to changes in confidence but was not involved in representing the values used to guide choice. These results provide a novel link between noise in value comparison and metacognitive awareness of choice, extending the study of metacognition to value-based decision-making.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baranski JV, Petrusic WM (2001) Testing architectures of the decision-confidence relation. Can J Exp Psychol 55(3):195–206

    Article  CAS  PubMed  Google Scholar 

  2. Basten U et al (2010) How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci 107(50):21767–21772

    Article  CAS  PubMed  Google Scholar 

  3. Beck JM et al (2012) Not noisy, just wrong: The role of suboptimal inference in behavioral variability. Neuron 74(1):30–39

    Article  CAS  PubMed  Google Scholar 

  4. Becker GM, DeGroot MH, Marschak J (1964) Measuring utility by a single-response sequential method. Behav Sci 9(3):226–232

    Article  CAS  PubMed  Google Scholar 

  5. Bogacz R et al (2006) The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 113(4):700–765

    Article  PubMed  Google Scholar 

  6. Daniel R, Pollmann S (2012) Striatal activations signal prediction errors on confidence in the absence of external feedback. NeuroImage 59(4):3457–3467

    Article  PubMed  Google Scholar 

  7. Daw N (2011) Trial-by-trial data analysis using computational models. In: Delgado MR, Phelps EA, Robbins TW (eds) Decision making, affect, and learning: Attention and performance XXIII. Oxford University Press, Oxford

    Google Scholar 

  8. De Martino B et al (2013) Confidence in value-based choice. Nat Neurosci 16(1):105–110

    Article  PubMed Central  PubMed  Google Scholar 

  9. De Martino B et al (2009) The neurobiology of reference-dependent value computation. J Neurosci 29(12):3833–3842

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  10. Faisal AA, Selen LPJ, Wolpert DM (2008) Noise in the nervous system. Nat Rev Neurosci 9(4):292–303

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  11. FitzGerald THB, Seymour B, Dolan RJ (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29(26):8388–8395

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  12. Fleming SM et al (2010) Relating introspective accuracy to individual differences in brain structure. Science 329(5998):1541–1543

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  13. Fleming SM, Huijgen J, Dolan RJ (2012) Prefrontal contributions to metacognition in perceptual decision making. J Neurosci 32(18):6117–6125

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  14. Friston K (2010) The free-energy principle: A unified brain theory? Nat Rev Neurosci 11(2):127–138

    Article  CAS  PubMed  Google Scholar 

  15. Glimcher PW (2005) Indeterminacy in brain and behavior. Annu Rev Psychol 56:25–56

    Article  PubMed  Google Scholar 

  16. Gul F, Pesendorfer W (2006) Random expected utility. Econometrica 74(1):121–146

    Article  Google Scholar 

  17. Hare TA et al (2008) Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28(22):5623–5630

    Article  CAS  PubMed  Google Scholar 

  18. Hare TA, Malmaud J, Rangel A (2011) Focusing attention on the health aspects of foods changes value signals in vmPFC and improves dietary choice. J Neurosci 31(30):11077–11087

    Article  CAS  PubMed  Google Scholar 

  19. Hunt LT et al (2012) Mechanisms underlying cortical activity during value-guided choice. Nat Neurosci 15:470–476

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  20. Insabato A et al (2010) Confidence-related decision making. J Neurophysiol 104(1):539–547

    Article  PubMed  Google Scholar 

  21. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10(12):1625–1633

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  22. Kahneman D, Tversky A (1979) Prospect theory—analysis of decision under risk. Econometrica 47(2):263–291

    Article  Google Scholar 

  23. Kepecs A et al (2008) Neural correlates, computation and behavioural impact of decision confidence. Nature 455(7210):227–231

    Article  CAS  PubMed  Google Scholar 

  24. Kiani R, Shadlen M (2009) Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324(5928):759

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  25. Knill DC, Pouget A (2004) The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci 27(12):712–719

    Article  CAS  PubMed  Google Scholar 

  26. Koriat A (1997) Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. J Exp Psychol Gen 126(4):349

    Article  Google Scholar 

  27. Koriat A, Goldsmith M (1996) Monitoring and control processes in the strategic regulation of memory accuracy. Psychol Rev 103(3):490–517

    Article  CAS  PubMed  Google Scholar 

  28. Lau H, Rosenthal D (2011) Empirical support for higher-order theories of conscious awareness. Trends Cogn Sci 15(8):365–373

    Article  PubMed  Google Scholar 

  29. Louviere J et al (2002) Dissecting the random component of utility. Mark Lett 13(3):177–193

    Article  Google Scholar 

  30. Maniscalco B, Lau H (2012) A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings. Conscious Cogn 21(1):422–430

    Article  PubMed  Google Scholar 

  31. Maniscalco B, Lau H (2010) Comparing signal detection models of perceptual decision confidence. J Vis 10(7):213

    Article  Google Scholar 

  32. McCurdy LY et al (2013) Anatomical coupling between distinct metacognitive systems for memory and visual perception. J Neurosci 33(5):1897–1906

    Article  CAS  PubMed  Google Scholar 

  33. McFadden D (1980) Econometric models for probabilistic choice among products. J Bus pp S13–S29

    Google Scholar 

  34. Milosavljevic M et al (2010) The drift diffusion model can account for value-based choice response times under high and low time pressure. Judgement Decis Making 5:437–449

    Google Scholar 

  35. Moreno-Bote R (2010) Decision confidence and uncertainty in diffusion models with partially correlated neuronal integrators. Neural Comput 22(7):1786–1811

    Article  PubMed  Google Scholar 

  36. Nelson TO, Narens L (1990) Metamemory: A theoretical framework and new findings. Psychol Learn Motiv 26, 125–322

    Google Scholar 

  37. Pasquali A, Timmermans B, Cleeremans A (2010) Know thyself: Metacognitive networks and measures of consciousness. Cognition 117(2):182–190

    Article  PubMed  Google Scholar 

  38. Plassmann H, O’Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27(37):9984–9988

    Article  CAS  PubMed  Google Scholar 

  39. Pleskac TJ, Busemeyer JR (2010) Two-stage dynamic signal detection: A theory of choice, decision time, and confidence. Psychol Rev 117(3):864–901

    Article  PubMed  Google Scholar 

  40. Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20(2):262–270

    Article  CAS  PubMed  Google Scholar 

  41. Ratcliff R, Rouder JN (1998) Modeling response times for two-choice decisions. Psychol Sci 9(5):347–356

    Article  Google Scholar 

  42. Ratcliff R, Starns JJ (2009) Modeling confidence and response time in recognition memory. Psychol Rev 116(1):59–83

    Article  PubMed Central  PubMed  Google Scholar 

  43. Rolls ET, Grabenhorst F, Deco G (2010) Choice, difficulty, and confidence in the brain. NeuroImage 53(2):694–706

    Article  PubMed  Google Scholar 

  44. Rounis E et al (2010) Theta-burst transcranial magnetic stimulation to the prefrontal cortex impairs metacognitive visual awareness. Cogn Neurosci 1(3):165–175

    Article  PubMed  Google Scholar 

  45. Rushworth MFS et al (2011) Frontal cortex and reward-guided learning and decision-making. Neuron 70(6):1054–1069

    Article  CAS  PubMed  Google Scholar 

  46. Smith DV et al (2010) Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 30(7):2490–2495

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  47. Soltani A, De Martino B, Camerer C (2012) A range-normalization model of context-dependent choice: A new model and evidence. PLoS Comput Biol 8(7):e1002607

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  48. Sugrue LP, Corrado GS, Newsome WT (2005) Choosing the greater of two goods: Neural currencies for valuation and decision making. Nat Rev Neurosci 6(5):363–375

    Article  CAS  PubMed  Google Scholar 

  49. Summerfield C, Tsetsos K (2012) Building bridges between perceptual and economic decision-making: Neural and computational mechanisms. Frontiers Neurosci 6:70

    Article  Google Scholar 

  50. Usher M, McClelland JL (2001) The time course of perceptual choice: The leaky, competing accumulator model. Psychol Rev 108(3):550–592

    Article  CAS  PubMed  Google Scholar 

  51. Vickers D (1979) Decision processes in visual perception. Academic Press, New York

    Google Scholar 

  52. Wang S et al (2012) The role of risk aversion in non-conscious decision making. Frontiers Psychol 3

    Google Scholar 

  53. Yokoyama O et al (2010) Right frontopolar cortex activity correlates with reliability of retrospective rating of confidence in short-term recognition memory performance. Neurosci Res 68(3):199–206

    Article  PubMed  Google Scholar 

  54. Zylberberg A, Barttfeld P, Sigman M (2012) The construction of confidence in a perceptual decision. Frontiers Integr Neurosci 6

    Google Scholar 

Download references

Acknowledgments

The research reviewed in this chapter was supported by the Wellcome Trust. SMF is supported by a Sir Henry Wellcome Fellowship (WT096185). BDM is supported by a UCL early career fellowship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stephen M. Fleming .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Fleming, S.M., De Martino, B. (2014). Metacognition and Confidence in Value-Based Choice. In: Fleming, S., Frith, C. (eds) The Cognitive Neuroscience of Metacognition. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45190-4_8

Download citation

Publish with us

Policies and ethics