Abstract
This chapter reviews extant research on the quality of expert judgement of probability and risk. Both types of judgement are of great relevance to the concerns of this book, because expert judgement under uncertainty is a key component in the making of decisions with scant information.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ayton P and McClelland AGR. (1997). How real is overconfidence? Journal of Behavioral Decision Making 10:279-285.
Barke RP and Jenkins-Smith HC. (1993). Politics and scientific expertise: scientists, risk perception, and nuclear waste policy. Risk Analysis 13 (4): 425–439.
Bolger F and Wright G. (1994). Assessing the quality of expert judgement: issues and analysis. Decision Making Systems 11:1–24.
Bolger F, Wright G, Rowe Gammack J, and Wood RJ. (1989). Lust for life: developing expert systems for life assurance underwriting. In: Shadbold N (ed.) Research and Development in Expert Systems, VI. Cambridge University Press: Cambridge.
Bockriede W and Ehninger D. (1960). Toulmin on argument: an interpretation and application. Quarterly Journal of Speech 46:44–53.
Carmines EG and Zeller RA. (1979). Reliability and Validity Assessment. Sage University Papers Series: Beverley Hills, CA.
Compte O and Postlewaite A. (2004). Confidence-enhanced performance. American Economic Review 94:1536–1557.
Dalkey N. (1972). An elementary cross-impact model. Technological Forecasting and Social Change 3:341–351.
Dougherty MRP, Getys CF, and Ogden EE. (1999). MINERVA-DM: a memory processes model for judgements of likelihood. Psychological Review 106:180–209.
Dube-Rioux L and Russo JE. (1988). An availability bias in professional judgement. Journal of Behavioural Decision-Making 1:233–237.
Ducharme WM and Peterson CR. (1968). Intuitive inference about normally distributed populations. Journal of Experimental Psychology 78:269–275.
Eddy DM. (1982). Probabilistic reasoning in clinical medicine: problems and opportunities. In: Kahneman D, Slovic P, and Tversky A (eds). Judgement Under Uncertainty: Heuristics and Biases. Cambridge University Press: Cambridge.
Edwards W, Phillips LD, Hays WL, and Goodman BC. (1968). Probabilistic information processing systems. IEEE Transactions on Systems Science and Cybernetics 4:248–265.
Einhorn HJ (1980) Learning from experience and sub-optimal rules in decision making. In Wallsten T (ed.) Cognitive Processes in Choice and Decision Behavior. Hillsdale, N.J.: Erlbaum.
Einhorn HJ and Hogarth RM. (1978). Overconfidence in judgement. Persistence of the illusion of validity. Psychological Review 85:394–476.
Ferrell WR and McGoey PJ. (1980). A model for calibration of subjective probabilities. Organizational Behavior and Human Decision Processes 26:32–53.
Flynn J, Slovic P, and Mertz CK. (1993). Decidedly different: expert and public views of risks from a radioactive waste repository. Risk Analysis 13 (6): 643–648.
Goodwin P and Wright G. (2004). Decision Analysis for Management Judgement. Wiley: Chichester.
Griffin D and Tversky A. (1992). The weighting of evidence and the determinants of overconfidence. Cognitive Psychology 24:411–435.
Gutteling JM and Kuttschreuter M. (1999). The millennium bug controversy in the Netherlands? Experts’ views versus public perception. In: Goossens LHJ (ed.) Proceedings of the 9th Annual Conference of Risk Analysis: Facing the Millennium. Delft University Press: Delft, Netherlands, pp. 489–493.
Hoerl A and Fallin HK. (1974). Reliability of subjective evaluation in a high incentive situation. Journal of the Royal Statistical Society 137:227–230.
Kabus I. (1976). You can bank on uncertainty. Harvard Business Review, May–June, 54:95–105.
Kahneman D, Slovic P, and Tversky A. (1982). Judgement Under Uncertainty: Heuristics and Biases. Cambridge University Press: Cambridge.
Kanal LN and Lemmer JF (eds). (1986). University and Artificial Intelligence. Elsevier: Amsterdam.
Keren G. (1987). Facing uncertainty in the game of bridge: a calibration study. Organisational Behaviour and Human Decision Processes 39:98–114.
Keren G. (1990). Cognitive aids and debiasing methods. In: Caverni JP et al. (eds). Cognitive Biases. Elsevier: Amsterdam.
Kraus N, Malmfors T, and Slovic P. (1992). Intuitive toxicology: expert and lay judgements of chemical risks. Risk Analysis 12 (2): 215–232.
Lemmer JF and Kanal LN (eds). (1988). Uncertainty and Artificial Intelligence 2. Elsevier: Amsterdam.
Lichtenstein S, Fischhoff B, and Phillips LD. (1982). Calibration of probabilities: the state of the art to 1980. In: Kahneman D, Slovic P, and Tversky A (eds). Judgement Under Uncertainty: Heuristics and Biases. Cambridge University Press: New York.
Lichtenstein S, Slovic P, Fischoff B, Layman M, and Combs B. (1978). Judged frequency of lethal events. Journal of Experimental Psychology: Human Learning and Memory 4:551–578.
Maxwell RJ. (1999). The British government’s handling of risk: some reflections on the BSE/CJD crisis. In: Bennett P and Calman K (eds). Communications and Public Health. Oxford University Press: Oxford, pp. 94–107.
McClelland AGR and Bolger F. (1994). The calibration of subjective probabilities: theories and models 1940–94. In: Wright G and Ayton P (eds). Subjective Probability. Wiley: Chichester.
McCroskey JC. (1969). Toward an understanding of the importance of “evidence” in persuasive communication. The Pennsylvania Speech Annual 23:65–71.
McDaniels TL, Axelrod LJ, Cavanagh NS, and Slovic P. (1997). Perception of ecological risk to water environments. Risk Analysis 17 (3): 341–352.
Mumpower JL, Livingston S, and Lee TJ. (1987). Expert judgments of political riskiness. Journal of Forecasting 6:51–65.
Murphy AH and Brown BG. (1985). A comparative evaluation of objective and subjective weather forecasts in the United States. In: Wright G (ed.) Behavioural Decision Making. Plenum: New York.
Oskamp S. (1965). Overconfidence in case-study judgements. Journal of Consulting Psychology 29:261–265.
Phillips LD and Edwards W. (1966). Conservatism in a simple probabilistic inference task. Journal of Experimental Psychology 72:346–354.
Phillips LD, Hays WL, and Edwards W. (1966). Conservatism in complex-probabilistic inferences. IEEE Transactions on Human Factors in Electronics 7:7–18.
Rowe G and Wright G. (1999). The Delphi technique as a forecasting tool: issues and analysis. International Journal of Forecasting 15:353–375.
Rowe G and Wright G. (2001). Differences in experts and lay judgements of risk: myth or reality? Risk Analysis 21:341–356.
Schafer RE, Borcherding K, and Laemmerhold CL. (1977). Consistency of future event assessments. In: Jungermann H and de Zeeuw G (eds). Decision Making and Change in Human Affairs. Reidel, Dordrecht: The Netherlands.
Shafer G. (1987). Probability judgement in artificial intelligence and expert systems. Statistical Science 2:3–44.
Shanteau J. (1978). When does a response error become a judgement bias? Commentary on “judged frequency of lethal events”. Journal of Experimental Psychology: Human Learning and Memory 4 (6): 579–581.
Shanteau J. (1992). The psychology of experts: an alternative view. In: Wright G and Bolger F (eds). Expertise and Decision Support. Plenum: New York.
Slovic P. (1987). Perception of risk. Science 236:280–285.
Slovic P. (1999). Trust, emotion, sex, politics and science: surveying the risk-assessment battlefield. Risk Analysis 19 (4): 689–701.
Slovic P, Fischhoff B, and Lichtenstein S. (1985). Characterizing perceived risk. In: Kates RW, Hohenemser C, and Kasperson JX (eds). Perilous Progress: Managing the Hazards of Technology. Westview: Boulder, CO, pp. 91–125.
Slovic P, Malmfors T, Krewski D, Mertz CK, Neil N, and Bartlett S. (1995). Intuitive toxicology II. Expert and lay judgements of chemical risks in Canada. Risk Analysis 15 (6): 661–675.
Smith TJ. (1972). The Effects of Truth and Desirability Evidence on Judgements of Truth and Desirability of a Proposition. Unpublished Master’s thesis. Michigan State University: East Lansing.
Stanchi KM. (2006). The science of persuasion: an initial exploration. Michigan State Law Review I 52:1–45.
Tonn BE, Goeltz RT, and Travis C. (1992). Eliciting reliable uncertainty estimates. Expert Systems 9 (1): 25–33.
Tversky A and Koehler DJ. (1994). Support theory: a nonextensional representation of subjective-probability. Psychological Review 101:547–567.
Wagenaar WA and Keren GB. (1986). Does the expert know? The reliability of predictions and confidence ratings of experts. In: Hollnagel E et al. (eds). Intelligent Decision Support in Process Environment. Springer-Verlag: Berlin.
Wallace HA. (1923). What is the corn Judge’s mind? Journal of the American Society of Agronomy 15:300-304.
Wallsten TS and Budescu DV. (1983). Encoding subjective probabilities: a psychological and psychometric review. Management Science 29:151–173.
Wright G and Ayton P. (1987). Judgemental Forecasting. Wiley: Chichester.
Wright G, Bolger F, and Rowe G. (2002). An empirical test of the relative validity of expert and lay judgments of risk. Risk Analysis 22 (6): 1107–1122.
Wright G, Pearman A, and Yardley K. (2000). Risk perception in the UK oil and gas production industry: are expert loss-prevention managers’ perceptions different from those of members of the public? Risk Analysis 20:681-690.
Wright G, Rowe G, Bolger F, and Gammack G. (1994). Coherence, calibration and expertise in judgemental probability forecasting. Organisational Behavior and Human Decision Processes 57:1–25.
Wright G, Saunders C, and Ayton P. (1988). The consistency, coherence and calibration of holistic, decomposed and recomposed judgemental probability forecasts. Journal of Forecasting 7:185–199.
Yates JF. (1990). Judgement and Decision Making. Prentice-Hall: Englewood Cliffs, NJ.
Youseff ZI and Peterson CR. (1973). Intuitive cascaded inferences. Organisational Behaviour and Human Performance 10:349–358.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Copyright information
© 2009 George Wright, Fergus Bolger and Gene Rowe
About this chapter
Cite this chapter
Wright, G., Bolger, F., Rowe, G. (2009). Expert Judgement of Probability and Risk. In: Williams, T.M., Samset, K., Sunnevåg, K.J. (eds) Making Essential Choices with Scant Information. Palgrave Macmillan, London. https://doi.org/10.1057/9780230236837_11
Download citation
DOI: https://doi.org/10.1057/9780230236837_11
Publisher Name: Palgrave Macmillan, London
Print ISBN: 978-1-349-30224-6
Online ISBN: 978-0-230-23683-7
eBook Packages: Palgrave Business & Management CollectionBusiness and Management (R0)