Abstract
Expert elicitation is the process of determining what expert knowledge is relevant to support a quantitative analysis and then eliciting this information in a form that supports analysis or decision-making. The credibility of the overall analysis, therefore, relies on the credibility of the elicited knowledge. This, in turn, is determined by the rigor of the design and execution of the elicitation methodology, as well as by its clear communication to ensure transparency and repeatability. It is difficult to establish rigor when the elicitation methods are not documented, as often occurs in ecological research. In this chapter, we describe software that can be combined with a well-structured elicitation process to improve the rigor of expert elicitation and documentation of the results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Albert I, Donnet S, Guihenneuc C et al (2010) Combining expert opinions in expert elicitation. Available from http://eprints.qut.edu.au/40812 (accessed April 2011)
Austin M (2002) Spatial prediction of species distribution: an interface between ecological theory and statistical modelling. Ecol Modell 157:101–118
Baguley T (2004) Understanding statistical power in the context of applied research. Appl Ergon 35:73–80
Bedrick EJ, Christensen R, Johnson W (1996) A new perspective on priors for generalized linear models. J Am Stat Assoc 91(436):1450–1460
Boyce MS, Irwin LL, Barker R (2005) Demographic meta-analysis: synthesizing vital rates for spotted owls. J Appl Ecol 42:38–49
Cooke RM, Goosens LLJH (2008) TU Delft expert judgment data base. Reliab Engin Syst Safe 93:657–674
Denham R, Mengersen K (2007) Geographically assisted elicitation of expert opinion for regression models. Bayesian Anal 2(1):99–136
Donald M, Mengersen K, Toze S et al (2011) Incorporating parameter uncertainty into Quantitative Microbial Risk Assessments (QMRA). J Water Health 9(1):10–26
Elith J, Graham C, Anderson R et al (2006) Novel methods improve prediction of species’ distributions from occurrence data. Ecography 29:129–151
Fitzpatrick MC, Hargrove WW (2009) The projection of species distribution models and the problem of non-analog climate. Biodivers Conserv 18:2255–2261
Fleishman E, MacNally R, Fay JP, Murphy DD (2001) Modelling and predicting species occurrences using broad-scale environmental variables: an example with butterflies of the great basin. Conserv Biol 15:1674–1685
Ihaka R, Gentleman R (1996) R: A Language for Data Analysis and Graphics, J Comput Graph Statist 5:299–314
James A, Low-Choy S, Murray J, Mengersen K (2010) Elicitator: An expert elicitation tool for regression in ecology. Environ Modell Softw 25(1):129–145
Jarrad F, Barrett S, Murray J et al (2011 Improved design method for biosecurity surveillance and early detection of non-indigenous rats. New Zeal J Ecol 35(2), Available from http://www.nzes.org.nz/nzje/new_issues/NZJEcol_JarradIP.pdf (accessed April 2011)
Johnson S, Fielding F, Hamilton G, Mengersen K (2010) An Integrated Bayesian Network approach to Lyngbya majuscula bloom initiation. Marine Environ Res 69:27–37
Kadane JB, Dickey JM, Winkler RL et al (1980) Interactive elicitation of opinion for a normal linear model. J Am Stat Assoc 75:845–854
Keeney RL, von Winterfeldt D (1991) Eliciting probabilities from experts in complex technical problems. IEEE Trans Eng Manage 38(3):191–201
Kuhnert P, Martin TG, Griffiths SP (2010) A guide to eliciting and using expert knowledge in Bayesian ecological models. Ecol Lett 13:900–914
Kynn M (2005) Eliciting expert opinion for a Bayesian logistic regression model in natural resources. PhD thesis, School of Mathematical Sciences, Queensland University of Technology, Brisbane. Available from http://eprints.qut.edu.au/16041/ (accessed April 2011)
Kynn M (2008) The “heuristics and biases” bias in expert elicitation. J Roy Stat Soc A Sta 171(1):239–264
Low-Choy S, James A, Mengersen K (2009a) Expert elicitation and its interface with technology: a review with a view to designing Elicitator. In: Anderssen RS, Braddock RD, Newnham LTH (eds) 18th World IMACS Congress and MODSIM09 International Congress on Modelling and Simulation. Modelling and Simulation Society of Australia and New Zealand and International Association for Mathematics and Computers in Simulation, pp 4269–4275. Available from http://www.mssanz.org.au/modsim09/J2/lowchoy.pdf (accessed April 2011)
Low-Choy S, O’Leary R, Mengersen K (2009b) Elicitation by design for ecology: using expert opinion to inform priors for Bayesian statistical models. Ecology 90:265–277
Low-Choy S, Wilson T (2009) How do experts think about statistics? Hints for improving undergraduate and postgraduate training. In: Murphy P (ed) Next Steps in Statistics Education, Durban, South Africa 2009. International Association for Statistics Education, Auckland. Available from http://www.stat.auckland.ac.nz/∼iase/publications/sat09/4_3.pdf (accessed April 2011)
Low-Choy S, Murray J, James A, Mengersen K (2010) Indirect elicitation from ecological experts: from methods and software to habitat modelling and rock-wallabies. In: O’Hagan A, West M (eds) Oxford Handbook of Applied Bayesian Analysis. Oxford University Press, Oxford
Martin TG, Kuhnert PM, Mengersen K, Possingham HP (2005) The power of expert opinion in ecological models: A Bayesian approach examining the impact of livestock grazing on birds. Ecol Appl 15(1):266–280
McCarthy MA (2007) Bayesian Methods for Ecology, Cambridge University Press, Cambridge
Murray JV (2009) Spatial modeling for the conservation of threatened species: distributions, habitats and landscape connectivity of the brush-tailed rock wallaby (Petrogale penicillata). PhD thesis, School of Biological Sciences, The University of Queensland, Brisbane, Available from: http://espace.library.uq.edu.au/view/UQ:188140 (accessed April 2011)
Murray JV, Goldizen AW, O’Leary RA et al (2009) How useful is expert opinion for predicting the distribution of a species within and beyond the region of expertise? A case study using brush-tailed rock-wallabies Petrogale penicillata. J Appl Ecol 46:842–851
Murray JV, Low-Choy S, McAlpine CA et al (2011) Evaluating model transferability for a threatened species to adjacent areas: implications for rock-wallaby conservation. Austral Ecol 36(1):76–89
Murray J, Low-Choy S, Possingham H, Goldizen A (2008) The importance of ecological scale for wildlife conservation in naturally fragmented environments: A case study of the brush-tailed rock-wallaby (Petrogale penicillata). Biol Conserv 141:7–22
Oakley JE, O’Hagan, A (2010) SHELF: the Sheffield Elicitation Framework (version 2.0). School of Mathematics and Statistics, University of Sheffield, Sheffield. Available from http://tonyohagan.co.uk/shelf (accessed April 2011)
O’Hagan A, Buck CE, Daneshkhah A et al (2006) Uncertain judgements: eliciting experts’ probabilities. John Wiley & Sons Inc, Chichester
O’Leary R, Low-Choy S, Murray J et al (2009) Comparison of three elicitation methods for logistic regression on predicting the presence of the threatened brush-tailed rock-wallaby Petrogale penicillata. Environmetrics 20:379–398
O’Leary RA, Murray JV, Low-Choy S, Mengersen K (2008) Expert elicitation for Bayesian classification trees. J Appl Prob Stat 3:95–106
Pike WA (2004) Modeling drinking water quality violations with Bayesian networks. J Am Water Resour Assoc 40:1563–1578
Sheppard CRC (1999) How large should my sample be? Some quick guides to sample size and the power of tests. Mar Pollut Bull 38(6):439–447
Smith CS, Howes AL, Price B, McAlpine CA (2007) Using a Bayesian belief network to predict suitable habitat of an endangered mammal—the Julia Creek dunnart (Sminthopsis douglasi). Biol Conserv 8:333–347
Spiegelhalter DJ, Thomas A, Best NG, Lunn D (2003) WinBUGS version 1.4 user manual. MRC Biostatistics Unit, Cambridge. Technical report
Store R, Kangas J (2001) Integrating spatial multi-criteria evaluation and expert knowledge for GIS-based habitat suitability modelling. Landsc Urban Plan 55:79–93
Uusitalo L (2007) Advantages and challenges of Bayesian networks in environmental modelling. Ecol Modell 203:312–318
Vikneswaran (2005) An R companion to “experimental design”. Available from http://cran.r-project.org/doc/contrib/Vikneswaran-ED_companion.pdf (accessed April 2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Low-Choy, S., James, A., Murray, J., Mengersen, K. (2012). Elicitator: A User-Friendly, Interactive Tool to Support Scenario-Based Elicitation of Expert Knowledge. In: Perera, A., Drew, C., Johnson, C. (eds) Expert Knowledge and Its Application in Landscape Ecology. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1034-8_3
Download citation
DOI: https://doi.org/10.1007/978-1-4614-1034-8_3
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-1033-1
Online ISBN: 978-1-4614-1034-8
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)