Abstract
The acquisition of knowledge from multiple experts for the development of intelligent decision support systems is difficult in that divergent opinions are often held so strongly that consensus cannot be reached. Yet, disagreement is a common feature in fields such as law, science and engineering. A model for eliciting common ground amongst experts without the involvement of extensive knowledge engineer resources is presented. The model, called Consult, enables experts to elicit a set of arguments that are plausible for an issue. The process involves three steps. A knowledge engineer initially elicits a set of arguments consistent with the generic actual argument model (GAAM) from one expert. A process based on the Delphi method is then used to anonymously elicit suggested modifications from other experts. The Borda Count voting system is used in the third phase to elect modifications preferred by experts. In this way, Consult semi-automates knowledge acquisition by capturing a consensus view from multiple experts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Buchanan B, Barstow D, Bechtal R, et al. Constructing an expert system. In: Hays-Roth F, Waterman D, Lenat D (eds) Building Expert systems. Addison-Wesley, MA, 1983
Clemen RT, Winkler RL. Limits in the precision and value of information from dependent sources. Operations Research 1985; 33: 427–442
Linstone HA, Turoff M. The Delphi Method, Techniques and Applications. Addison-Wesley Publication Company, London, Amsterdam, Don Mills, Ontario, Sydney, Tokyo, 1975
Gains BR, Shaw ML. Comparing the Conceptual Systems of Experts. The 11th International Joint Conference on Artificial Intelligence 1989; 633–638
LeClair SR. A Multi expert Knowledge System Architecture for Manufacturing Decision Analysis. Ph.D. Dissertation, Arizona State University, Tempe, Arizona, 1985
Skuce D. Conventions for Reaching Agreement on Shared ontologies. In: Gaines B, Musen M (eds) Proc. 9th BANFF Knowledge Acquisition for Knowledge-Based Systems Workshop. SRDG Publications, Banff, Alberta, Canada, 1995, pp. 3–19
Richards D. Negotiating a Shared Conceptual Model using Groupware. In: Proceedings of the 11th Australasian Conference on Information Systems, 6–8 December. Brisbane, Australia, 2000
Trice A, Davis R. Consensus knowledge acquisition information technologies group, Working Paper. MIT School of Management, 1989
Compton P, Edwards G, Srinivasan A, et al. Ripple-down-rules: Turning Knowledge Acquisition into Knowledge Maintenance. Artificial Intelligence in Medicine 1992; 47–59
Boose J. Expertise Transfer for Expert Systems Design. Elsevier, Amsterdam, 1986
Shaw ME. Group Dynamics: The Psychology of Small Group Behavior. third ed. McGraw Hill, New York, 1981
Vogel D, Nunamaker J. Group Decision Support System Impact: Multi methodological Exploration. In: Galegher J, Kraut R, Egido C (eds) Proceedings of Conference on Technology and Cooperative Work (Tucson, Arizona, February 25–28). National Science Foundation, Bell Communications, University of Arizona, Tucson, 1988
Stranieri A, Zeleznikow J, Yearwood J. Argumentation structures that integrate dialectical and non-dialectical reasoning. To appear in Knowledge Engineering Review 2002
Gordon TF, Karacapilidis N. The Zeno argumentation framework. In: Proceedings of the Sixth International Conference on AI and Law. ACM Press. New York City, NY, USA, 1997
Yearwood J, Stranieri A. The integration of retrieval, reasoning and drafting for refugee law: a third generation legal knowledge based system. In: Seventh International Conference on Artificial Intelligence and Law, ICAIL. ACM Press. 1999
Toulmin SE. The uses of argument,. Cambridge University Press, Cambridge, England, 1958
Stranieri A, Zeleznikow J, Gawler M, et al. A Hybrid rule- neural approach for the automation of legal reasoning in the discretionary domain of family law in Australia. Artificial Intelligence and Law 1999; 153-183
Stranieri A, Zeleznikow J. Copyright regulation with argumentation agents. Information and Communication Law 2000.; 10: 123–137
Saari DG. Basic geometry of voting. Springer, Berlin, New York, 1995
Yearwood J, Stranieri A. An argumentation shell for knowledge based systems. In: Proceedings of IASTED International conference on Law and Technology. 2000
Stasser G. Information Salience and the discovery of hidden profiles by decision making groups: a “thought experiment” Organisational Behaviour and Human Decision Processes 1992; 156–181
Turoff M, Hiltz SR. Computer Based Delphi Processes. Cited at:http://eies.nJit.edu/~turoff/Papers/delphi3.html, 2002
Scheibe M, Skusch M, Schofer J. Experiments in Delphi Methodology, supported by the Urban Systems Engineering Center, Northwestern University. In: Linstone HA, Turoff M (eds) The Delphi Method, Techniques and Applications. Addison-Wesley Publication Company, London, Amsterdam, DonMills, Ontario, Sydney, Tokyo, 1975, pp. 262–288
Damian D, Eberlein A, Shaw M, et al. Studies in Distributed Software Requirements Engineering. In: Proceedings of the 12th Workshop on Knowledge Acquisition, Modelling and management, KAW. Banff, 1999
Diehl M, Stroebe W. Productivity loss in brainstorming groups: toward the solution of a riddle. Journal of personality and social psychology 1987; 497–509
Gordon HB, Morrow DG. Mental models in narrative comprehension. Science 1990; 44–48
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag London Limited
About this paper
Cite this paper
Afshar, F., Yearwood, J., Stranieri, A. (2003). Capturing Consensus Knowledge from Multiple Experts. In: Bramer, M., Preece, A., Coenen, F. (eds) Research and Development in Intelligent Systems XIX. Springer, London. https://doi.org/10.1007/978-1-4471-0651-7_18
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0651-7_18
Publisher Name: Springer, London
Print ISBN: 978-1-85233-674-5
Online ISBN: 978-1-4471-0651-7
eBook Packages: Springer Book Archive