Abstract
Evaluation of knowledge acquisition (KA) is difficult in general because of the costs of using a human expert. In this paper, we use a general simulation framework to evaluate some aspects of KA. We focus on the importance of acquiring domain ontological structures and the use of stored or cornerstone cases to validate changes. We find that the for a higher level of expertise, an ontology is very useful, but cornerstone cases less so, but the weaker the level of expertise, the more valuable the cornerstone cases and the less helpful an ontology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cao, T., Compton, P.: A simulation framework for knowledge acquisition evaluation. In: Proceedings of 28th Australasian Computer Science Conference, pp. 353–361 (2005)
Clancey, W.J.: Heuristic classification. Artificial Intelligence 27, 289–350 (1985)
Compton, P., Jansen, R.: A philosophical basis for knowledge acquisition. knowledge acquisition 2, 241–257 (1990)
Compton, P., Preston, P., Kang, B.: The use of simulated experts in evaluating knowledge acquisition. In: Gaines, B., Musen, M. (eds.) 9th Banff KAW Proceeding, pp. 1–12 (1995)
Compton, P., Peters, L., Edwards, G., Lavers, T.: Experience with ripple-down rules. Knowledge Based Systems (to appear, 2006)
Gomez-Perez, A.: Evaluation of ontologies. Int. J. Intelligent Systems 16, 391–409 (2001)
Menzies, T., Van Hamelen, F.: Editorial: Evaluating knowledge engineering techniques. Journal of Human-Computer Studies 51(4), 715–727 (1999)
Noy, N.F., Sintek, M., Decker, S., Crubézy, M., Fergerson, R.W., Musen, M.A.: Creating semantic web contents with protégé-2000. IEEE Intelligent Systems 16(2), 60–71 (2001)
Shadbolt, N., O’Hara, K.: The experimental evaluation of knowledge acquisition techniques and methods: history, problem and new directions. Journal of Human-Computer Studies 51(4), 729–775 (1999)
Sure, Y., Gómez-Pérez, A., Daelemans, W., Reinberger, M.-L., Guarino, N., Noy, N.F.: Why evaluate ontology technologies? because it works!. IEEE Intelligent Systems 19(4), 74–81 (2004)
van Heijst, G., Schreiber, A.T., Wielinga, B.J.: Using explicit ontologies in kbs development. Journal of Human-Computer Studies 45, 183–292 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cao, T.M., Compton, P. (2006). Knowledge Acquisition Evaluation Using Simulated Experts. In: Staab, S., Svátek, V. (eds) Managing Knowledge in a World of Networks. EKAW 2006. Lecture Notes in Computer Science(), vol 4248. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11891451_6
Download citation
DOI: https://doi.org/10.1007/11891451_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46363-4
Online ISBN: 978-3-540-46365-8
eBook Packages: Computer ScienceComputer Science (R0)