A Methodology for Evaluation of Knowledge-Based Systems
Knowledge based systems (KBS) are of great potential use in medicine. However, the progress in development and actual day to day use of KBSs in medicine has been disappointing. Shortliffe (1989) believes that this is because medical decision aids are not user friendly, they do not explain their reasoning adequately, they are too time consuming to use in the actual work environment, and particularly because of physician fears of e.g. legal liability and intrusion of the systems into their practice.
KeywordsDecision Support System Clinical Decision Support System Medical Informatics Knowledge Base System Complete Data Collection
Unable to display preview. Download preview PDF.
- Barber, B., Jensen, O.A., Lamberts, H., Roger, F.H., De Schouwer, P., Zollner, H. “The Six Safety First Principles Of Health Information Systems, Computer Perspectives In Health Care - Cp90, Uk National Conference Of Medical Informatics 2–4 April (1990), Brighton, Pub. British Journal Of Health Care Computing.Google Scholar
- De Dombal, F.T. “Towards a more objective evaluation of computer aided decision support systems”. In MEDINFO ’83. Ed, Van Bemmel J., Ball M.J., Wigertz O. 436–439 (1983).Google Scholar
- Miller, P.L. “Evaluation of artificial intelligence systems in medicine.” Comp. Prog. Method Biomed, 22 5–11 (1986 a).Google Scholar
- O’Moore R., Clarke K., Smeets R., Brender J., Nykanen P., McNair P., Grimson J., Barber B. “Items of Relevance for the Evaluation of Knowledge Based/Expert Systems and Influence from Domain Characteristics”. KAVAS (A1021) Report EM 1.1. EEC AIM Office, 62 Rue de Treves, Brussels. (1990 a).Google Scholar
- O’Moore, R., Clarke, K., Brender. J., McNair. P., Nykanen. P., Smeets, R., Talmon, J., Grimson, J., Barber, B. “Methodology for Evaluation of Knowledge Based Systems”. Technical report EM 1.2, KAVAS (A 1021) Project, CEC AIM Programme, (1990 b).Google Scholar
- Rossi-Mori, A., Ricci, F.L. “Comprehensive criteria for evaluation and design of knowledge based systems in Medicine.” In System Engineering in Medicine. Ed. Talmon, J. & Fox, J. Springer Verlag (1989).Google Scholar
- Schioler, T., Nolan, J., McNair, P. “Transferability of Knowledge Based Systems, Information Technology Factors”, MIE ‘91.Google Scholar
- Shortliffe, E.H. “Testing reality - the introduction of decision support technologies for physicians. Meth. Inform. Med., 28, 1–5 (1989).Google Scholar
- Smeets, R.P.A.M., Talmon, J.L., O’Moore, R. “General Methodology and Problems in Assessment of Decision Support Systems”. In Lecture Notes in Medical Informatics, MIE490, Vol 40, 225–230. (1990).Google Scholar
- Wyatt, J, “The evaluation of clinical decision support systems: a discussion of the methodology used iti the ACORN project. AIME ’87. Ed. Fox, J., Fieschi, M., Engelbrecht, R. Lecture notes in medical informatics 33, Springer Verlag, 229–238 (1987).Google Scholar
- Wyatt, J., Spiegelhalter, D. “Evaluating medical decision aids: What to test, and how.” In System In Medicine Eds. Talmon, J. and Fox, J. Springer Verlag 1–13 (1990).Google Scholar