Advertisement

A Methodology for Evaluation of Knowledge-Based Systems

  • Kevin Clarke
  • Rory O’Moore
  • Raymond Smeets
  • Jan Talmon
  • Jytte Brender
  • Peter McNair
  • Pirkko Nykanen
  • Jane Grimson
  • Barry Barber
Part of the Lecture Notes in Medical Informatics book series (LNMED, volume 45)

Abstract

Knowledge based systems (KBS) are of great potential use in medicine. However, the progress in development and actual day to day use of KBSs in medicine has been disappointing. Shortliffe (1989) believes that this is because medical decision aids are not user friendly, they do not explain their reasoning adequately, they are too time consuming to use in the actual work environment, and particularly because of physician fears of e.g. legal liability and intrusion of the systems into their practice.

Keywords

Decision Support System Clinical Decision Support System Medical Informatics Knowledge Base System Complete Data Collection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barber, B., Jensen, O.A., Lamberts, H., Roger, F.H., De Schouwer, P., Zollner, H. “The Six Safety First Principles Of Health Information Systems, Computer Perspectives In Health Care - Cp90, Uk National Conference Of Medical Informatics 2–4 April (1990), Brighton, Pub. British Journal Of Health Care Computing.Google Scholar
  2. De Dombal, F.T. “Towards a more objective evaluation of computer aided decision support systems”. In MEDINFO ’83. Ed, Van Bemmel J., Ball M.J., Wigertz O. 436–439 (1983).Google Scholar
  3. Miller, P.L. “Evaluation of artificial intelligence systems in medicine.” Comp. Prog. Method Biomed, 22 5–11 (1986 a).Google Scholar
  4. Nolan, J., McNair, P., Brender, J. “Factors Influencing the Transferability of Medical Decision Support Systems”. Int J Biomed Comput, 27, 7–26. (1990).CrossRefGoogle Scholar
  5. O’Moore R., Clarke K., Smeets R., Brender J., Nykanen P., McNair P., Grimson J., Barber B. “Items of Relevance for the Evaluation of Knowledge Based/Expert Systems and Influence from Domain Characteristics”. KAVAS (A1021) Report EM 1.1. EEC AIM Office, 62 Rue de Treves, Brussels. (1990 a).Google Scholar
  6. O’Moore, R., Clarke, K., Brender. J., McNair. P., Nykanen. P., Smeets, R., Talmon, J., Grimson, J., Barber, B. “Methodology for Evaluation of Knowledge Based Systems”. Technical report EM 1.2, KAVAS (A 1021) Project, CEC AIM Programme, (1990 b).Google Scholar
  7. Rossi-Mori, A., Ricci, F.L. “Comprehensive criteria for evaluation and design of knowledge based systems in Medicine.” In System Engineering in Medicine. Ed. Talmon, J. & Fox, J. Springer Verlag (1989).Google Scholar
  8. Schioler, T., Nolan, J., McNair, P. “Transferability of Knowledge Based Systems, Information Technology Factors”, MIE ‘91.Google Scholar
  9. Shortliffe, E.H. “Testing reality - the introduction of decision support technologies for physicians. Meth. Inform. Med., 28, 1–5 (1989).Google Scholar
  10. Smeets, R.P.A.M., Talmon, J.L., O’Moore, R. “General Methodology and Problems in Assessment of Decision Support Systems”. In Lecture Notes in Medical Informatics, MIE490, Vol 40, 225–230. (1990).Google Scholar
  11. Wyatt, J, “The evaluation of clinical decision support systems: a discussion of the methodology used iti the ACORN project. AIME ’87. Ed. Fox, J., Fieschi, M., Engelbrecht, R. Lecture notes in medical informatics 33, Springer Verlag, 229–238 (1987).Google Scholar
  12. Wyatt, J., Spiegelhalter, D. “Evaluating medical decision aids: What to test, and how.” In System In Medicine Eds. Talmon, J. and Fox, J. Springer Verlag 1–13 (1990).Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1991

Authors and Affiliations

  • Kevin Clarke
    • 1
  • Rory O’Moore
    • 1
  • Raymond Smeets
    • 2
  • Jan Talmon
    • 2
  • Jytte Brender
    • 3
  • Peter McNair
    • 4
  • Pirkko Nykanen
    • 5
  • Jane Grimson
    • 1
  • Barry Barber
    • 6
  1. 1.Dept. Computer Science and Laboratory MedicineTrinity CollegeDublinIreland
  2. 2.Dept. of Med. Informatics and StatisticsUniversity of LimburgMaastrichtNetherlands
  3. 3.Computer Resources International a/sCopenhagenDenmark
  4. 4.Dept. Clinical ChemistryHvidovre HospitalCopenhagenDenmark
  5. 5.Med. Engineering LabTechnical Research Centre of FinlandTampereFinland
  6. 6.Information Management CentreNational Health ServiceBirminghamUK

Personalised recommendations