Summary
This chapter will focus on two “skills” which occur frequently in discussions in medical education — critical thinking and critical appraisal. While the terms are often used interchangeably, and share some common characteristics, they have very different lineages. Critical thinking refers to general strategies which might be used in a variety of problem situations to gather and evaluate data, generate hypotheses, assess evidence and arrive at conclusions. By contrast, critical appraisal was coined at McMaster University to describe skills used to evaluate clinical research articles according to principles of clinical epidemiology. Thus, there are published criteria to assess the methodological rigor of a study of a therapeutic intervention or a diagnostic test, and learning critical appraisal skills amounts to learning to apply these criteria.
Despite their different histories, the evidence on the effectiveness of both is similar. First, it emerges that teaching such skills is much more difficult than might be imagined. Typical effects amount to a few percent change. Second, like clinical reasoning skills, the evidence strongly suggests that such “skills ”, once learned, are very content-specific and not at all general.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Audet, N., Gagnon, R., Ladouceur, R., & Marcil, M. (1993). L’enseignement de l’ analyse critique des publications scientifiques medicales est-il efficace? Revision des etudes et leur qualite methodologique. [Teaching of critical appraisal of scientific medical publications is it effective? Review of studies and of their methodological quality.]Canadian Medical Association Journal 148945–952.
Barrows, H. S., Norman, G. R., Neufeld, V. R., & Feightner, J. W. (1982). The clinical reasoning of randomly selected physicians in general medical practice.Clinical and Investigative Medicine 549–56.
Bauwens, E. E., & Gerhard, G. G. (1987). The use of the Watson Glaser Critical Thinking Appraisal to predict success in a baccalaureate nursing program.Journal of Nursing Education 26278–281.
Bazarian J. J., Davis, C. O., Spillane, L. L., Blumstein, H.&Schneider, S. M. (1999). Teaching emergency medicine residents evidence-based critical appraisal skills: A controlled trial.Annals of Emergency Medicine 43148–154.
Bennett, K. J., Sackett, D. L., Haynes, R. B., Neufeld, V. R., Tugwell, P., & Roberts, R. S. (1987). A controlled trial of teaching critical appraisal of the clinical literature to medical students.Journal of the American Medical Association257, 2451–2454.
Boreham, N. C. (1994). The dangerous practice of thinking.Medical Education 28172–179.
Bransford, J., Sherwood, R., Vye, N., & Rieser, J. (1986). Teaching thinking and problem-solving: Research foundations.American Psychologist 411078–1089.
Brooks, K. L., & Shepherd, J. M. (1990). The relation between decision making skills in nursing and general critical thinking ability of senior nursing students in four types of nursing programs.Journal of Nursing Education 29391–399.
Brooks, L. R., LeBlanc, V. R., & Norman, G. R. (2000). On the difficulty of noticing obvious features in patient appearance.Psychological Science 11112–118.
Catrambone, R., & Holyoak, K. J. (1989). Overcoming contextual limitations on problem-solving transfer.Journal of Experimental Psychology: Learning Memory & Cognition15, 1147–1156.
Chase, W. C.&Simon, H. A. (1973). Perception in chess.Cognitive Psychology 455–81.
Couto, J. S. (1998). Evidence-based medicine: A Kuhnian perspective of a transvestite non-theory.Journal of Evaluation in Clinical Practice 4267–275.
Cuddy, P. G., Elenbaas. J. K., & Coit, K. J. (1984). The effectiveness of a slide tape program on literature evaluation.Journal of Biocommunication 112–4.
De Groot, A. D. (1965).Thought and choice in chess.The Hague: Mouton.
Eagle C. J., Harasym, P. H., & Mandin, H. (1992). Effects of tutors with case expertise on problem-based learning issues.Academic Medicine 70465–469.
Ellis, J. E., Mulligan, I., Rowe, J., & Sackett, D. L. (1995). In patient general medicine is evidence-based.Lancet 346407–410.
Elstein, A. S., Shulman, L. S.&Sprafka, S. A. (1978).Medical problem solving: an analysis of clinical reasoning.Cambridge: Harvard University Press.
Eva, K. W., Neville, A. J., & Norman, G. R. (1998). Exploring the etiology of content specificity: Factors influencing analogic transfer and problem-solving.Academic Medicine 73Sl-S5.
Evidence Based Medicine Working Group (1992). Evidence-based medicine: A new approach to teaching the practice of medicine.Journal of the American Medical Association 2682420–2425.
Frasca, M. A., Dorsch, J. L., Aldag, J. C., & Christiansen, R. G. (1992). A multidisciplinary approach to information management and critical appraisal instruction: A controlled study.Bulletin of the Medical Library Association 8023–27.
Gehlbach, S. H., Bobula, J. A., & Dickinson, J. C. (1980). Teaching residents to read the literature.Journal of Medical Education 55362–365.
Glaser, R. (1984). Education and thinking: The role of knowledge.American Psychologist39, 93–104.
Green, M. L. (1999). Graduate medical education training in clinical epidemiology, critical appraisal and evidence based medicine: A critical review of curricula.Academic Medicine 74686–694.
Green, M. L., & Ellis, P. J. (1997) Impact of an evidence-based medicine curriculum based on adult learning theory.Journal of General Internal Medicine 12742–750.
Guyatt, G. H., Sinclair, J., Cook, D. J., & Glaxziou, P. (1999). User’s guide to the medical literature XVI: How to use a treatment recommendation.Journal of the American Medical Association 2811836–1843.
Halpern, D. E. (1998). Teaching critical thinking skills for transfer across domains: Dispositions, skills, structure training and metacognitive monitoring.American Psychologist 53449–455.
Heller, R. F., & Peach, H. (1984). Evaluation of a new course to teach the principles and clinical applications of epidemiology to medical students.International Journal of Epidemiology 13533–537.
Herrnstein, R. J., & Murray, C. (1994) The Bell curve: intellligence and class structure in American life. New York: Free Press.
Hodges, B., Regehr, G., McNaughton, N., Tiberius, R., & Hanson, M. (1999). OSCE checklists do not capture increasing levels of expertise.Academic Medicine 741129–1134.
Kitchens, J., & Pfeiffer, M. P. (1989). Teaching residents to read the medical literature: A controlled trial of a curriculum in critical appraisal/clinical epidemiology.Journal of General Internal Medicine 4 385–387.
Landry, F. J., Pangaro, L., Kroenke, K., Lucey, C., & Herbers, J. (1994). A controlled trial of a seminar to improve medical student attitudes toward knowledge about and use of the medical literature.Journal of General Internal Medicine 9436–439.
Langkamp, D. L., Pascoe, J. M., & Nelson, D. B. (1992). The effect of a medical joumal club on residents’ knowledge of clinical epidemiology and biostatistics.Family Medicine 24528–530.
Linzer, M. (1990). Critical appraisal: More work to be done.Journal of General Internal Medicine 5457–459.
Linzer, M. L., Brown, J. T., Frazier, L. M., DeLong, E. R., & Siegel, W. C. (1988). Impact of a medical journal club on house staff reading habits, knowledge and critical appraisal: A randomized controlled trial.Journal of the American Medical Association 2602537–2541.
Linzer, M., DeLong, E. R., & Hupart, K. H. (1987). A comparison of two formats for teaching critical reading skills in a medical journal club.Journal of Medical Education 62690–692.
May, B. A., Edell, V., Butell, S., Doughty, J., & Langford, C. (1999). Critical thinking and clinical competence: A study of their relationship.Journal of Nursing Education 38100–110.
McKibbon, K. A., Haynes, R. B., Walker, C. J., Ramsden, M. F., Ruyan, N. C., Baker, L., Hemming, T., & Fitzgerald, D. (1990) How good are clinical MEDLINE searches? A comparative study of clinical end-user and librarian searches.Computers and Biomedical Research 23583–593.
Miles, A., Bentley, P., Polychromins, A., Grey, J.&Price, N. (1998). Recent progress in health services research: on the need for evidence-based debate.Journal of Evaluation in Clinical Practice 383–86.
Miller, M. A. (1992). Outcomes evaluation: Measuring critical thinking.Journal of Advanced Nursing 171401–1407.
Needham, D. R.&Begg, I. R. (1991). Problem-oriented training promotes spontaneous analogical transfer: memory-oriented training promotes memory for training.Memory & Cognition 19543–557.
Newell, A.&Simon, H. A. (1972).Human problem solving.Englewood Cliffs: Prentice-Hall.
Norman,G. R.&Shannon, S. I. (1998). Effectiveness of instruction in Evidence Based Medicine: A critical appraisal.Canadian Medical Association Journal 158177–184.
Norman, G. R., Brooks, L. R., Colle, C. L., & Hatala, R. M. (2000). Relative effectiveness of instruction in forward and backward reasoning.Cognition and Instruction 17433–448.
Patel, V. L., & Groen, G. J. (1986). Knowledge based solution strategies in medical reasoning.Cognitive Science 1091–116.
Perkins, D. N., & Salomon, G. (1989) Are cognitive skills context-bound?Educational Researcher 1816–25.
Polya, G. (1957).How to solve it: A new aspect of mathematical method.Princeton, NJ: Princeton University Press.
Radack, K. L., & Valanis, B. (1986). Teaching critical appraisal and application of medical literature to clinical problem solving.Journal of Medical Education 61329–331.
Regehr, G., Freeman, R., Robb, A., Missiha, N., & Heisey, R. (1999). OSCE performance evaluations made by standardized patients: comparing checklist and global rating scores.Academic Medicine 74S135–137.
Riegelman, R. K. (1986). Effects of teaching first year medical students skills to read medical literature.Journal of Medical Education 61454–459.
Romm, F. J., Dignan, M., & Hermann, J. M. (1989). Teaching clinical epidemiology: A controlled trial of two methods.Americal Journal of Preventive Medicine 150–51.
Sackett, D. L., & Rosenberg, W. M. C. (1995). The need for evidence based medicine.Journal of the Royal Society of Medicine 88620–624.
Sackett, D. L., Richardson, W. S., Rosenberg, W.&Haynes, R. B. (1997).Evidence-based medicine: how to practice and teach EBM.New York: Churchill-Livingstone.
Saucier, B. L. (1995). Critical thinking skills of baccalaureate nursing students.Journal of Professional Nursing 11351–357.
Schön, D. (1983).The reflective practitioner: how professionals think in action.New York: Basic Books.
Scott, J. N., Markert, R. J., & Dunn, M. M. (1998). Critical thinking: change during medical school and relationship to performance in clinical clerkships.Medical Education 3214–18.
Shin, J., Haynes, R. B., & Johnston, M. E. (1988). Effect of problem-based, self-directed undergraduate education on lifelong learning.Canadian Medical Association Journal 148969–976.
Swanson, D. B., Norman, G. R., & Linn, R. L. (1995). Performance-based assessment: Lessons from the health professions.Educational Researcher 245–11.
Tonelli, M. R. (1998). The philosophical limits of evidence based medicine.Academic Medicine 731234–1240.
Watson, G., & Glaser, E. M. (1980).The Watson—Glaser critical thinking appraisal manual.Princeton: Psychological Corporation.
Acknowledgements
Norman, G. R., & Shannon, S. I. (1998). Effectiveness of instruction in Evidence Based Medicine: A critical appraisal. Reprinted from, by permission of the publisherCanadian Medical Association JournalJanuary 27;158177–184.
Norman, G. R. (1999). Examining the assumptions of evidence-based medicine.Journal of Evaluation in Clinical Practice 5139–147.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Norman, G. (2002). Critical Thinking and Critical Appraisal. In: Norman, G.R., et al. International Handbook of Research in Medical Education. Springer International Handbooks of Education, vol 7. Springer, Dordrecht. https://doi.org/10.1007/978-94-010-0462-6_11
Download citation
DOI: https://doi.org/10.1007/978-94-010-0462-6_11
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-3904-8
Online ISBN: 978-94-010-0462-6
eBook Packages: Springer Book Archive