Abstract
This chapter applies the theoretical material of Chapter 5 to actual practice. In Chapter 5 we introduced theories of measurement that were, in effect, theories of error. In this chapter we address specific procedures for estimating and minimizing error. We discuss the structure of measurement studies, the mechanics of conducting them, and how to use the results of these studies to improve measurement techniques. We consider how to develop measurement methods that yield results that are acceptably reliable and valid. We discuss in detail three specific situations that arise frequently in informatics: first, when the repeated observations in a measurement process are tasks completed by either persons or information resources; second, when the repeated observations are the opinions of judges about clinical cases; and third, when the repeated observations are items or questions on forms. Although the same overall measurement issues apply in all three instances, there are issues of implementation and technique specific to each.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Issac S, Michael WB: Handbook in Research and Evaluation. San Diego: EdITS Publishers, 1989.
Cureton EE, D’Agostino RB: Factor Analysis, an Applied Approach. Hillsdale, NJ: Lawrence Erlbaum, 1983.
Kim J, Mueller CW: Factor Analysis: Statistical Methods and Practical Issues. Beverly Hills, CA: Sage, 1978.
Brennan RL.: Elements of Generalizability Theory. Iowa City: American College Testing Program, 1983.
Anderson JG, Jay SJ, Schweer HM, et al: Why doctors don’t use computers: some empirical findings. JR Soc Med 1986;79:142–144.
Brown SH, Coney RD: Changes in computer anxiety and attitudes related to clinical information system use. J Am Med Inf Assoc 1994; 1: 381–394.
Elstein AS, Shulman LS, Sprafka SA: Medical Problem Solving. Cambridge, MA: Harvard University Press, 1978.
Schmidt HG, Norman GR, Boshuizen HPA: A cognitive perspective on medical expertise: theory and implications. Acad Med 1990;65:611–621.
Stillman P, Swanson D, Regan MB, et al: Assessment of clinical skills of residents using standardized patients. Ann Intern Med 1991;114:393–401.
Swets JA: Measuring the accuracy of diagnostic systems. Science 1998;240:1285–1293.
Jain R: The Art of Computer Systems Performance Analysis. New York: Wiley, 1991.
Friedman CP: Anatomy of the clinical simulation. Acad Med 1995;70: 205–208.
Berk RA (ed): Performance Assessment: Methods and Applications. Baltimore: Johns Hopkins Press, 1986.
Murphy KR, Cleveland JN: Understanding Performance Appraisal: Social, Organizational, and Goal-Based Perspectives. Thousand Oaks, CA: Sage, 1995.
Guilford JP: Psychometric Methods. New York: McGraw-Hill, 1954.
Thorndike RL, Hagen E: Measurement and Evaluation in Psychology and Education. New York: Wiley, 1977.
Wyatt J: A method for developing medical decision-aids applied to ACORN, a chest pain advisor. DM thesis, Oxford University, 1991.
Clarke JR, Webber BL, Gertner A, Rymon. KJ: On-line decision support for emergency trauma management. Proc Symp Comput Applications Med Care 1994; 18:1028.
Landy FJ, Farr JL: Performance rating. Psychol Bull 1980;87:72–107.
Detmer WM, Friedman CP: Academic physicians’ assessment of the effects of computers on health care. Proc Symp Comput Applications Med Care 1994;18:558–62.
Miller GA: The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 1956;63:46–49.
Quaglini S, Stefanelli M, Barosi G, Berzuini A: A performance evaluation of the expert system ANAEMIA. Comp Biomed Res 1987;21:307–323.
Yu VL, Fagan LM, Wraith SM, et al: Antimicrobial selection by computer: a blinded evaluation by infectious disease experts. JAMA 1979;242:1279–1282.
Delbecq AE: Group Techniques for Program Panning: A Guide to Nominal Group and Delphi Processes. New York: Scott, Foresman, 1975.
Kors JA, Sittig A, van Bemmel JH: The Delphi method used to validate diagnostic knowledge in a computerised ECG interpreter. Methods Inf Med 1990;29:44–50.
Shavelson RJ, Webb NM, Rowley GL: Generalizability theory. Am Psychol 1989;44:922–932.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1997 Springer Science+Business Media New York
About this chapter
Cite this chapter
Friedman, C.P., Wyatt, J.C. (1997). Developing Measurement Technique. In: Evaluation Methods in Medical Informatics. Computers and Medicine. Springer, New York, NY. https://doi.org/10.1007/978-1-4757-2685-5_6
Download citation
DOI: https://doi.org/10.1007/978-1-4757-2685-5_6
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4757-2687-9
Online ISBN: 978-1-4757-2685-5
eBook Packages: Springer Book Archive