Abstract
In this chapter, we consider how medical images may be evaluated in terms of the information they provide to human observers. Much of this book discusses what is known about the registration and interpretation of visual data within the human visual system. This knowledge, the product of a large psychophysical and neurophysiological literature, is fundamental to any attempt to characterize imagery: it specifies the dimensions, properties, and aspects of images that are informative. An understanding of visual perception should educate our attempts to characterize images by means of physical measurements. Beyond this, the psychophysical literature provides a family of methodologies for assessing diagnostic performance of imaging systems in which human observers serve as pattern recognizers. Psychophysical methods assess psychological response to variation in physical stimuli. These procedures can be applied even where little is known about the underlying recognition process itself or where the physics of the imaging process is not well understood. The best known and most widely used psychophysical method in medical imaging research generates receiver operating characteristic (ROC) curves. The second part of this chapter is devoted to an introduction to current use of these methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hunt E.B. Artificial Intelligence. New York: Academic; 1985.
Minsky M. Steps toward artificial intelligence. Proc. IRE 1961; 49: 8–30.
Chan F.H., Pizer S.M. An ultrasonogram display system using a natural color scale. J. Clin. Ultrasound 1976; 4: 335–338.
Pizer S.M., Zimmerman J.B. Color display in ultrasonography. Ultrasound Med. Biol. 1983; 9: 331–345.
Katsuragawa S., Doi K., MacMahon H. Image feature analysis and computer-aided diagnosis in digital radiology: Detection and characterization of interstitial lung disease in digital chest radiographs. Med. Phys. 1988; 15: 311–319.
Katsuragawa S., Doi K., MacMahon H. Image feature analysis and computer-aided diagnosis in digital radiology: Classification of normal and abnormal lungs with interstitial disease in chest images. Med. Phys. 1989; 16: 38–44.
Powell G., Doi K., Katsuragawa S. Localization of interrib spaces for lung texture analysis and computer-aided diagnosis in digital images. Med. Phys. 1988; 15: 581–587.
Biederman I. Recognition by components: A theory of human image understanding. Psychol. Rev. 1987; 94: 115–147.
Berbaum K.S., Franken E.A., Honda H., McGuire C., Weis R.R., Barloon T. Evaluation of a PACS workstation for interpreting body CT studies. J. Comput. Asst. Tomog. 1990; 14: 853–858.
Berbaum K.S., Smoker W.R.K., Smith W.L. Measurement and prediction of diagnostic performance during radiology training. Am. J. Roentg. 1985; 145: 1305–1311.
Rogers D., Johnston R., Brenton B., Staab E., Thompson B., Perry J. Predicting PACS console requirements from radiologists’ reading habits. Proc. SPIE 1985; 536: 88–96.
Rogers D., Johnston R., Hemminger B., Pizer S. Development of and experience with a prototype medical image display. Presented at the Far West Image Perception Conference, Department of Radiology, University of New Mexico, 1986.
Pizer S.M., Johnston R.E., Rogers R.C., Beard D.V. Effective presentation of medical images on an electronic display station. Radiographics 1987; 7: 1267 1274.
Carmody D.P., Nodine C.F., Kundel H.L. Finding lung nodules with and with- out comparative visual scanning. Percept. Psychophys..1981; 29: 594–598.
Franken E.A., Berbaum K.S. Perceptual aspects of cardiac imaging. In: Marcus M.L., Schelbert H.R., Skorton D.J., Wolf G., eds. Cardiac Imaging-Principles and Practice: A Companion to Braunwald’s Heart Disease. Philadelphia: Sanders; 1991: 87–92.
Green D.M., Swets J.A. Signal Detection Theory and Psychophysics. New York: Wiley; 1966.
Wagner R.F., Brown D.G. Unified SNR analysis of medical imaging systems. Phys. Med. Biol. 1985; 30: 498–518.
Rose A. Vision, Human and Electronic. New York: Plenum; 1973.
Wagner R.F. Toward a unified view of radiological imaging systems. Part II. Noisy images. Med. Phys. 1977; 4: 279–296.
Schnitzler A.D. Analysis of noise required contrast and modulation in image detecting and display systems. In: Biberman L.C., ed. Perception of Displayed Information. New York: Plenum; 1973: 119–166.
Giger M.L., Doi K. Investigation of basic imaging properties in digital radiography. 3. Effect of pixel size on SNR and threshold contrast. Med. Phys. 1985; 12: 201–208.
Ohara K., Doi K., Metz C.E., Giger M.L. Investigation of basic imaging properties in digital radiography. 13. Effect of simple structured noise on the detectibility of simulated stenotic lesions. Med. Phys. 1989; 16: 14–21.
Giger M.L., Doi K. Investigation of basic imaging properties in digital radiography. 1. Modulation transfer function. Med. Phys. 1984; 11: 287–293.
Dainty J.C., Shaw R. Image Science. New York: Academic; 1974.
Schade O. Optical and photoelectric analog of the eye. J. Opt. Soc. Am. 1956; 46: 721–739.
Morgan R.H. Threshold visual perception and its relationship to photon fluctuations and sine-wave response. Am. J. Roentg. 1965; 93: 982–997.
Sorenson J.A., Phelps M.E. Physics in Nuclear Medicine ( 2nd ed. ). New York: Grune and Stratton; 1987: 115–142.
Kijewski M.F., Judy P.F. The noise power spectrum of CT images. Phys. Med. Biol. 1987; 32: 565–575.
Moore S.C., Kijewski M.F., Mueller S.P., Holman B.L. SPECT image noise power: Effects of nonstationary projection noise and attenuation compensation. J. Nucl. Med. 1988; 29: 1704–1709.
Giger M.L., Doi K., Metz C.E. Investigation of basic imaging properties in digital radiography. 2. Noise Wiener spectrum. Med. Phys. 1984; 11: 797–805.
Bracewell R.N. The Fourier Transform and its Applications ( 2nd ed. ). New York: McGraw-Hill; 1978.
Riederer S.J., Pelc N.J., Chesler D.A. The noise power spectrum in computed X-ray tomography. Phys. Med. Biol. 1978; 23: 446–454.
Sandrik J.M., Wagner R.F. Absolute measures of physical image quality: Measurement and application to radiographic magnification. Med. Phys. 1982; 9: 540–549.
Wagner R.F., Brown D.G., Pastel M.S. Application of information theory to the assessment of computed tomography. Med. Phys. 1979; 6: 83–94.
Hanson K.M. Detectibility in computed tomogiaphic images. Med. Phys. 1979; 6: 441–451.
Judy P., Swensson R.G., Szulc M. Lesion detection and signal-to-noise ratio in CT images. Med. Phys. 1981; 8: 13–23.
Cohen G. Contrast detail analysis of imaging systems: Caveats and kudos. In: Doi K., Lanzl L., Lin P.J., eds. Recent Developments in Digital Imaging (AAPM Medical Physics Monograph 12 ). New York: American Institute of Physics; 1985: 141–159.
Cohen G., McDaniel D.L., Wagner L.K. Analysis of variations in contrast detail experiments. Med. Phys. 1984; 11: 469–473.
Wald A. Statistical Decision Functions. New York: Wiley; 1950.
Peterson W.W., Birdsall T.G., Fox W.C. The theory of signal detectibility. Trans. IRE Prof. Grp. Inform. Theory 1965; PGIT-4: 171–212.
Tanner W.P., Swets J.A. A decision-making theory of visual detection. Psycho!. Rev. 1954; 61: 401–409.
McNicol D. A Primer of Signal Detection Theory. London: Allen and Unwin; 1972.
Gescheider G.A. Psychophysics: Method, Theory, and Application ( 2nd ed. ). Hillsdale: Erlbaum; 1985: 135–166.
Hanley J.A., McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29–36.
Hanley J.A., McNeil B.J. A method of comparing receiver operating characteristic curves derived from the same cases. Radiology 1983; 148: 839–843.
Kundel H.L., Revesz G. The evaluation of radiographic techniques by observer tests: Problems, pitfalls, and procedures. Invest. Radio!. 1974; 9: 166–173.
Lusted L.B. General problems in medical decision making, with comments on ROC analysis. Semin. Nucl. Med. 1978; 8: 299–306.
McNeil B.J., Keeler E., Adelstein S.J. Primer on certain elements of medical decision making. N. Engl. J. Med. 1975; 293: 211–215.
McNeil B.J., Hanley J.A. Statistical approaches to the analysis of receiver operating characteristics (ROC) curves. Med. Decis. Making 1984; 4: 137–150.
McNeil B.J., Hanley J.A., Funkenstein H.H., Wallman J. Paired receiver operating characteristic curves and the effect of history on radiographic interpretation: CT of the head as a case study. Radiology 1983; 149: 75–77.
Metz C.E. Basic principles of ROC analysis. Semin. Nucl. Med. 1978; 8: 283–298.
Metz C.E. ROC methodology in radiographic imaging. Invest. Radio!. 1986; 21: 720–733.
Swets J.A. ROC analysis applied to the evaluation of medical imaging techniques. Invest. Radio!. 1979; 14: 109–121.
Swets J.A. Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psycho!. Bull. 1986; 99: 100–117.
Swets J.A. Form of empirical ROCs in discrimination and diagnostic tasks: Implications for theory and measurement of performance. Psycho!. Bull. 1986; 99: 181–198.
Swets J.A., Pickett R.M. Evaluation of Diagnostic Systems: Methods from Signal Detection Theory. New York: Academic; 1982.
Metz C.E. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest. Radio!. 1989; 24: 234–245.
Swets J.A. Is there a sensory threshold? Science 1961; 134: 168–177.
Dorfman D.D., Alf E. Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals-Rating method data. J. Math. Psycho!. 1969; 6: 487–496.
Yerushalmy J. The statistical assessment of the variability in observer perception. Radio!. Clin. N. Am. 1969; 7: 381–392.
Revesz G., Kundel H.L., Bonitatibus M. The effect of verification on the assessment of imaging techniques. Invest. Radio!. 1983; 18: 194–198.
Ker M., Seeley G.W., Stempski M.O., Patton D. A protocol for verifying truth of diagnosis. Invest. Radiol. 1988; 23: 485–487.
Kundel H.L., Revesz G. The evaluation of radiographic techniques by observer tests: Problems, pitfalls, and procedures. Invest. Radio!. 1974; 9: 166–172.
Ransoholf D.F., Feinstein A.R. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N. Engl. J. Med. 1978; 299: 926–930.
Metz C.E., Kronman H.B. Statistical significance tests for binormal ROC curves. J. Math. Psycho!. 1980; 22: 218–243.
Metz C.E., Wang P.-L., Kronman H.B. A new approach for testing the significance of differences between ROC curves measured from correlated data. In: Deconink F., ed. Information Processing in Medical Imaging. The Hague: Nijhoff; 1984: 432–445.
Metz C.E. Statistical analysis of ROC data in evaluating diagnostic performance. In: Herbert D., Myers R., eds. Multiple Regression Analysis: Applications in the Health Sciences. New York: American Institute of Physics; 1986: 365–384.
Berbaum K.S., Franken E.A., Dorfman D.D., Barloon T.J., Ell S.R., Lu C.H., Smith W.L., Abu-Yousef M.M. Tentative diagnoses facilitate the detection of diverse lesions in chest radiographs. Invest Radio!. 1986; 21: 532–539.
Berbaum K.S., Franken E.A., Dorfman D.D., Barloon T.J. Influence of clinical history upon detection of nodules and other lesions. Invest. Radio!. 1988; 23: 48–55.
Hanley J.A. Alternative approaches to receiver operating characteristic analysis. Radiology 1988; 168: 568–570.
Berbaum K.S., El Khoury G.E., Franken E.A., Kathol M.C., Montgomery W.J., Hesson W. The impact of clinical history on detection of fractures. Radiology 1988; 168: 507–511.
Dorfman D.D. RSCORE II. In: Swets J.A., Pickett R.M., Evaluation of Diagnostic Systems: Methods from Signal Detection Theory. New York: Academic; 1982: 212–232.
Metz C.E. Some practical uses of experimental design and data analysis in radiographic ROC studies. Invest. Radio!. 1989; 24: 234–235.
Rey W.J.J. Introduction to Robust and Quasi-Robust Statistical Methods. New York: Springer; 1983.
Arvesen J.N., Salsburg D.S. Approximate tests and confidence intervals using the jackknife. In: Elashoff R.M., ed. Perspectives in Biometrics. New York: Academic; 1975: 123–147.
Tukey J.W. Bias and confidence in not quite large samples. Ann. Math. Stat. 1958; 29: 614. Abstract.
Tukey J.W. Analyzing data: Sanctification or detective work ? Am. Psychol. 1969; 24: 83–91.
Winer B.J. Statistical Principles in Experimental Design. New York: McGraw-Hill; 1971.
Dorfman D.D., Berbaum K.S. RSCORE-J: Pooled rating method data: A computer program for analyzing pooled ROC curves. Behay. Res. Methods Instrum. Comput. 1986; 18: 452–462.
Getty D.J., Pickett R.M., D’Orsi C.J., Swets J.A. Enhanced interpretation of diagnostic images. Invest. Radio!. 1988; 23: 240–252.
Berbaum K.S., Franken E.A., Dorfman D.D., Rooholamini S.A., Kathol M.H., Barloon T.J., Behlke F.M., Sato Y., Lu C.H., El-Khoury G.Y., Flickinger F.W., Montgomery W.J. Satisfaction of search in diagnostic radiology. Invest. Radio!. 1990; 25: 133–140.
Berbaum K.S., Franken E.A., Dorfman D.D., Rooholamini S., Coffman C.E., Cornell S.H., Cragg A.H., Galvin J.R., Honda H.H., Kao S.C.S., Kimball D.A., Ryals T.J., Sickels W.J., Smith A.P. Time course of satisfaction of search. Invest. Radiol. 1991; 26: 640–648.
Chakraboraty D.P., Winter L.H.L. Free response methodology: Alternative analysis and a new observer performance experiment. Radiology 1990; 174: 873–881.
Bunch P.C., Hamilton J.F., Sanderson G.K., Simmons A.H. A free response approach to the measurement and characterization of radiographic observer performance. Proc. SPIE 1977; 127: 124–135.
Metz C.E., Starr S.J., Lusted L.B. Observer performance in detecting multiple radiographic signals. Radiology 1976; 121: 337–347.
Starr S.J., Metz C.E., Lusted L.B., Goodenough D.J. Visual detection and localization of radiographic images. Radiology 1975; 116: 533–538.
Swets J.A., Pickett R.M., Whitehead S.F., Getty D.J., Schnur J.A., Swets J.B.,Freeman B.A. Assessment of diagnostic technologies. Science 1979; 205: 753–759.
Berbaum K.S., Dorfman D.D., Franken E.A. Measuring observer performance by ROC analysis: Implications and complications. Invest. Radio!. 1989; 24: 228–233.
Turing A.M. On computable numbers, with an application to the Entscheidungs-problem. Proc. London Math. Soc. (Ser. 2) 1990; 42: 230–265.
Turing A.M. Computing machinery and intelligence. Mind 1950; 59: 433–460.
Von Neumann J. The general and logical theory of automata. In: Newman J.R.,ed. The World of Mathematics (Vol. 4 ). New York: Simon and Schuster; 1956: 2070–2098.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1993 Springer Science+Business Media New York
About this chapter
Cite this chapter
Berbaum, K.S., Madsen, M., Dorfman, D.D. (1993). Physical and Psychophysical Measurement of Images. In: Hendee, W.R., Wells, P.N.T. (eds) The Perception of Visual Information. Springer, New York, NY. https://doi.org/10.1007/978-1-4757-6769-8_9
Download citation
DOI: https://doi.org/10.1007/978-1-4757-6769-8_9
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4757-6771-1
Online ISBN: 978-1-4757-6769-8
eBook Packages: Springer Book Archive