Abstract
The scientific area of radiology of the Higher School of Health Technology of Lisbon, conducted an experimental study with the goal of investigating the influence of the tube potential (kV) on the detection of simulate chest lesions in a chest phantom. Exposure parameters influence the quality and quantity of a X-ray beam and consequently image quality, therefore influencing the observer capacity to detect lesions. To produce images with high quality, readers’ performances were compared as well as the accuracy of lesions detection associated with different tube potential and ROC (receiver operating characteristic) methodology was used to select the best ones. The proper binormal ROC curve model was used to select the reader with best performance. However, the conventional ROC curve is not adequate to select the best tube potential, because the evaluation of the images also depends on the reader’s interpretation. So, the MRMC (multiple readers multiple cases) ROC curves were proposed and, for their estimation, Dorfman–Berbaum–Metz method was used. All calculations were performed on the PROPROC, DBM-MRMC 2.2 and R free softwares.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beiden, S.V., Wagner R.F., Campbell, G.: Components-of-variance models and multiple-bootstrap experiments: an alternative method for random-effects, receiver operating characteristic analysis. Acad. Radiol. 7, 341–349 (2000)
Dorfman, D.D., Berbaum, K.S., Metz, C.E.: Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. Invest. Radiol. 27, 723–731 (1992)
Hillis, S.L.: Monte Carlo validation of the Dorfman-Berbaum-Metz method using normalized pseudovalues and less data-based model simplification. Acad. Radiol. 12, 1534–1541 (2005)
Hillis, S.L.: A comparison of denominator degrees of freedom for multiple observer ROC analysis. Stat. Med. 26, 596–619 (2007)
Hillis, S.L., Berbaum, K.S.: Power estimation for the Dorfman-Berbaum-Metz method. Acad. Radiol. 11, 1260–1273 (2004)
Hillis, S.L., Obuchowski, N.A., Schartz, K.M., Berbaum, K.S.: A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Stat. Med. 24, 1579–1607 (2005)
Ishawaran, H., Gatsonis, C.A.: A general class of hierarchical ordinal regression models with applications to correlated ROC analysis. Can. J. Stat. 28, 731–750 (2000)
Kimme-Smith, C., Aberle, D.R., Sayre, J.W., Hart, E.M., Greaves, S.M., Brown, K., Young, D.A., Deseran, M.D., Johnson, T., Johnson, S.L.: Effects of reduced exposure on computed radiography: comparison of nodule detection accuracy with conventional and asymmetric screen-film radiographs of a chest phantom. Am. J. Roentgenol. 165, 269–273 (1995)
Lança, L., Silva, A., Alves, E., Serranheira, F., Correia, M.: Evaluation of Exposure Parameters in Plain Radiography: A Comparative Study with European Guidelines. Radiat. Prot. Dosim. (2007) doi:10.1093/rpd/ncn144
Lança, L., Silva, R., Marques, G., Silva-Fortes, C.: The influence of the tube potential (kV) on the detection of simulated chest lesions in a CR system. Eur. Radiol. 19(S1):S292 (2009)
McEntee, M.F., Brennan, P.C., Connor, G.O.: The effect of X-ray tube potential on the image quality of PA chest radiographs when using digital image acquisition devices. Radiography 10, 287–292 (2004)
Metz, C.E., Herman, B.A., Shen, J.H.: Maximum likelihood estimation of receiver operating characteristic (roc) curves from continuously-distributed data. Stat. Med. 17, 1033–1053 (1998)
Metz, C.E., Pan, X.: Proper binormal ROC curves: Theory and maximum-likelihood estimation. J. Math. Psycho. 43, 1–33 (1999)
Obuchowski, N.A., Rockette, H.E.: Hypothesis testing of the diagnostic accuracy for multiple diagnostic tests: an ANOVA approach with dependent observations. Commun. Stat. Simulat. 24, 285–308 (1995)
Obuchowski, N.A., Beiden, S., Berbaum, K.S., Hillis, S.L., Ishwaran, H., Song, H.H., Wagner, R.F.: Multireader, multicase receiver operating characteristic analysis. Acad. Radiol. 11, 980–995 (2004)
Roe, C.A., Metz, C.E.: Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: Validation with computer simulation. Acad. Radiol. 4, 298–303 (1997)
Roe, C.A., Metz, C.E.: Variance-component modeling of receiver operating characteristic index estimates. Acad. Radiol. 4, 587–600 (1997)
Song, H.H.: Analysis of correlated ROC area in diagnostic testing. Biometrics 53, 370–382 (1997)
Sweets, J.A.: ROC curve analysis applied to the evaluation of medical imaging techniques. Invest. Radiol. 14, 109–121 (1979)
Sweets, J.A.: Measuring the accuracy of diagnostic systems. Science 240, 1285–1293 (1988)
http://perception.radiology.uiowa.edu. Cited 1 Set 2009
http://xray.bsd.uchicago.edu/krl. Cited 1 Set 2009
Acknowledgements
Research was partially sponsored by national funds through the Fundação Nacional para a Ciência e Tecnologia, Portugal FCT under the project (PEst- OE/MAT/UI0006/2011), and by the FCT PhD scholarship SFRH/BD/45938/2008. The authors wish to thank an anonymous referee for all valuable suggestions on this manuscript.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Silva-Fortes, C., Turkman, M.A.A., Lança, L., Silva, R., Marques, G. (2013). An Application of MRMC ROC Curves on Radiology. In: Lita da Silva, J., Caeiro, F., Natário, I., Braumann, C. (eds) Advances in Regression, Survival Analysis, Extreme Values, Markov Processes and Other Statistical Applications. Studies in Theoretical and Applied Statistics(). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34904-1_47
Download citation
DOI: https://doi.org/10.1007/978-3-642-34904-1_47
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34903-4
Online ISBN: 978-3-642-34904-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)