Abstract
The AUC (area under ROC curve) is a commonly used metric to assess discrimination of risk prediction rules; however, standard errors of AUC are usually based on the Mann-Whitney U test that assumes independence of sampling units. For ophthalmologic applications, it is desirable to assess risk prediction rules based on eye-specific outcome variables which are generally highly, but not perfectly correlated in fellow eyes [e.g. progression of individual eyes to age-related macular degeneration (AMD)]. In this article, we use the extended Mann-Whitney U test (Rosner and Glynn, Biometrics 65:188–197, 2009) for the case where subunits within a cluster may have different progression status and assess discrimination of different prediction rules in this setting. Both data analyses based on progression of AMD and simulation studies show reasonable accuracy of this extended Mann-Whitney U test to assess discrimination of eye-specific risk prediction rules.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
The paper appeared in volume 19 (2013) of Lifetime Data Analysis.
References
Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (roc) curve. Diagn. Radiol. 143, 29–36 (1982)
Hodges, J.L., Jr., Lehmann, E.L.: The efficiency of some nonparametric competitors of the t test. Ann. Math. Stat. 27, 324–335 (1956)
Kendall, M.G., Stuart, A.: The Advanced Theory of Statistics. Hafner, New York (1969)
Li, G., Zhou, K.: A unified approach to nonparametric comparison of receiver operating characteristic curves for longitudinal and clustered data. J. Am. Stat. Assoc. 103(482), 705–713 (2008)
National Eye Institute.: Age-related macular degeneration. http://www.nei.nih.gov/health/maculardegen/armd_facts.asp (2011). Retrieved on Mar 2011
Obuchowski, N.A.: Receiver operating characteristic curves and their use in radiology. Radiology 229, 3–8 (2003)
Obuchowski, N.A., McClish, D.K.: Sample size determination for diagnostic accuracy studies involving binormal roc curve indices. Stat. Med. 16(13), 1529–1542 (1997)
Pencina, M.J., D’Agostino, R.B. Sr., D’Agostino, R.B. Jr., Vasan, R.S.: Evaluating the added predictive ability of a new marker: from area under the roc curve to reclassification and beyond. Stat. Med. 27, 157–172 (2008)
Rosner, B., Glynn, R.J.: Power and sample size estimation for the wilcoxon rank sum test with application to comparisons of c statistics from alternative prediction models. Biometrics 65, 188–197 (2009)
Rosner, B., Glynn, R.J., Lee, M.T.: Extension of the rank sum test for clustered data: two-group comparisons with group membership defined at the subunit level. Biometrics 62, 1251–1259 (2006)
Rubin, D.B.: Multiple Imputation for Non-response in Surveys. Wiley, New York (1987)
Seddon, J.M., Cote, J., Rosner, B.: Progression of age-related macular degeneration. Arch. Ophthalmol. 121, 1728–1737 (2003)
Toledano, A.Y., Gatsonis, C.A.: GEEs for ordinal categorical data: arbitrary patterns of missing responses and missingness in a key covariate. Biometrics 55, 488–496 (1996)
Zou, K.H., O’Malley, A.J., Mauri, L.: Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation 115, 654–657 (2007)
Acknowledgements
This work was supported by the National Institutes of Health Grant EY12269 from the National Eye Institute.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this paper
Cite this paper
Rosner, B., Qiu, W., Lee, ML.T. (2013). Assessing Discrimination of Risk Prediction Rules in a Clustered Data Setting. In: Lee, ML., Gail, M., Pfeiffer, R., Satten, G., Cai, T., Gandy, A. (eds) Risk Assessment and Evaluation of Predictions. Lecture Notes in Statistics, vol 215. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8981-8_10
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8981-8_10
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8980-1
Online ISBN: 978-1-4614-8981-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)