Skip to main content

Estimation of ROC Curve with Multiple Types of Missing Gold Standard

  • Conference paper
  • First Online:
Applied Statistics in Biomedicine and Clinical Trials Design

Part of the book series: ICSA Book Series in Statistics ((ICSABSS))

  • 1941 Accesses

Abstract

In evaluating the diagnostic accuracy of a test, the gold standard might be missing because of high cost or harmfulness to the patient. The estimation of the diagnostic accuracy could be biased if the missingness is not handled appropriately. In this chapter, we propose a likelihood-based approach to jointly estimate the selection model and disease model when the missing data mechanism is a mixture of ignorable and nonignorable missingness. The receiver operating characteristic (ROC) curve and its area are estimated empirically using imputation and reweighting techniques. The proposed method extends the results of Liu and Zhou (2010, Biometrics, 66, 1119–1128), as the latter assumes a single source of nonignorable missingness. We perform simulation studies to compare the performance of the proposed method and the existing approaches in the literature. This methodology is motivated from and applied to a study in Alzheimer’s disease (AD), where two reasons of missingness are modeled separately.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alonzo TA, Pepe MS (2005) Assessing accuracy of a continuous screening test in the presence of verification bias. Appl Stat 54:173–190

    MATH  MathSciNet  Google Scholar 

  • Baker SG (1995) Evaluating multiple diagnostic tests with partial verification. Biometrics 51:330–337

    Article  MATH  Google Scholar 

  • Begg CB (1987) Biases in assessment of diagnostic tests. Stat Med 6:411–423

    Article  Google Scholar 

  • Begg CB, Greenes RA (1983) Assessment of diagnostic tests when disease verification is subject to verification bias. Biometrics 39:207–215

    Article  MathSciNet  Google Scholar 

  • Harel O, Schafer JL (2009) Partial and latent ignorability in missing-data problems. Biometrika 96:37–50

    Article  MATH  MathSciNet  Google Scholar 

  • Kosinski AS, Barnhart HX (2003) Accounting for nonignorable verification bias in assessment of diagnostic tests. Biometrics 59:163–171

    Article  MATH  MathSciNet  Google Scholar 

  • Liu D, Zhou XH (2010) A model for adjusting for nonignorable verification bias in estimation of ROC curve and its area with likelihood-based approach. Biometrics 66:1119–1128

    Article  MATH  MathSciNet  Google Scholar 

  • Liu D, Zhou XH (2011) Semiparametric estimation of the covariate-specific ROC curve in presence of ignorable verification bias. Biometrics 67:906–916

    Article  MATH  MathSciNet  Google Scholar 

  • Rodenberg CA, Zhou XH (2000) ROC curve estimation when covariates affect the verification process. Biometrics 56:1256–1262

    Article  MATH  MathSciNet  Google Scholar 

  • Rotnitzky A, Faraggi D, Schisterman E (2006) Doubly robust estimation of the area under the receiver-operating characteristic curve in the presence of verification bias. J Am Stat Assoc 101:1276–1288

    Article  MATH  MathSciNet  Google Scholar 

  • Zhou XH (1996) A nonparametric ML estimate of an ROC curve area corrected for verification bias. Biometrics 52:310–316

    Google Scholar 

  • Zhou XH (1998) Comparing correlated areas under the ROC curves of two diagnostic tests in the presence of verification bias. Biometrics 54:349–366

    Article  Google Scholar 

  • Zhou XH, Castelluccio P (2003) Nonparametric analysis for the ROC areas of two diagnostic tests in the presence of nonignorable verification bias. J Stat Plan Inference 115:193–213

    Article  MATH  MathSciNet  Google Scholar 

  • Zhou XH, Castelluccio P (2004) Adjusting for non-ignorable verification bias in clinical studies for Alzheimer’s disease. Stat Med 23:221–230

    Article  Google Scholar 

  • Zhou XH, Rodenberg CA (1998) Estimating an ROC curve in the presence of non-ignorable verification bias. Commun Stat 27:635–657

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Danping Liu .

Editor information

Editors and Affiliations

Acknowledgments

Acknowledgments

The authors would like to thank the referees for their insightful comments, which greatly improved the quality of this chapter. This work was supported in part by NIH/NIA grant U01AG016976. Dr. Danping Liu’s research is supported by the Intramural Research Program of the National Institute of Health (NIH), Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD). This chapter does not necessarily represent the findings and conclusions of VA HSR&D. Dr. Xiao-Hua Zhou is presently a core investigator and biostatistics unit director at HSR&D Center of Excellence, Department of Veterans Affairs Puget Sound Health Care System, Seattle, Washington.

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Liu, D., Zhou, XH. (2015). Estimation of ROC Curve with Multiple Types of Missing Gold Standard. In: Chen, Z., Liu, A., Qu, Y., Tang, L., Ting, N., Tsong, Y. (eds) Applied Statistics in Biomedicine and Clinical Trials Design. ICSA Book Series in Statistics. Springer, Cham. https://doi.org/10.1007/978-3-319-12694-4_5

Download citation

Publish with us

Policies and ethics