Skip to main content

Assessing Diagnostic Tests

  • Chapter
  • First Online:
Introduction to Statistical Methods in Pathology

Abstract

Pathologists need to assess diagnostic tests and to decide whether to incorporate a test into their practice and decision-making process. This requires them to understand and interpret the technical and clinical characteristics of the tests. The technical utility of tests is dependent on their technical accuracy and precision which are determined by identifying and quantifying measurement error. Clinical utility of diagnostic tests is dependent on the ability of the test to correctly distinguish diseased state from the unaffected state; the clinical accuracy is defined using terms such as sensitivity and specificity.

However, knowing the accuracy of a test is not enough for complete assessment of that test; pathologists should also consider clinical applicability by answering questions such as “Do my patients benefit from this test?” Furthermore, they should consider the financial burden of the test on the laboratory using tools such as cost-effectiveness analysis.

In this chapter, we provide a framework for assessment of diagnostic tests and using a stepwise approach explain the issues of test accuracy and applicability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. McPherson RA, Pincus MR. Henry’s clinical diagnosis and management by laboratory methods. Elsevier Health Sciences: USA; 2016.

    Google Scholar 

  2. Crook M. Clinical governance and pathology. J Clin Pathol. 2002;55(3):177–9.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Van den Bruel A, Cleemput I, Aertgeerts B, Ramaekers D, Buntinx F. The evaluation of diagnostic tests: evidence on technical and diagnostic accuracy, impact on patient outcome and cost-effectiveness is needed. J Clin Epidemiol. 2007;60(11):1116–22.

    Article  PubMed  Google Scholar 

  4. Garfield S, Polisena J, Spinner DS, Postulka A, Lu CY, Tiwana SK, Faulkner E, Poulios N, Zah V, Longacre M. Health technology assessment for molecular diagnostics: practices, challenges, and recommendations from the medical devices and diagnostics Special Interest Group. Value Health. 2016;19(5):577–87.

    Article  PubMed  Google Scholar 

  5. Koffijberg H, van Zaane B, Moons KG. From accuracy to patient outcome and cost-effectiveness evaluations of diagnostic tests and biomarkers: an exemplary modelling study. BMC Med Res Methodol. 2013;13(1):12.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Knottnerus JA, van Weel C, Muris JW. Evaluation of diagnostic procedures. Br Med J. 2002;324(7335):477.

    Article  Google Scholar 

  7. Banoo S, Bell D, Bossuyt P, Herring A, Mabey D, Poole F, Smith PG, Sriram N, Wongsrichanalai C, Linke R, O'brien R. Evaluation of diagnostic tests for infectious diseases: general principles. Nat Rev Microbiol. 2008;8:S16–28.

    Article  Google Scholar 

  8. Swets JA. Measuring the accuracy of diagnostic systems. Science. 1988;240(4857):1285.

    Article  CAS  PubMed  Google Scholar 

  9. Bonini P, Plebani M, Ceriotti F, Rubboli F. Errors in laboratory medicine. Clin Chem. 2002;48(5):691–8.

    CAS  PubMed  Google Scholar 

  10. Acken JM, Millman SD. Fault model evolution for diagnosis: accuracy vs. precision. In: Proceedings of the custom integrated circuits conference; 1992. p. 13–4.

    Google Scholar 

  11. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Moher D, Rennie D, De Vet HC, Lijmer JG. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem. 2003;49(1):7–18.

    Article  CAS  PubMed  Google Scholar 

  12. Jennings L, Van Deerlin VM, Gulley ML. Recommended principles and practices for validating clinical molecular pathology tests. Arch Pathol Lab Med. 2009;133(5):743–55.

    PubMed  Google Scholar 

  13. Šimundić AM. Measures of diagnostic accuracy: basic definitions. EJIFCC. 2009;19(4):203.

    PubMed  PubMed Central  Google Scholar 

  14. Yuoh C, Elghetany MT, Petersen JR, Mohammad A, Okorodudu AO. Accuracy and precision of point-of-care testing for glucose and prothrombin time at the critical care units. Clin Chim Acta. 2001;307(1):119–23.

    Article  CAS  PubMed  Google Scholar 

  15. Sirota RL. Error and error reduction in pathology. Arch Pathol Lab Med. 2005;129(10):1228–33.

    PubMed  Google Scholar 

  16. Zarbo RJ, Meier FA, Raab SS. Error detection in anatomic pathology. Arch Pathol Lab Med. 2005;129(10):1237–45.

    PubMed  Google Scholar 

  17. Plebani M. The detection and prevention of errors in laboratory medicine. Ann Clin Biochem. 2010;47(2):101–10.

    Article  PubMed  Google Scholar 

  18. Bossuyt PM, Irwig L, Craig J, Glasziou P. Diagnosis: comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ. 2006;6:1089–92.

    Article  Google Scholar 

  19. Apple FS, Jesse RL, Newby LK, Wu AH, Christenson RH. National Academy of Clinical Biochemistry and IFCC Committee for Standardization of Markers of Cardiac Damage Laboratory Medicine Practice Guidelines: analytical issues for biochemical markers of acute coronary syndromes. Circulation. 2007;115(13):e352–5.

    Article  PubMed  Google Scholar 

  20. Katayev A, Balciza C, Seccombe DW. Establishing reference intervals for clinical laboratory test results. Am J Clin Pathol. 2010;133(2):180–6.

    Article  CAS  PubMed  Google Scholar 

  21. Bellera CA, Hanley JA. A method is presented to plan the required sample size when estimating regression-based reference limits. J Clin Epidemiol. 2007;60(6):610–5.

    Article  PubMed  Google Scholar 

  22. Tosteson AN, Begg CB. A general regression methodology for ROC curve estimation. Med Decis Making. 1988;8(3):204–15.

    Article  CAS  PubMed  Google Scholar 

  23. Hajian-Tilaki K. Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Caspian J Intern Med. 2013;4(2):627.

    PubMed  PubMed Central  Google Scholar 

  24. Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, Bakken S, Kaplan CP, Squiers L, Fabrizio C, Fernandez M. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Trikalinos TA, Siebert U, Lau J. Decision-analytic modeling to evaluate benefits and harms of medical tests: uses and limitations. Med Decis Making. 2009;29(5):E22–9.

    Article  PubMed  Google Scholar 

  26. Siegel JE, Weinstein MC, Russell LB, Gold MR. Recommendations for reporting cost-effectiveness analyses. JAMA. 1996;276(16):1339–41.

    Article  CAS  PubMed  Google Scholar 

  27. Mushlin AI, Ruchlin HS, Callahan MA. Costeffectiveness of diagnostic tests. Lancet. 2001;358(9290):1353–5.

    Article  CAS  PubMed  Google Scholar 

  28. Brunstein J. Cost-effectiveness considerations with molecular diagnostics in oncology. MLO Med Lab Obs. 2016;48(5):30.

    Google Scholar 

  29. Gray AM, Clarke PM, Wolstenholme JL, Wordsworth S. Applied methods of cost-effectiveness analysis in healthcare. Oxford: OUP; 2010.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Cite this chapter

Momeni, A., Pincus, M., Libien, J. (2018). Assessing Diagnostic Tests. In: Introduction to Statistical Methods in Pathology . Springer, Cham. https://doi.org/10.1007/978-3-319-60543-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60543-2_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60542-5

  • Online ISBN: 978-3-319-60543-2

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics