Skip to main content

Statistical Power and Sample Size: Some Fundamentals for Clinician Researchers

  • Chapter
  • First Online:
Essentials of Clinical Research
  • 4668 Accesses

Abstract

This chapter aims to arm clinical researchers with the necessary conceptual and practical tools (1) to understand what sample size or power analysis is, (2) to conduct such analyses for basic low-risk studies, and (3) to recognize when it is necessary to seek expert advice and input. I hope it is obvious that this chapter aims to serve as a general guide to the issues; specific details and mathematical presentations may be found in the cited literature. Additionally, it should be obvious that this discussion of statistical power is focused, appropriately, on quantitative investigations into real or hypothetical effects of treatments or interventions. It does not address qualitative study designs. The ultimate goal here is to help practicing clinical researcher get started with power analyses.

Surgeon: Say, I’ve done this study but my results are disappointing.

Statistician: How so?

Surgeon: The p-value for my main effect was 0.06.

Statistician: And?

Surgeon: I need something less than 0.05 to get tenure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baussell RB, Li Y-F. Power analysis for experimental research: a practical guide for the biological, medical and social sciences. New York: Cambridge University Press; 2002. p. ix.

    Book  Google Scholar 

  2. Herman A, Notzer N, Libman Z, Braunstein R, Steinberg DM. Statistical education for medical students – concepts are what remain when the details are forgotten. Stat Med. 2007;26:4344–51.

    Article  PubMed  Google Scholar 

  3. Berry DA. Introduction to Bayesian methods III: use and interpretation of Bayesian tools in design and analysis. Clin Trials. 2005;2:295–300; discussion 301–4, 364–78.

    Article  PubMed  Google Scholar 

  4. Berry DA. Bayesian statistics. Med Decis Mak. 2006;26:429–30.

    Article  Google Scholar 

  5. Browne RH. Using the sample range as a basis for calculating sample size in power calculations. Am Stat. 2001;55:293–8.

    Article  Google Scholar 

  6. Bloom HS. Minimum detectable effects: a simple way to report the statistical power of experimental designs. Eval Rev. 1995;10:547–56.

    Article  Google Scholar 

  7. Greenland S. Power, sample size and smallest detectable effect determination for multivariate studies. Stat Med. 1985;4:117–27.

    Article  CAS  PubMed  Google Scholar 

  8. Poole C. Low P-values or narrow confidence intervals: which are more durable? Epidemiology. 2001;12:291–4.

    Article  CAS  PubMed  Google Scholar 

  9. Savitz DA, Tolo KA, Poole C. Statistical significance testing in the American Journal of Epidemiology, 1970–1990. Am J Epidemiol. 1994;139:1047–52.

    CAS  PubMed  Google Scholar 

  10. Sterne JA. Teaching hypothesis tests – time for significant change? Stat Med. 2002;21:985–94; discussion 995–9, 1001.

    Article  PubMed  Google Scholar 

  11. Greenland S. On sample-size and power calculations for studies using confidence intervals. Am J Epidemiol. 1988;128:231–7.

    CAS  PubMed  Google Scholar 

  12. Hintz J. PASS 2008, statistical analysis and sample size software. NCSS, LLC. www.ncss.com. Accessed 22 Oct 2013.

  13. Hoenig JM, Heisey D. The abuse of power: the pervasive fallacy of power calculations for data analysis. Am Stat. 2001;55:19–24.

    Article  Google Scholar 

  14. Chow S-C, Shao J, Wang H. Sample size calculations in clinical research. New York: Marcel Dekker; 2003.

    Google Scholar 

  15. Lipsey M. Design sensitivity: statistical power for experimental research. Newbury Park: Sage; 1990.

    Google Scholar 

  16. Maxwell SE, Kelly K, Rausch JR. Sample size planning for statistical power and accuracy in parameter estimation. Annu Rev Psychol. 2008;59:537–63. doi:10.1146/annurev.psych.59.103006.093735.

    Article  PubMed  Google Scholar 

  17. Oakes JM, Feldman HA. Statistical power for nonequivalent pretest-posttest designs. The impact of change-score versus ANCOVA models. Eval Rev. 2001;25:3–28.

    Article  CAS  PubMed  Google Scholar 

  18. Feldman HA, McKinlay SM. Cohort versus cross-sectional design in large field trials: precision, sample size, and a unifying model. Stat Med. 1994;13:61–78.

    Article  CAS  PubMed  Google Scholar 

  19. Armstrong B. A simple estimator of minimum detectable relative risk, sample size, or power in cohort studies. Am J Epidemiol. 1987;126:356–8.

    Article  CAS  PubMed  Google Scholar 

  20. Greenland S. Tests for interaction in epidemiologic studies: a review and a study of power. Stat Med. 1983;2:243–51.

    Article  CAS  PubMed  Google Scholar 

  21. Self SG, Mauritsen RH. Power/sample size calculations for generalized linear models. Biometrics. 1988;44:79–86.

    Article  Google Scholar 

Download references

Acknowledgements

This chapter would not have been possible without early training by Henry Feldman and the outstanding comments and corrections of Peter Hannan.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Michael Oakes Ph.D. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Oakes, J.M. (2014). Statistical Power and Sample Size: Some Fundamentals for Clinician Researchers. In: Glasser, S. (eds) Essentials of Clinical Research. Springer, Cham. https://doi.org/10.1007/978-3-319-05470-4_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-05470-4_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-05469-8

  • Online ISBN: 978-3-319-05470-4

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics