Abstract
In an experiment, power and sample size calculations anticipate the outcome of a statistical test that will be performed when the experimental data are available for analysis. In parallel, in an observational study, the power of a sensitivity analysis anticipates the outcome of a sensitivity analysis that will be performed when the observational data are available for analysis. In both cases, it is imagined that the data will be generated by a particular model or distribution, and the outcome of the test or sensitivity analysis is anticipated for data from that model. Calculations of this sort guide many of the decisions made in designing a randomized clinical trial, and similar calculations may usefully guide the design of an observational study. In experiments, the power in large samples is used to judge the relative efficiency of competing statistical procedures. In parallel, the power in large samples of a sensitivity analysis is used to judge the ability of design features, such as those in Chapter 5, to distinguish treatment effects from bias due to unmeasured covariates. As the sample size increases, the limit of the power of a sensitivity analysis is a step function with a single step down from power 1 to power 0, where the step occurs at a value Γ̃ of Γ called the design sensitivity. The design sensitivity is a basic tool for comparing alternative designs for an observational study.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Heller, R., Rosenbaum, P.R., Small, D.: Split samples and design sensitivity in observational studies. J Am Statist Assoc 104, to appear (2009)
Hodges, J.L., Lehmann, E.L.: Estimates of location based on ranks, Ann Math Statist 34, 598–611 (1963)
Lehmann, E.L.: Nonparametrics, San Francisco: Holden Day (1975). Reprinted New York: Springer (2006)
Rosenbaum, P. R.: Hodges-Lehmann point estimates of treatment effect in observational studies. J Am Statist Assoc 88 1250–1253 (1993)
Rosenbaum, P. R.: Design sensitivity in observational studies. Biometrika 91, 153–164 (2004)
Rosenbaum, P. R.: Heterogeneity and causality: Unit heterogeneity and design sensitivity in observational studies. Am Statistician 59, 147–152 (2005)
Rosenbaum, P.R.: What aspects of the design of an observational study affect its sensitivity to bias from covariates that were not observed? Festshrift for Paul W. Holland. Princeton, NJ: ETS (2009)
Small, D., Rosenbaum, P. R.: War and wages: The strength of instrumental variables and their sensitivity to unobserved biases. J Am Statist Assoc 103, 924–933 (2008)
Werfel, U., Langen, V., Eickhoff, I., Schoonbrood, J., Vahrenholz, C., Brauksiepe, A., Popp, W., Norpoth, K.: Elevated DNA single-strand breakage frequencies in lymphocytes of welders. Carcinogenesis 19, 413–418 (1998)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2010 Springer-Verlag New York
About this chapter
Cite this chapter
Rosenbaum, P.R. (2010). The Power of a Sensitivity Analysis and Its Limit. In: Design of Observational Studies. Springer Series in Statistics. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-1213-8_14
Download citation
DOI: https://doi.org/10.1007/978-1-4419-1213-8_14
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-1212-1
Online ISBN: 978-1-4419-1213-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)