Outcome Rates and Effect on Sample Size
Outcome rates, such as the percent of sample units refusing to participate in a survey, generally have three uses. The first is to measure study performance and outcome rates, which are often also referred to as process indicators. The second use is to inflate a calculated sample size for loss of sample units to ensure viability of planned analyses. Third, study rates can also be incorporated into the design weights as adjustment factors to create final analysis weights. Outcome rates are not necessarily a measure of data quality but can be used to guide field decisions, and the logic behind them helps in the planning stages of a survey. Disposition codes are discussed that are needed to define the outcome rates.
- AAPOR. (2016b). Standard definitions: Final dispositions of case codes and outcome rates for surveys, 9th edn. Tech. rep., The American Association for Public Opinion Research, Deerfield, IL, URL http://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf
- Callegaro M., Baker R., Bethlehem J., Göritz A., Krosnick J., Lavrakas P. (eds) (2014). Online Panel Research: A Data Quality Perspective. John Wiley & Sons, Ltd., United Kingdom.Google Scholar
- Defense Manpower Data Center. (2004). May 2004 Status of Forces Survey of Reserve component members: Administration, datasets, and codebook. Tech. Rep. No. 2004-013, Defense Manpower Data Center, Arlington, VA.Google Scholar
- Potter F. J., Iannacchione V. G., Mosher W., Mason R., Kavee J. A. (1998). Sample design, sampling weights, imputation, and variance estimation in the 1995 National Survey of Family Growth. Vital and Health Statistics, National Center for Health Statistics 124(2).Google Scholar
- Traugott M. W., Goldstein K. (1993). Evaluating dual frame samples and advance letters as a means of increasing response rates. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 1284–1286.Google Scholar