Skip to main content

Outcome Rates and Effect on Sample Size

  • Chapter
  • First Online:
Book cover Practical Tools for Designing and Weighting Survey Samples

Abstract

Outcome rates, such as the percent of sample units refusing to participate in a survey, generally have three uses. The first is to measure study performance and outcome rates, which are often also referred to as process indicators. The second use is to inflate a calculated sample size for loss of sample units to ensure viability of planned analyses. Third, study rates can also be incorporated into the design weights as adjustment factors to create final analysis weights. Outcome rates are not necessarily a measure of data quality but can be used to guide field decisions, and the logic behind them helps in the planning stages of a survey. Disposition codes are discussed that are needed to define the outcome rates.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.m-s-g.com/

  2. 2.

    http://www.surveysampling.com/

  3. 3.

    Alternatively, the units could be worked in a random order, in which case, data collection could be stopped partway through a replicate. Working cases in a random order is typically impractical, however.

  4. 4.

    http://planning.dc.gov/planning/frames.asp?doc=/planning/lib/planning/maps/docs/census_tract.pdf

References

  • AAPOR. (2016b). Standard definitions: Final dispositions of case codes and outcome rates for surveys, 9th edn. Tech. rep., The American Association for Public Opinion Research, Deerfield, IL, URL http://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf

  • Abraham K. G., Maitland A., Bianchi S. M. (2006). Nonresponse in the American time use survey: Who is missing from the data and how much does it matter? Public Opinion Quarterly 70(5):676–703.

    Article  Google Scholar 

  • Brick J. M., Waksberg J., Kulp D., Starer A. (1995). Bias in list-assisted telephone samples. Public Opinion Quarterly 59(2):218–235.

    Article  Google Scholar 

  • Callegaro M., Baker R., Bethlehem J., Göritz A., Krosnick J., Lavrakas P. (eds) (2014). Online Panel Research: A Data Quality Perspective. John Wiley & Sons, Ltd., United Kingdom.

    Google Scholar 

  • Defense Manpower Data Center. (2004). May 2004 Status of Forces Survey of Reserve component members: Administration, datasets, and codebook. Tech. Rep. No. 2004-013, Defense Manpower Data Center, Arlington, VA.

    Google Scholar 

  • Groves R. M. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly 70(5):646–675.

    Article  Google Scholar 

  • Groves R. M., Peytcheva E. (2008). The impact of nonresponse rates on nonresponse bias. Public Opinion Quarterly 72:167–189.

    Article  Google Scholar 

  • Kish L. (1965). Survey Sampling. John Wiley & Sons, Inc., New York.

    MATH  Google Scholar 

  • Potter F. J., Iannacchione V. G., Mosher W., Mason R., Kavee J. A. (1998). Sample design, sampling weights, imputation, and variance estimation in the 1995 National Survey of Family Growth. Vital and Health Statistics, National Center for Health Statistics 124(2).

    Google Scholar 

  • Traugott M. W., Goldstein K. (1993). Evaluating dual frame samples and advance letters as a means of increasing response rates. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 1284–1286.

    Google Scholar 

  • Wagner J. (2010). The fraction of missing information as a tool for monitoring the quality of survey data. Public Opinion Quarterly 74(2):223–243.

    Article  Google Scholar 

  • Wagner J., Ragunathan T. (2010). A new stopping rule for surveys. Statistics in Medicine 29(9):1014–1024.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Valliant, R., Dever, J.A., Kreuter, F. (2018). Outcome Rates and Effect on Sample Size. In: Practical Tools for Designing and Weighting Survey Samples. Statistics for Social and Behavioral Sciences. Springer, Cham. https://doi.org/10.1007/978-3-319-93632-1_6

Download citation

Publish with us

Policies and ethics