Skip to main content

Methodological Trends and Controversies in the Media’s Use of Opinion Polls

  • Chapter

Abstract

Polls have been an integral part of news coverage for more than 200 years, although scientific polls have been in use for only the last eight decades. Pollsters and news organizations have enjoyed a symbiotic relationship over this time period because of the interest of the pollsters in promoting their commercial business and the interest of news organizations in enhancing their coverage. Over time, polling itself has undergone a number of methodological advances that produced distinctive shifts in how polls are conducted, analyzed and presented. But this marriage of convenience has not been without its problems, often producing controversies in the conduct of the polls and how the media report them.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • American Association for Public Opinion Research (2009) An Evaluation of the Methodology of the 2008 Pre-election Primary Polls, available at http://aapor.org/uploads/AAPOR_Rept_FINAL-Rev-4-13-09.pdf.

  • American Association for Public Opinion Research (2010a) AAPOR Report on Online Panels, available at http://poq.oxfordjournals.org/content/early/2010/10/19/poq.nfq048.full.html.

  • American Association for Public Opinion Research (2010b) New Considerations for Survey Researchers When Planning and Conducting RDD Telephone Surveys in the U.S. With Respondents Reached via Cell Phone Numbers, available at http://aapor.org/AM/Template.cfm?Section=Cell_Phone_Task_Force&Template=/CM/ContentDisplay.cfm&ContentID=2818.

  • American Association for Public Opinion Research (2011) Transparency Supporters, available at http://www.aapor.org/AAPOR_Transparency_Supporters.htm.

  • Bellis, M. (2010) Inventors of the Modern Computer, available at http://inventors.about.com/library/weekly/aa120198.htm?p=1.

  • Bishop, G. and D. Moore (2010) 2010 Top Ten ‘Dubious Polling’ Awards (February 1), available at http://www.stinkyjournalism.org/latest-journalism-news-updates-169.php.

  • Blumberg, S. J. and J. V. Luke (2011) Wireless Substitution: Early Release of Estimates from the National Health Interview Survey, January–June, 2011, available at http://www.cdc.gov/nchs/data/nhis/earlyrelease/wireless201112.htm.

  • Blumenthal, M. (2010a) Pollsters Raise Alarm: Inaccurate Polls May Be Impacting Campaigns (November 8), available at http://www.huffingtonpost.com/2010/11/08/pollsters-raise-alarm-ina_n_780705.html?utm_source=twitterfeed&utm_medium=twitter.

  • Blumenthal, M. (2010b) Population ‘Modeling:’ Presuming Too Much? (June 7), available at http://nationaljournal.com/njonline/po_20100604_8918.php.

  • Blumenthal, M. (2010c) What Makes a Poll Partisan? (March 22), available at http://nationaljournal.com/njonline/what-makes-a-poll-partisan-20100322?mrefid=site_search.

  • Catanese, D. (2010) Pollster Kills Site as Critics Pile On (July 8), available at http://www.politico.com/news/stories/0710/39497.html.

  • Cho, J-E (2010) How the Polls got the Local Elections all Wrong (June 17), available at http://joongangdaily.joins.com/article/view.asp?aid=2921960.

  • Converse, J. M. (1987) Survey Research in the United States: Roots and Emergence, 1890–1960 (Berkeley, CA: University of California Press).

    Google Scholar 

  • DiCamillo, M. (2010) The Rise of Robopolling in California and Its Implications (November 15), available at http://www.pollingreport.com/md1011.htm.

  • DiSogra, C. (2007) Of Trains, Panel Quality, and Sample Coverage, available at http://www.knowledgenetworks.com/accuracy/spring2007/disogra.html.

  • Durand, C. (2011) ‘Polls at the Subnational Level: The Canadian Case.’ Paper presented at the 2011 WAPOR conference, Amsterdam.

    Google Scholar 

  • Elert, G. (2002) Number of Cell Phones in the US, available at http://hypertextbook.com/facts/2002/BogusiaGrzywac.shtml.

  • Hopkins, D. J. (2009) ‘No More Wilder Effect, Never a Whitman Effect: When and Why Polls Mislead about Black and Female Candidates’, Journal of Politics, 71, 769–781.

    Article  Google Scholar 

  • Intac (2010) Internet Usage in America by Household, available at http://www.mtac.net/internet-usage-in-america-by-household_2010-05-11/.

  • Keeter, S., L. Christian and M. Dimock (2010) The Growing Gap between Landline and Dual Frame Election Polls (November 22), available at http://pewresearch.org/pubs/1806/growing-gap-between-landline-and-dual-frame-election-polls.

  • Kim, S. W., Traugott, M. W., Park, S. H., and Lee, S. K. (2011) ‘Why Did the Preelection Polls in South Korean Local Elections Go All Wrong? Assessing the Sources of Errors using Dual-Frame Landline/Cell Phone Post-election Survey?’ Paper presented at the 2011 WAPOR conference, Amsterdam.

    Google Scholar 

  • Kos Media LLC et al. v. Research 2000 et al. (2011) Documents from the California Northern District Court. Available at http://dockets.justia.com/docket/california/candce/3:2010cv02894/229290/.

  • Martin, E. A., M. W. Traugott and C. Kennedy (2005) ‘A Review and a Proposal for a New Measure of Poll Accuracy’, Public Opinion Quarterly, 69, 342–369.

    Article  Google Scholar 

  • Media Matters for America (2010) McClatchy D.C. Bureau Cuts Polling, Follows Trend (July 8), available at http://mediamatters.org/blog/201007080012.

  • Mitofsky, W. J. (1991) ‘A Short History of Exit Polls’, in P. J. Lavrakas and J. J. Holley (eds), Polling and Presidential Election Coverage (Newbury Park, CA: Sage Publications).

    Google Scholar 

  • Mitofsky, W. J. and M. Edelman (1995) ‘A Review of the 1992 VRS Exit Polls’, in P. J. Lavrakas, M. W. Traugott and P. V. Miller (eds), Presidential Polls and the News Media (Boulder, CO: Westview Press).

    Google Scholar 

  • Moreno, A., Aguilar-Pariente, R., and Romero, V. (2011) ‘The Unnatural Left-Right Coalitions: Challenges for Pre-election Polls in Mexico.’ Paper presented at the 2011 WAPOR conference, Amsterdam.

    Google Scholar 

  • Mosteller, F., H. Hyman, P. J. McCarthy, E. S. Marks and D. B. Truman (1949) The Pre-election Polls of 1948 (New York: Social Science Research Council).

    Google Scholar 

  • Politico (2010) Available at http://www.politico.com/news/stories/1110/45008.html.

  • Reader, S. (2010) Partisan Bias in Internal Polls: Lessons from the 2010 Midterm (November 11), available at http://www.huffingtonpost.com/scot-reader/partisan-bias-in-internal_b_782157.html.

  • Rivers, D. (2006) Sample Matching: Representative Samples from Internet Panels (Palo Alto, CA: Polimetrix Inc.), available at http://www.rochester.edu/College/faculty/mperess/srm2011/Polimetrix_Methodology.pdf.

  • Silver, N. (2009a) Comparison Study: Unusual Patterns in Strategic Vision Polling Data Remain Unexplained, available at http://www.fivethirtyeight.com/2009/09/comparison-study-unusual-patterns-in.html.

  • Silver, N. (2009b) Reality Check: NY 23 Poll May Seek to Alter, Not Reflect, Reality, available at http://www.fivethirtyeight.com/2009/10/reality-check-ny-23-poll- may-seek-to.html.

  • Silver, N. (2010a) BREAKING: Daily Kos to Sue Research 2000 for Fraud, available at http://www.fivethirtyeight.com/2010/06/breaking-daily-kos-to-sue-research-2000.html.

  • Silver, N. (2010b) Rasmussen Polls Were Biased and Inaccurate; Quinnipiac, SurveyUSA Performed Strongly (November 4), available at http://fivethirtyeight.blogs.nytimes.com/2010/11/04/rasmussen-polls-were-biased-and-inaccurate- quinnipiac-surveyusa-performed-strongly/.

  • Smith, B. (2009) Embattled Pollster Defends Methods (September 25), available at http://www.politico.com/blogs/bensmith/0909/Embattled_pollster_defends_methods.html.

  • Smith, T. W. (1982) ‘House Effects and the Reproducibility of Survey Measurements: A Comparison of the 1980 GSS and the 1980 American National Election Study’, Public Opinion Quarterly, 46(1), 54–68.

    Article  Google Scholar 

  • Squire, P. (1988) ‘Why the 1936 Literary Digest Poll Failed’, Public Opinion Quarterly, 52(1), 125–133.

    Article  Google Scholar 

  • Tarran, B. (2010) ABC Polling Director Goes Independent, Bags ABC as Client (August 2), available at http://www.research-live.com/news/people/abc-polling-director-goes-independent-bags-abc-as-client/4003278.article.

  • Traugott, M. W. (2009) Changes in Media Polling in Recent Presidential Campaigns: Moving from Good to ‘Average’ at CNN, available at http://www.hks.harvard.edu/presspol/publications/papers/research_papers/r33_traugott.pdf.

  • Traugott, M. W. and C. Wlezien (2009) ‘The Dynamics of Poll Performance during the 2008 Presidential Nomination Contest’, Public Opinion Quarterly, 73, 866–894.

    Article  Google Scholar 

  • Tyebjee, T. (1979) ‘Telephone Survey Methods: The State of the Art’, Journal of Marketing, 43, 68–78.

    Article  Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Copyright information

© 2012 Michael Traugott

About this chapter

Cite this chapter

Traugott, M. (2012). Methodological Trends and Controversies in the Media’s Use of Opinion Polls. In: Holtz-Bacha, C., Strömbäck, J. (eds) Opinion Polls and the Media. Palgrave Macmillan, London. https://doi.org/10.1057/9780230374959_4

Download citation

Publish with us

Policies and ethics