Skip to main content

Systematic Measurement Error

  • Chapter
  • First Online:
  • 488 Accesses

Abstract

Systematic errors bias measurements. Obviously, cheating is a biasing factor . Answer copying is a type of cheating , which can be detected by answer-copying indices. Satisficing is responding to items with less than optimal efforts. It is detectable by building instructional manipulation checks or bogus items into the test. A response style is a typical way of taking a test. Plodding is a style where test takers start slowly and take much time to answer items. It is counteracted by informing test takers on the amount of time and number of items that remain. Fumbling is a style where test takers start rather panicky. It cannot be prevented, but testing should be less panic arousing as possible. The extremity and midpoint styles are the tendencies to choose extreme and midpoint answer categories, respectively. Acquiescence and dissentience are tendencies of yea- and nay-saying, respectively, and are detectable if the test is balanced (i.e., has about equal numbers of indicative and contra-indicative items). Satisficing and fumbling yield aberrant response patterns and acquiescence and dissentience aberrant response patterns at balanced tests that are detectable by person-fit indices. Item nonresponse is the tendency to skip items. It is reduced by computerized test administration and re-approaching test takers who omitted items. These styles and tendencies are sometimes person characteristics that are of interest of their own. Deleting test takers who show styles or tendencies yields missing data that have to be handled in the analysis of the data (see Chap. 16).

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Beach, D. A. (1989). Identifying the random responder. The Journal of Psychology, 123, 101–103.

    Article  Google Scholar 

  • Couch, A., & Keniston, K. (1960). Yeasayers and naysayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 60, 151–174.

    Article  Google Scholar 

  • de Vries, A. L. M. (2006). The merit of ipsative measurement. Unpublished doctoral dissertation. The Netherlands, Maastricht: University.

    Google Scholar 

  • DuBois, P. H. (1970). A history of psychological testing. Boston: Allyn and Bacon.

    Google Scholar 

  • Guttman, L. (1950). The basis for scalogram analysis. In S. A. Stouffer, L. Guttman, E. A. Suchman, P. F. Lazarsfeld, S. A. Star, & J. A. Clausen (Eds.), Measurement and prediction (pp. 60–90). Princeton, NJ: Princeton University Press.

    Google Scholar 

  • Huisman, M., Krol, B., & van Sonderen, F. L. P. (1998). Handling missing data by re-approaching nonrespondents. Quality & Quantity, 32, 77–91.

    Article  Google Scholar 

  • Krosnick, J. A., & Presser, S. (2010). Questions and questionnaire design. In P. V. Marsden & J. D. Wright (Eds.), Handbook of survey research (2nd ed., pp. 263–313). Bingley, UK: Emerald.

    Google Scholar 

  • Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437–455.

    Article  Google Scholar 

  • Meijer, R. R. (1994). The number of Guttman errors as a simple and powerful person-fit statistic. Applied Psychological Measurement, 18, 311–314.

    Article  Google Scholar 

  • Meijer, R. R., & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107–135.

    Article  Google Scholar 

  • Mellenbergh, G. J. (2011). A conceptual introduction to psychometrics: Development, analysis, and application of psychological and educational tests. The Hague, The Netherlands: Eleven International Publishing.

    Google Scholar 

  • Miyazaki, I. (1963/1981). China’s examination hell (C. Schirokauer). New Haven, CT: Yale University Press.

    Google Scholar 

  • Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867–872.

    Article  Google Scholar 

  • Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46, 598–609.

    Article  Google Scholar 

  • Rorer, L. G. (1965). The great response-style myth. Psychological Bulletin, 63, 129–156.

    Article  Google Scholar 

  • Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory. Thousand Oaks, CA: Sage.

    Book  Google Scholar 

  • Sotaridona, L. S., van der Linden, W. J., & Meijer, R. R. (2006). Detecting answer copying using statistic kappa. Applied Psychological Measurement, 30, 412–431.

    Article  Google Scholar 

  • Wollack, J. A. (2006). Simultaneous use of multiple answer copying indexes to improve detection rates. Applied Measurement in Education, 19, 265–288.

    Article  Google Scholar 

  • Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: Mesa Press.

    Google Scholar 

  • Zopluogo, C. (2013). CopyDetect: An R package for computing statistical indices to detect answer copying on multiple-choice examinations. Applied Psychological Measurement, 37, 93–95.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gideon J. Mellenbergh .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Mellenbergh, G.J. (2019). Systematic Measurement Error. In: Counteracting Methodological Errors in Behavioral Research. Springer, Cham. https://doi.org/10.1007/978-3-030-12272-0_8

Download citation

Publish with us

Policies and ethics