Abstract
The chapter shifts focus away from the history of construct validity theory (CVT), in order to explore recent developments in validity theory more generally. Emphasis is placed on the contributions of one of the pioneers of late twentieth century, Samuel Messick, including his challenge to the “Trinitarian” view of validity in favour of the “Unitarian” view and his emphasis on validity as a property of interpretations, uses, and consequences of tests. This is followed by a brief review of more current treatments of validity and a comparison of these to the CVT paradigm. The chapter concludes with a presentation of developments in validity theory and standards of practice as manifest in the 4th, 5th, and 6th editions of the Standards.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Test validity is thus an overall evaluative judgment of the adequacy and appropriateness of inferences drawn from test scores. This evaluation rests on four bases: (1) an inductive summary of convergent and discriminant research evidence that the test scores are interpretable in terms of a particular construct meaning, (2) an appraisal of the value implications of that interpretation, (3) a rationale and evidence for the relevance of the construct and the utility of the scores in particular applications, and (4) an appraisal of the potential social consequences of the proposed use and of the actual consequences when used.
—Messick (1980, p. 2023)
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1985). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (1974). Standards for educational and psychological tests. Washington, DC: American Psychological Association.
Bechtoldt, H. P. (1959). Construct validity: A critique. American Psychologist, 14, 619–629.
Borsboom, D. (2005). Measuring the mind. Cambridge, UK: Cambridge University Press.
Borsboom, D. (2006). The attack of the psychomatricians. Psychometrika, 71, 425–440.
Borsboom, D., Cramer, A. O. J., Kievit, R. A., Scholtan, A. Z., & Franic, S. (2009). The end of construct validity. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 135–170). Charlotte, NC: Information Age Publishing.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
Cizek, G. J. (2012). Defining and distinguishing validity: Interpretations of score meaning and justifications of test use. Psychological Methods, 17, 31–43.
Cizek, G. J. (2016). Validating test score meaning and defending test score use: Different aims, different methods. Assessment in Education: Principles, Policy & Practice, 23, 212–225.
Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field setting. Chicago, IL: Rand McNally.
Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443–507). Washington, DC: American Council on Education.
Cronbach, L. J. (1988). Five perspectives on the validity argument. In H. Wainer & H. Braun (Eds.), Test validity (pp. 3–17). Hillsdale, NJ: Erlbaum.
Cronbach, L. J. (1989). Construct validation after thirty years. In R. L. Linn (Ed.), Intelligence: Measurement theory and public policy: Proceedings of a symposium in honor of Lloyd G. Humphreys (pp. 147–171). Urbana: University of Illinois Press.
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity and psychological tests. Psychological Bulletin, 52, 281–302.
Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179–197.
Embretson, S. E. (1993). Psychometric models for learning and cognitive processes. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test theory for a new generation of tests (pp. 125–150). Hillsdale, NJ: Lawrence Erlbaum Associates.
Embretson, S. E. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 380–396.
Embretson, S. E. (2007). Construct validity: A universal validity system or just another test evaluation procedure? Educational Researcher, 36, 449–455.
Embretson, S. E., & Gorin, J. (2001). Improving construct validity with cognitive psychology principles. Journal of Educational Measurement, 38, 343–368.
Gellerman, S. W. (1958). The ethics of personality testing. Personnel, 35, 30–35.
Goodwin, L. D., & Leech, N. L. (2003). The meaning of validity the new standards for educational and psychological testing: Implications for measurement courses. Measurement and Evaluation in Counseling and Development, 36, 181–191.
Guion, R. M. (1977). Content validity: Three years of talk—What’s the action? Public Personnel Management, 6, 407–414.
Guion, R. M. (1980). On trinitarian doctrines of validity. Professional Psychology, 11, 385–398.
Hubley, A. M., & Zumbo, B. D. (2011). Validity and the consequences of test interpretation and use. Social Indicators Research, 103, 219–230.
Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112, 527–535.
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38, 319–342.
Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed.). Washington, DC: American Council on Education/Praeger.
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1–73.
Kane, M. T. (2016). Explicating validity. Assessment in Education: Principles, Policy & Practice, 23, 198–211.
Lawson, D. E. (1944). Need for safeguarding the field of intelligence testing. Journal of Educational Psychology, 35, 240–247.
Lissitz, R. W., & Samuelsen, K. (2007a). A suggested change in terminology and emphasis regarding validity and education. Educational Researcher, 36, 437–448.
Lissitz, R. W., & Samuelsen, K. (2007b). Further clarification regarding validity and education. Educational Researcher, 36, 482–484.
Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694.
Markus, K. A., & Borsboom, D. (2013). Frontiers of test validity theory: Measurement, causation, and meaning. New York: Routledge.
Messick, S. (1965). Personality measurement and the ethics of assessment. American Psychologist, 20, 136–142.
Messick, S. (1975). The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30, 955–966.
Messick, S. (1980). Test validity and the ethics of assessment. American Psychologist, 35, 1021–1027.
Messick, S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 33–46). Hillsdale, NJ: Lawrence Erlbaum.
Messick, S. (1989a). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: MacMillan.
Messick, S. (1989b). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18, 5–11.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific enquiry into score meaning. American Psychologist, 50, 741–749.
Mislevy, R. J. (2009). Validity from the perspective of model-based reasoning. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 83–108). Charlotte, NC: Information Age Publishing.
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessment. Measurement: Interdisciplinary Research and Perspectives, 1, 3–62.
Moss, P. A. (1992). Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 62, 229–258.
Moss, P. A. (1996). Enlarging the dialogue in educational measurement: Voices from interpretive research traditions. Educational Researcher, 25, 20–28.
Moss, P. A. (1998). The role of consequences in validity theory. Educational Measurement: Issues and Practice, 17(2), 6–12.
Moss, P. A. (2013). Validity in action: Lessons from studies of data use. Journal of Educational Measurement, 50, 91–98.
Newton, P. E. (2012a). Clarifying the consensus definition of validity. Measurement: Interdisciplinary Research and Perspectives, 10, 1–29.
Newton, P. E. (2012b). Questioning the consensus definition of validity. Measurement: Interdisciplinary Research and Perspectives, 10, 110–122.
Newton, P. E., & Shaw, S. (2013). Standards for talking and thinking about validity. Psychological Methods, 18, 301–319.
Newton, P. E., & Shaw, S. (2014). Validity in educational and psychological assessment. London: Sage.
Seashore, H. (1951). Personnel selection tests and fair employment practices. American Psychologist, 6, 128–129.
Shepard, L. A. (1993). Evaluating test validity. Review of Research in Education, 19, 405–450.
Shepard, L. A. (1997). The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16, 5–8.
Sireci, S. G. (1998). The construct of content validity. Social Indicators Research, 45, 83–117.
Sireci, S. G. (2013). Agreeing on validity arguments. Journal of Educational Measurement, 50, 99–104.
Author information
Authors and Affiliations
Corresponding author
Copyright information
© 2017 The Author(s)
About this chapter
Cite this chapter
Slaney, K. (2017). Recent Accounts of (Construct) Validity. In: Validating Psychological Constructs. Palgrave Studies in the Theory and History of Psychology. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-137-38523-9_5
Download citation
DOI: https://doi.org/10.1057/978-1-137-38523-9_5
Published:
Publisher Name: Palgrave Macmillan, London
Print ISBN: 978-1-137-38522-2
Online ISBN: 978-1-137-38523-9
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)