Advertisement

A Technique for Setting Standards and Maintaining Them over Time

  • Mark Wilson
  • Karen Draney

Summary

This paper describes a new procedure for standard setting based on item response maps (“Wright maps”). Motivation for the technique is discussed, and variants of the item response formulation are shown. An example based on the Golden State Examinations is used as a context for the discussion, and for some results.

Keywords

Committee Member Proficiency Level Multiple Choice Item Construct Mapping Polytomous Item 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Adams, R. J., Wilson, M., & Wang, W. C. (1997). The Multidimensional Random Coefficients Multinomial Logit Model. Applied Psychological Measurement, 21, 1–23.CrossRefGoogle Scholar
  2. Draney, K., & Wilson, M. (1998, June). Creating composite scores and setting performance levels: Use of a scaling procedure. Council of Chief State School Officers National Conference on Large Scale Assessment, Colorado Springs, CO.Google Scholar
  3. Jaeger, R. M. (1995). Setting standards for complex performances: An iterative, judgmental policy-capturing strategy. Educational Measurement, Issues, and Practice, 14 (4), 16–20.MathSciNetCrossRefGoogle Scholar
  4. Jaeger, R. M., Plake B. S., & Hambleton, R. K. (1993). Integrating multidimensional performance and setting performance standards. Paper presented at the annual meeting of the National Council on Measurement in Education, Atlanta, GA.Google Scholar
  5. Wilson, M. (1994). Assessment nets: An alternative approach to assessment in mathematics education. In T. Romberg (Ed.), Assessment in School Mathematics New York: SUNY Press.Google Scholar
  6. Wilson, M., & Draney, K. (1998, June. Creating composite scores and setting performance levels: Comparison of raw score and scaling procedures. Council of Chief State School Officers National Conference on Large Scale Assessment, Colorado Springs, CO.Google Scholar
  7. Wu, M., Adams, R. J., & Wilson M. (1998). ACER-Conquest [computer program and manual]. Hawthorn, Australia: ACER PressGoogle Scholar

Copyright information

© Springer Japan 2002

Authors and Affiliations

  • Mark Wilson
    • 1
  • Karen Draney
    • 1
  1. 1.University of California, BerkeleyBerkeleyUSA

Personalised recommendations