Advertisement

Statistical Considerations for Subscore Reporting in Multistage Testing

  • Yanming JiangEmail author
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 265)

Abstract

This study examines factors that influence the reliability of subscores and the accuracy of subscore estimates in multistage testing (MST). The factors considered in the study include the number of subtests, subtest length, correlations among subscores, item pool characteristics such as item pool size relative to the number of items required for an MST and statistical properties of items. Results indicated that the factors that most influenced subscore reliability and subscore estimates were subtest length, item pool size, and the degree of item discrimination.

Keywords

Subscore Subscore reliability Multistage testing 

References

  1. American Psychological Association, National Council on Measurement in Education, & American Educational Research Association. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.  https://doi.org/10.1037/e578562014-008.CrossRefGoogle Scholar
  2. Diao, Q., & van der Linden, W. J. (2011). Automated test assembly using lp_solve version 5.5 in R. Applied Psychological Measurement, 35, 398–409.  https://doi.org/10.1177/0146621610392211.CrossRefGoogle Scholar
  3. Konis, K. (2009). lpSolveAPI, version 5.5.0.15 [Computer software].Google Scholar
  4. Sinharay, S. (2010). How often do subscores have added value? Results from operational and simulated data. Journal of Educational Measurement, 47(2), 150–174.  https://doi.org/10.1111/j.1745-3984.2010.00106.x.MathSciNetCrossRefGoogle Scholar
  5. Sinharay, S. (2013). A note on assessing the added value of subscores. Journal of Educational Measurement, 32, 38–42.  https://doi.org/10.1111/emip.12021.CrossRefGoogle Scholar
  6. Von Davier, M. (2016). Software for multidimensional discrete latent traits models [computer software]. Princeton, NJ: Educational Testing Service.Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Educational Testing ServicePrincetonUSA

Personalised recommendations