Abstract
This study examines factors that influence the reliability of subscores and the accuracy of subscore estimates in multistage testing (MST). The factors considered in the study include the number of subtests, subtest length, correlations among subscores, item pool characteristics such as item pool size relative to the number of items required for an MST and statistical properties of items. Results indicated that the factors that most influenced subscore reliability and subscore estimates were subtest length, item pool size, and the degree of item discrimination.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Theta correlation matrix is \( \left( {\begin{array}{*{20}c} 1 & {0.5} & {0.7} \\ {0.5} & 1 & {0.9} \\ {0.7} & {0.9} & 1 \\ \end{array} } \right) \).
References
American Psychological Association, National Council on Measurement in Education, & American Educational Research Association. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. https://doi.org/10.1037/e578562014-008.
Diao, Q., & van der Linden, W. J. (2011). Automated test assembly using lp_solve version 5.5 in R. Applied Psychological Measurement, 35, 398–409. https://doi.org/10.1177/0146621610392211.
Konis, K. (2009). lpSolveAPI, version 5.5.0.15 [Computer software].
Sinharay, S. (2010). How often do subscores have added value? Results from operational and simulated data. Journal of Educational Measurement, 47(2), 150–174. https://doi.org/10.1111/j.1745-3984.2010.00106.x.
Sinharay, S. (2013). A note on assessing the added value of subscores. Journal of Educational Measurement, 32, 38–42. https://doi.org/10.1111/emip.12021.
Von Davier, M. (2016). Software for multidimensional discrete latent traits models [computer software]. Princeton, NJ: Educational Testing Service.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Jiang, Y. (2019). Statistical Considerations for Subscore Reporting in Multistage Testing. In: Wiberg, M., Culpepper, S., Janssen, R., González, J., Molenaar, D. (eds) Quantitative Psychology. IMPS IMPS 2017 2018. Springer Proceedings in Mathematics & Statistics, vol 265. Springer, Cham. https://doi.org/10.1007/978-3-030-01310-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-01310-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01309-7
Online ISBN: 978-3-030-01310-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)