Abstract
Nonequivalent groups with anchor test (NEAT) design is typically preferred in test score equating, but there are tests which do not administer an anchor test. If the groups are nonequivalent, an equivalent groups (EG) design cannot be recommended. Instead, one can use a nonequivalent groups with covariates (NEC) design. The overall aim of this work was to propose the use of item response theory (IRT) with a NEC design by incorporating the mixed-measurement IRT with covariates model within IRT observed-score equating in order to model both test scores and covariates. Both simulations and a real test example are used to examine the proposed test equating method in comparison with traditional IRT observed-score equating methods with an EG design and a NEAT design. The results show that the proposed method can be used in practice, and the simulations show that the standard errors of the equating are lower with the proposed method as compared with traditional methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
ACT, ACT Technical Manual (ACT, Iowa City, IA, 2007)
K. Bränberg, M. Wiberg, Observed score linear equating with covariates. J. Educ. Meas. 48(4), 419–440 (2011)
B. Efron, R. Tibshirani, An Introduction to the Bootstrap (Chapman Hall, New York, NY, 1993)
M. Gnaldi, S. Bacci, Joint assessment of the latent trait dimensionality and observable differential item functioning of students' national tests. Qual. Quant. 50(4), 1429–1447 (2015)
J. González, M. Wiberg, A.A. von Davier, A note on the Poisson’s binomial distribution in item response theory. Appl. Psychol. Meas. 40(4), 302–310 (2016)
P.W. Holland, H. Wainer, Differential Item Functioning (Lawrence Erlbaum Associates, Hillsdale, NJ, 1993)
T. Hsu, K. Wu, J. Yu, M. Lee, Exploring the feasibility of collateral information test equating. Int. J. Test. 2(1), 1–14 (2002)
M. Kolen, R. Brennan, Test Equating, Scaling, and Linking: Method and Practice, 3rd edn. (Springer-Verlag, New York, NY, 2014)
M. Liou, P.E. Cheng, M. Li, Estimating comparable scores using surrogate variables. Appl. Meas. Educ. 25(2), 197–207 (2001)
N.T. Longford, Equating without an anchor for nonequivalent groups of examinees. J. Educ. Behav. Stat. 40(3), 227–253 (2015)
F.M. Lord, M.S. Wingersky, Comparison of IRT true-score and equipercentile observed-score "equatings". Appl. Psychol. Meas. 8, 452–461 (1984)
P.-E. Lyrén, R.K. Hambleton, Consequences of violated the equating assumptions under the equivalent group design. Int. J. Test. 36(5), 308–323 (2011)
M.A. Quenette, W.A. Nicewander, G.L. Thomasson, Model-based versus empirical equating of test forms. Appl. Psychol. Meas. 30, 167–182 (2006)
R Core Development Team, R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, Vienna, 2016.) http://www.R-project.org/
L. Tay, D. Newman, J.K. Vermunt, Item response theory with covariates (IRT-C): assessing item recovery and differential item functioning for the three-parameter logistic model. Educ. Psychol. Meas. 76(1), 22–42 (2016)
M. Wiberg, K. Bränberg, Kernel equating under the non-equivalent groups with covariates design. Appl. Psychol. Meas. 39(5), 349–361 (2015)
M. Wiberg, J. González, Statistical assessment of estimated transformations in observed-score equating. J. Educ. Meas. 53(1), 106–125 (2016)
J. González, M. Wiberg Applying Test Equating Methods Using R (Springer, Berlin, 2017). doi:10.1007/978-3-319-51824-4
N.K. Wright, N.J. Dorans, Using the Selection Variable for Matching or Equating (ETS Research Report RR-93–04) (Educational Testing Service, Princeton, NJ, 1993)
Acknowledgement
The research in this paper by Marie Wiberg was funded by the Swedish Research Council grant: 2014-578.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Sansivieri, V., Wiberg, M. (2017). IRT Observed-Score Equating with the Nonequivalent Groups with Covariates Design. In: van der Ark, L.A., Wiberg, M., Culpepper, S.A., Douglas, J.A., Wang, WC. (eds) Quantitative Psychology. IMPS 2016. Springer Proceedings in Mathematics & Statistics, vol 196. Springer, Cham. https://doi.org/10.1007/978-3-319-56294-0_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-56294-0_25
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-56293-3
Online ISBN: 978-3-319-56294-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)