Skip to main content
SpringerLink
Log in

An Attribute-Specific Item Discrimination Index in Cognitive Diagnosis

  • Conference paper
  • First Online:
Quantitative Psychology (IMPS 2017, IMPS 2018)

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 265))

  • 1090 Accesses

Abstract

There lacks an item quality index as a measure of item’s correct classification rates of attributes. The purpose of this study is to propose an attribute-specific item discrimination index as a measure of correct classification rate of attributes based on a q-vector, item parameters, and the distribution of attribute patterns. First, an attribute-specific item discrimination index was introduced. Second, a heuristic method was presented using the new index for test construction. The first simulation results showed that the new index performed well in that their values matched closely with the simulated correct classification rates of attributes across different conditions. The second simulation study results showed that the heuristic method based on the sum of the attributes’ indices yielded comparable performance to the famous CDI. The new index provides test developers with a useful tool to evaluate the quality of diagnostic items. It will be valuable to explore the applications and advantages of using the new index for developing an item selection algorithm or a termination rule in cognitive diagnostic computerized adaptive testing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Chang, H.-H. (2015). Psychometrics behind computerized adaptive testing. Psychometrika, 80(1), 1–20.

    Article  MathSciNet  MATH  Google Scholar 

  • Chang, H.-H., & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20(3), 213–229.

    Article  Google Scholar 

  • Chen, P., Xin, T., Wang, C., & Chang, H.-H. (2012). On-line calibration methods for the DINA model with independent attributes in CD-CAT. Psychometrika, 77(2), 201–222.

    Article  MathSciNet  MATH  Google Scholar 

  • Chen, Y., Liu, Y., & Xu, S. (2018). Mutual information reliability for latent class analysis. Applied Psychological Measurement, 42(6), 460–477.

    Article  Google Scholar 

  • Cheng, Y. (2009). When cognitive diagnosis meets computerized adaptive testing: CD–CAT. Psychometrika, 74(4), 619–632.

    Article  MathSciNet  MATH  Google Scholar 

  • Chiu, C.-Y., Douglas, J. A., & Li, X.-D. (2009). Cluster analysis for cognitive diagnosis: Theory and applications. Psychometrika, 74(4), 633–665.

    Article  MathSciNet  MATH  Google Scholar 

  • Cui, Y., Gierl, M. J., & Chang, H.-H. (2012). Estimating classification consistency and accuracy for cognitive diagnostic assessment. Journal of Educational Measurement, 49(1), 19–38.

    Article  Google Scholar 

  • de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76, 179–199.

    Article  MathSciNet  MATH  Google Scholar 

  • de la Torre, J., Hong, Y., & Deng, W. L. (2010). Factors affecting the item parameter estimation and classification accuracy of the DINA model. Journal of Educational Measurement, 47(2), 227–249.

    Article  Google Scholar 

  • Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26(4), 301–321.

    Article  Google Scholar 

  • Henson, R., & Douglas, J. (2005). Test construction for cognitive diagnosis. Applied Psychological Measurement, 29(4), 262–277.

    Article  MathSciNet  Google Scholar 

  • Henson, R., Roussos, L., Douglas, J., & He, X. (2008). Cognitive diagnostic attribute-level discrimination indices. Applied Psychological Measurement, 32(4), 275–288.

    Article  MathSciNet  Google Scholar 

  • Henson, R. A., Templin, J. L., & Willse, J. T. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191–210.

    Article  MathSciNet  MATH  Google Scholar 

  • Huebner, A., & Wang, C. (2011). A note on comparing examinee classification methods for cognitive diagnosis models. Educational and Psychological Measurement, 71(2), 407–419.

    Article  Google Scholar 

  • Junker, B. W., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25(3), 258–272.

    Article  MathSciNet  Google Scholar 

  • Kuo, B.-C., Pai, H.-S., & de la Torre, J. (2016). Modified cognitive diagnostic index and modified attribute-level discrimination index for test construction. Applied Psychological Measurement, 40(5), 315–330.

    Article  Google Scholar 

  • Lehmann, E. L., & Casella, G. (1998). Theory of point estimation (2nd ed.). New York: Springer.

    MATH  Google Scholar 

  • Rupp, A. A., Templin, J. L., & Henson, R. A. (2010). Diagnostic measurement: Theory, methods, and applications. New York: The Guilford Press.

    Google Scholar 

  • Sun, J., Xin, T., Zhang, S., & de la Torre, J. (2013). A polytomous extension of the generalized distance discriminating method. Applied Psychological Measurement, 37(7), 503–521.

    Article  Google Scholar 

  • Theodoridis, S., & Koutroumbas, K. (2009). Pattern recognition (4th ed.). London: Elsevier.

    MATH  Google Scholar 

  • von Davier, M. (2005). A general diagnostic model applied to language testing data (ETS RR-05–16). Princeton, NJ: Educational Testing Service.

    Google Scholar 

  • Wang, W. Y., Song, L. H., Chen, P., Meng, Y. R., & Ding, S. L. (2015). Attribute-level and pattern-level classification consistency and accuracy indices for cognitive diagnostic assessment. Journal of Educational Measurement, 52(4), 457–476.

    Article  Google Scholar 

  • Wang, W. Y., Song, L. H., & Ding, S. L. (2018). An item discrimination index and its application in cognitive diagnostic assessment on a classification oriented view. Journal of Psychological Science, 41(2), 475–483.

    Google Scholar 

  • Wang, W. Y., Song, L. H., Chen, P., & Ding, S. L. (2019). An item-level expected classification accuracy and its applications in cognitive diagnostic assessment. Journal of Educational Measurement, 56(1), 51–75.

    Google Scholar 

  • Xia, M. L., Mao, X. Z., & Yang, R. (2018). Cognitive diagnosis models under polytomous attributes and polytomous item. Journal of Jiangxi Normal University (Natural Science), 42(2), 134–138.

    MATH  Google Scholar 

Download references

Acknowledgments

This research was supported by the Key Project of National Education Science “Twelfth Five Year Plan” of Ministry of Education of China (Grant No. DHA150285). The authors would like to thank the editor Steve Culpepper for reviewing an earlier version of this work.

Author information

Authors and Affiliations

  1. Jiangxi Normal University, Nanchang, Jiangxi, People’s Republic of China

    Lihong Song & Wenyi Wang

Authors
  1. Lihong Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenyi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lihong Song .

Editor information

Editors and Affiliations

  1. Department of Statistics, Umeå School of Business, Economics and Statistics, Umeå University, Umeå, Sweden

    Marie Wiberg

  2. Department of Statistics, University of Illinois at Urbana-Champaign, Champaign, IL, USA

    Steven Culpepper

  3. Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium

    Rianne Janssen

  4. Facultad de Matematicas, Pontificia Universidad Catolica de Chile, Santiago, Chile

    Jorge González

  5. Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands

    Dylan Molenaar

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Song, L., Wang, W. (2019). An Attribute-Specific Item Discrimination Index in Cognitive Diagnosis. In: Wiberg, M., Culpepper, S., Janssen, R., González, J., Molenaar, D. (eds) Quantitative Psychology. IMPS IMPS 2017 2018. Springer Proceedings in Mathematics & Statistics, vol 265. Springer, Cham. https://doi.org/10.1007/978-3-030-01310-3_16

Download citation

Publish with us

Policies and ethics

Search

Navigation