Summary
In the present study we developed a domain-referenced test consisting of four subtests with the application of one parameter logistic model of item response theory. Some conditions are required: 10%–15% of the test takers pass the test given a cut-off score of 80% correct. Two of the four subtests satisfied the above requirements. One of the other two showed a passing ratio higher than specified. The other showed a low degree of classification consistency. In regards to validity, we attempted to secure content-related validity. Also there is an evidence of supporting construct-related validity. The correlations among the four subtests were small enough to show adequate discrimination of constructs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anastasi, A & Urbina, S (1997) Psychological Testing(7th Ed.). Upper Saddle River, NJ: Prentice Hall.
Carroll, JB (1993) Human Cognitive Abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press.
Central Committee of HRM-Korea (2001) Request of Proposals for Developing a Public Service Aptitude Test. Seoul, Korea: Author.
Graham, D & Berquist, C (1975) An examination of criterion-referenced test characteristics in relation to assumptions about the nature of achievement variables. Paper presented at the annual meeting of the AERA, Washington.
Mislevy, RJ (1992) Linking educational assessment: Concept, issue;, methods, and prospects. Princeton, NJ: Educational Testing Service.
Mislevy, RJ & Bock, RD (1986) PC-BILOG: User’s Guide. Mooresville, IN: Scientific Software.
Traub, RE & Rowley, GL (1980) Reliability of test scores and decisions. Applied Psychological Measurement. 4, 517–546.
Zimowski, MF, Muraki, E, Mislevy, RJ, & Bock, RD (1996) BILOG-MG Chicago, IL: Scientific Software.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2003 Springer Japan
About this paper
Cite this paper
Lee, S., Kim, C., Kim, MS. (2003). Developing a Domain-Referenced Test given a Selection Ratio and a Cut-Off Score: An application of Item Response Theory. In: Yanai, H., Okada, A., Shigemasu, K., Kano, Y., Meulman, J.J. (eds) New Developments in Psychometrics. Springer, Tokyo. https://doi.org/10.1007/978-4-431-66996-8_33
Download citation
DOI: https://doi.org/10.1007/978-4-431-66996-8_33
Publisher Name: Springer, Tokyo
Print ISBN: 978-4-431-66998-2
Online ISBN: 978-4-431-66996-8
eBook Packages: Springer Book Archive