Skip to main content

Assembling an Inventory of Multistage Adaptive Testing Systems

  • Chapter
  • First Online:

Part of the book series: Statistics for Social and Behavioral Sciences ((SSBS))

Abstract

There exists a natural tension between the goal of creating a large enough item bank to preserve the equivalency and security of test questions and that of cost reduction and efficiency for inventory creation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Ariel, A., van der Linden, W. J. & Veldkamp, B. P. (2006). A strategy for optimizing item pool management. Journal of Educational Measurement, 43, 85–96.

    Article  Google Scholar 

  • Breithaupt, K. & Hare, D. (2004, February). Automated simultaneous assembly of multi-stage subtests for the Uniform CPA Exam [Technical Report]. Ewing, NJ: American Institute of Certified Public Accountants.

    Google Scholar 

  • Breithaupt, K., Ariel, A. & Veldkamp, B. P. (2005). Automated simultaneous assembly for multistage testing. International Journal of Testing, 5, 319–330.

    Article  Google Scholar 

  • De Champlain, A. F., MacMillan, M. K., Margolis, M. J., Klass, D. J., Lewis, E. & Ahern, S. (2000). Modelling the effects of a test security breach on a large-scale standardized patient examination with a sample of international medical graduates. Academic Medicine, 75, 109–111.

    Article  Google Scholar 

  • DeVore, R. (2002). Considerations in the development of accounting simulations [Technical Report]. Ewing, NJ: American Institute of Certified Public Accountants.

    Google Scholar 

  • Downing, S. M. (2004). Item response theory: Applications of modern test theory in medical education. Medical Education, 37, 739-745.

    Article  Google Scholar 

  • Drasgow, F. & Olson-Buchanan, J. B. (1999). Innovations in computerized assessment. Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Hambleton, R. K. & Jones, R. W. (199l). Comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice [Instructional Topics in Educational Measurement Series], 38–47.

    Google Scholar 

  • Huitzing H. A. (2004). Using set covering with item sampling to analyze infeasibility of linear programming test assembly models. Applied Psychological Measurement, 28, 355–375.

    Article  MathSciNet  Google Scholar 

  • Huitzing, H. A., Veldkamp, B. P. & Verschoor, A. J. (2003). Infeasibility in automatic test assembly models: A comparison study of different methods. Journal of Educational Measurement, 42, 223–243.

    Article  Google Scholar 

  • ILOG. (2002). ILOG OPL Studio 3.6.1 [User Manual]. Mountain View, CA.

    Google Scholar 

  • Keller, L. A. & Davey, T. (2002). Using collateral information in IRT parameter estimation. Paper presentation at the annual meeting of the International Test Commission, Winchester, UK.

    Google Scholar 

  • Luecht, R. M. (1998). Computer-assisted test assembly using optimization heuristics. Applied Psychological Measurement, 22, 224–236.

    Article  Google Scholar 

  • Luecht, R. M., Brumfield, T. & Breithaupt, K. (2002). A subtest-assembly design for the uniform CPA Exam. Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans.

    Google Scholar 

  • Luecht, R. M. & Burgin, W. (2003). Test information targeting strategies for adaptive multistage testing designs. Paper presentation at the annual meeting of the National Council on Measurement in Education, Chicago, IL.LA.

    Google Scholar 

  • Luecht, R. M. & Nungester, R. (1998). Some practical examples of computer-adaptive sequential testing. Journal of Educational Measurement, 35, 229–249.

    Article  Google Scholar 

  • Nemhauser, G. L. & Wolsey, L. A. (1999). Integer and combinatorial optimization. New York: Wiley & Sons.

    MATH  Google Scholar 

  • Raymond, M. & Neustel, S. (2006). Determining the content of credentialing examinations. In S. Downing & T. Haldyna (Eds.), Handbook of test development (pp. 191–223). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Stocking, M. L. & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17, 277–292.

    Article  Google Scholar 

  • Sympson, J. B. & Hetter, R. D. (1985, October). Controlling item-exposure rates in computerized adaptive testing. Proceedings of the 27th Annual Meeting of the Military Testing Association (pp. 973–977). San Diego: Navy Personnel Research and Development Center.

    Google Scholar 

  • Tekian, A., McGuire, McGaghie & Associates (1999). Innovative simulations for assessing professional competence: From paper-and-pencil to virtual reality. Chicago: Department of Medical Education, University of Illinois at Chicago.

    Google Scholar 

  • Theunissen, T. J. J. M. (1985). Binary programming and test design. Psychometrika, 50, 411–420.

    Article  Google Scholar 

  • van der Linden, W. J. (2005) Linear models for optimal test design. New York: Springer-Verlag.

    MATH  Google Scholar 

  • van der Linden, W. J. & Adema, J. J. (1998). Simultaneous assembly of multiple test forms. Journal of Educational Measurement, 35, 185–198.

    Article  Google Scholar 

  • van der Linden, W. J., Ariel, A. & Veldkamp, B. P. (2006). Assembling a CAT item pool as a set of linear test forms. Journal of Educational and Behavioral Statistics, 31, 81–100.

    Article  Google Scholar 

  • van der Linden, W. J. & Boekkooi-Timminga, E. (1989). A maximin model for test design with practical constraints. Psychometrika, 54, 237–247.

    Article  Google Scholar 

  • van der Linden, W. J., Veldkamp, B. P. & Reese, L. M. (2000). An integer programming approach to item bank design. Applied Psychological Measurement, 22, 259–270.

    Article  Google Scholar 

  • Veldkamp, B. P. (2001). Principles and methods of constrained test assembly. Doctoral dissertation, University of Twente, Enschede, The Netherlands.

    Google Scholar 

  • Way, W. D., Steffen, M. & Anderson, G. S. (1998). Developing, maintaining, and renewing the item inventory to support computer-based testing. In C. N. Mills, M. Potenza, J. J. Fremer & W. Ward (Eds.), Computer-based testing: Building the foundation for future assessments (pp. 89–102). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Williams, H.P. (1990). Model building in mathematical programming (3rd ed.). New York: Wiley & Sons.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Breithaupt, K., Ariel, A.A., Hare, D.R. (2009). Assembling an Inventory of Multistage Adaptive Testing Systems. In: van der Linden, W., Glas, C. (eds) Elements of Adaptive Testing. Statistics for Social and Behavioral Sciences. Springer, New York, NY. https://doi.org/10.1007/978-0-387-85461-8_13

Download citation

Publish with us

Policies and ethics