Skip to main content

Constructing Instruments to Achieve Measurement

  • Chapter
  • First Online:
  • 66k Accesses

Part of the book series: Springer Texts in Education ((SPTE))

Abstract

During the item development stage, a pool of items are produced by experienced item writers according to the instrument specifications, which may include the number of the items to measure each aspect or content area and the format of each item. After items have been developed they are typically refined through a number of item trials. Instruments typically consist of item formats that require respondents to generate a response (constructed response item) and/or those that require respondents to choose a response from among alternatives (selected response item). Three basic types of selected response items are typically used in tests of proficiency: alternate choice, multiple-choice and matching items. Multiple-choice items consist of the correct response and a number of distractors. The item key is the correct response option for a multiple-choice item. Questionnaires often include selected response items with ordered response options. In order to achieve measurement, the number, order and wording of response categories need to be carefully considered. Raters or judges often rate persons according to one or multiple rating criteria on some performance.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Andrich, D., & Styles, I. (2004). Final report on the psychometric analysis of the Early Development Instrument (EDI) using the Rasch model: A technical paper commissioned for the development of the Australian Early Development Instrument (AEDI). http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.495.5875&rep=rep1&type=pdf.

  • Andrich, D., & Styles, I. (2009). Distractors with information in multiple choice items: A rationale based on the Rasch model. In E. V. Smith Jr. & G. E. Stone (Eds.), Criterion referenced testing: Practice analysis to score reporting using Rasch measurement models (pp. 24–70). Maple Grove: JAM Press.

    Google Scholar 

  • Andrich, D., de Jong, J. H. A. L., & Sheridan, B. E. (1997). Diagnostic opportunities with the Rasch model for ordered response categories. In J. Rost & R. Langeheine (Eds.), Applications of latent trait and latent class models in the social sciences (pp. 59–70). Münster and New York: Waxmann.

    Google Scholar 

  • Bertrand, A., & Cebula, J. P. (1980). Tests, measurement, and evaluation: A developmental approach. Boston, MA: Addison-Wesley.

    Google Scholar 

  • Bloom, B. S., Hastings, J. T., & Madaus, G. F. (1971). Handbook on formative and summative evaluation of student learning. New York: McGraw-Hill.

    Google Scholar 

  • Bock, R. D. (1975). Multivariate statistical methods in behavioral research. New York: McGraw-Hill.

    Google Scholar 

  • Doward, L. C., et al. (2003). Development of the ASQoL: A quality of life instrument specific to ankylosing spondylitis. Annals of the Rheumatic Diseases,62, 20–26.

    Article  Google Scholar 

  • Gilworth, G. et al. (2003). Development of a Work Instability Scale for Rheumatoid Arthritis. Arthritis & Rheumatism (Arthritis Care & Research), 49(3), 349–354.

    Google Scholar 

  • Hagquist, C., & Andrich, D. (2004). Measuring subjective health among adolescents in Sweden: A Rasch analysis of the HBSC instrument. Social Indicators Research,68, 201–220.

    Article  Google Scholar 

  • Humphry, S. M., & Heldsinger, S. A. (2014). Common structural design features of rubrics may represent a threat to validity. Educational Researcher,43(5), 253–263.

    Article  Google Scholar 

  • Likert, R. A. (1932). A technique for the measurement of attitudes. Archives of Psychology,140, 5–55.

    Google Scholar 

  • Oppenheim, A. N. (1992). Questionnaire design, interviewing and attitude measurement. London: Pinter.

    Google Scholar 

  • Smith, R. M. (1987). Assessing partial knowledge in vocabulary. Journal of Educational Measurement,24(3), 217–231.

    Article  Google Scholar 

  • Sudman, S., & Bradburn, N. M. (1982). Asking questions: A practical guide to questionnaire design. San Fransisco: Jossey-Bass.

    Google Scholar 

  • van Wyke, J. F. (2003). Constructing and interpreting achievement scales using polytomously scored items: A comparison between the Rasch and Thurstone models. Professional Doctorate thesis, Murdoch University, Western Australia.

    Google Scholar 

  • Wohwill, J. F. (1963). The measurement of scalability of non-cumulative items. Educational and Psychological Measurement,23, 543–555.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Andrich .

Exercises

Exercises

Respond to the statements in Table 2.8 and give yourself a score. Are you for or against capital punishment and to what degree?

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Andrich, D., Marais, I. (2019). Constructing Instruments to Achieve Measurement. In: A Course in Rasch Measurement Theory. Springer Texts in Education. Springer, Singapore. https://doi.org/10.1007/978-981-13-7496-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-7496-8_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-7495-1

  • Online ISBN: 978-981-13-7496-8

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics