Skip to main content
SpringerLink
Log in
Book cover

Quantitative Psychology Research pp 67–78Cite as

Different Growth Measures on Different Vertical Scales

  • Conference paper
  • First Online:

  • 1493 Accesses

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 167))

Abstract

Vertical scales have been used by testing programs for decades to facilitate the tracking of student performance over time. With the recent emphasis on the measuring of student growth for accountability purposes, scores from vertically scaled tests have been used to evaluate school or teacher performance. Because there are different types of growth measures and there are also different ways to construct a vertical scale, it is important to understand the impact of the vertical scales on various growth measures for important educational decisions. Based on some mathematical relationships that have been shown to exist among certain growth measures and with the use of empirical data, this study investigated the impact of different vertical scales on the relationships among simple gain scores, residual gain scores, and three growth measures based on conditional status percentile ranks (CSPR). Results showed that the correlations between simple gain scores and the rest of the growth measures were affected by the extent of scale expansion or scale shrinkage across grades.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   139.00
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Betebenner, D. W. (2008). Toward a normative understanding of student growth. In K. E. Ryan & L. A. Shepard (Eds.), The future of test-based educational accountability (pp. 155–170). NewYork, NY: Taylor & Francis.

    Google Scholar 

  • Betebenner, D. W. (2009). Norm-and criterion-referenced student growth. Educational Measurement: Issues and Practice, 28(4), 42–51.

    Article  Google Scholar 

  • Briggs, D. C., & Domingue, B. (2013). The gains from vertical scaling. Journal of Educational and Behavioral Statistics, 38(6), 551–576.

    Article  Google Scholar 

  • Briggs, D. C., & Weeks, J. P. (2009). The impact of vertical scaling decisions on growth interpretations. Educational Measurement: Issues and Practice, 28(4), 3–14.

    Article  Google Scholar 

  • Burket, G. R. (1984). Response to Hoover. Educational Measurement: Issues and Practice, 3(4), 15–16.

    Article  Google Scholar 

  • Castellano, K. E., & Ho, A. D. (2013). Contrasting OLS and quantile regression approaches to student “growth” percentiles. Journal of Educational and Behavioral Statistics, 38(2), 190–215.

    Article  Google Scholar 

  • Dunn, J., & Allen, J. (2009). Holding schools accountable for the growth of nonproficient students: Coordinating measurement and accountability. Educational Measurement: Issues and Practice, 28(4), 27–41.

    Article  Google Scholar 

  • Goldschmidt, P., Choi K., & Beaudon, J. P. (2012). Growth model comparison study: Practical implications of alternative models for evaluating school performance. Retrieved from http://www.ccsso.org/Documents/2012/Growth_Model_Comparison_Study_Evaluating_School_Performance_2012.pdf.

  • Grady, M., Lewis, D., & Gao, F. (2010). The effect of sample size on student growth percentiles. Paper presented at the 2010 annual meeting of the National Council on Measurement in Education. May 1–3, Denver, CO.

    Google Scholar 

  • Harris, D. W. (Ed.). (1963). Problems in measuring change. Madison: University of Wisconsin Press.

    Google Scholar 

  • Hoover, H. D. (1984). The most appropriate scores for measuring educational development in the elementary schools: GEs. Educational Measurement: Issues and Practice, 3(4), 8–14.

    Article  Google Scholar 

  • Kolen, M. J., & Brennan, R. L. (2014). Test equating, scaling, and linking: Methods and practices (3rd ed.). New York: Springer.

    Book  MATH  Google Scholar 

  • Lei, P., & Zhao, Y. (2012). Effects of vertical scaling methods on linear growth estimation. Applied Psychological Measurement, 36(1), 21–39.

    Article  Google Scholar 

  • Li, D. (2015a). Investigations of the Thurstone scaling method in the ACT Aspire vertical scaling study. In W. Tao (Chair), Constructing a vertical scale under linked scaling tests design. Symposium conducted at the annual meeting of the National Council on Measurement in Education. April 15–19, Chicago, IL.

    Google Scholar 

  • Li, D. (2015b). Relationships of growth measures from different plausible vertical scales. Paper presented at the annual meeting of the National Council on Measurement in Education. April 15–19. Chicago, IL.

    Google Scholar 

  • Li, D., & Kolen, M. J. (2008). Models of individual growth for school accountability—An empirical comparison. Paper presented at the annual meeting of the American Educational Research Association. March 24–28, New York City, NY.

    Google Scholar 

  • Li, D., & Kolen, M. J. (2011). Relationships between status, simple gain, residual gain, and linear growth. Paper presented at the annual meeting of the National Council on Measurement in Education. April 7–11, New Orleans, LA.

    Google Scholar 

  • Lord, F. M. (1967). A paradox in the interpretation of group comparisons. Psychological Bulletin, 685, 304–305.

    Article  Google Scholar 

  • Maris, E. (1998). Covariance adjusted versus gain scores—Revisited. Psychological Methods, 3, 309–327.

    Article  Google Scholar 

  • Paek, I., Young, M. J., & Yi, Q. (2008). The impact of data collection design, linking method, and sample size on vertical scaling using the Rasch model. Journal of Applied Measurement, 9(3), 229–248.

    Google Scholar 

  • Patz, R. (2007). Vertical scaling in standards-based educational assessment and accountability systems. Washington, DC: The Council of Chief State School Officers.

    Google Scholar 

  • Phillips, S. E., & Clarizio, H. F. (1988). Conflicting growth expectations cannot both be real: A rejoinder to Yen. Educational Measurement: Issues and Practice, 7(4), 18–19.

    Article  Google Scholar 

  • Roberts, D. M., & Burrill, D. F. (1995). Gain score grading revisited. Educational Measurement: Issues and Practice, 14(1), 29–33.

    Article  Google Scholar 

  • Thurstone, L. L. (1938). Primary mental abilities. Chicago: University of Chicago Press.

    Google Scholar 

  • Tong, Y., & Kolen, M. J. (2007). Comparisons of methodologies and results in vertical scaling for educational achievement tests. Applied Measurement in Education, 20(2), 227–253.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ACT, Inc., 500 ACT Drive, Iowa City, IA, 52243, USA

    Dongmei Li

Authors
  1. Dongmei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dongmei Li .

Editor information

Editors and Affiliations

  1. University of Amsterdam, Amsterdam, The Netherlands

    L. Andries van der Ark

  2. University of Wisconsin, Madison, Wisconsin, USA

    Daniel M. Bolt

  3. Education University of Hong Kong, Hong Kong, China

    Wen-Chung Wang

  4. University of Illinois, Champaign, Illinois, USA

    Jeffrey A. Douglas

  5. Umeå University, Umeå, Sweden

    Marie Wiberg

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Li, D. (2016). Different Growth Measures on Different Vertical Scales. In: van der Ark, L., Bolt, D., Wang, WC., Douglas, J., Wiberg, M. (eds) Quantitative Psychology Research. Springer Proceedings in Mathematics & Statistics, vol 167. Springer, Cham. https://doi.org/10.1007/978-3-319-38759-8_6

Download citation

Publish with us

Policies and ethics

Search

Navigation