Responses of schools to accountability systems using multiple measures: the case of New York City elementary schools
- 457 Downloads
Many studies point to potential unintended consequences of accountability systems such as when schools narrow their teaching to fixate on tested subjects. As a result, some states and districts in the USA have complemented the federal test-based accountability system with additional measures of educational practices to hold schools accountable on multiple measures. To explore the consequences of such systems, this study focuses on the responses of nine elementary schools to a multiple-measure accountability system in New York City, including high-stakes tests and quality reviews. While some schools showed broader improvement efforts, results suggest the state test remains the dominant measure in driving responses of schools, and in some cases, the quality review further reinforces the schools' focus on the test.
KeywordsQuality reviews High-stakes testing Educational accountability
The research reported here was supported by the Spencer Foundation (grant agreement number 201100124).
- Barber, M. (2004). The virtue of accountability: system redesign, inspection, and incentives in the era of informed professionalism. Journal of Education, 85(1), 7–38.Google Scholar
- Cullen, J.B., & Reback, R. (2006). Tinkering toward accolades: school gaming under a performance accountability system. Cambridge: National Bureau of Economic Research. Working paper 12286. http://www.nber.org/papers/w12286. Accessed Feb 2010.
- De Wolf, I.F., & Janssens, F.J.G. (2005). Effects and side effects of inspections and accountability in education; an overview of empirical studies. http://www1.fee.uva.nl/scholar/wp/wp53-05.pdf. Accessed Nov 2009.
- Ehren, M. C. M. (2006). Toezicht en schoolverbetering. Delft: Uitgeverij Eburon.Google Scholar
- Figlio, D.N. and Getzler, L.S. (2002). Accountability, ability and disability: gaming the system. NBER working paper 9307. http://www.nber.org/papers/w9307. Accessed Dec 2009.
- Gong, B., & Hill, R. (2001). Some considerations of multiple measures in assessment and school accountability. Presentation at the Seminar on Using Multiple Measures and Indicators to Judge Schools' Adequate Yearly Progress Under Title I (sponsored by CCSSO & US DOE), Washington, DC.Google Scholar
- Gribben, M.A., Campbell, H.L., Mathew, J. (2008). Are advanced students advancing? Examining achievement trends beyond proficiency. Paper presented at AERA 2008.Google Scholar
- Hamilton, L.S., Stecher, B.M., Klein, S.P. (Eds.). (2002). Making sense of test-based accountability in education. Santa Monica: Rand cooperation. http://www.rand.org/pubs/monograph_reports/MR1554/. Accessed Feb 2010.
- Kogan, M., & Maden, M. (1999). An evaluation of evaluators: the OFSTED system of school inspection. In C. Cullingford (Ed.), An inspector calls; Ofsted and its effect on school standards (9–32). London: Kogan Page Limited.Google Scholar
- Koretz, D.M., McCaffrey, D.F., Hamilton, L.S. (2001). Towards a framework for validating gains under high-stakes conditions. CRESST/Harvard Graduate School of Education: CSE Technical Report 551Google Scholar
- Ladd, H.F. (2007). Holding schools accountable revisited. 2007 Spencer Foundation Lecture in Education Policy and Management.Google Scholar
- Linn, R. L. (2005). Conflicting demands of no child left behind and state systems: mixed messages about school performance. Education Policy Analysis Archives, 13(33), 1–17.Google Scholar
- New York City Department of Education. (2010g). Quality reviewer handbook. Retrieved from http://schools.nyc.gov/Accountability/default.htm. Accessed Jan 2010.
- New York State Education Department. (2008). Information bulletin New York State accountability system February 2008. http://www.nysed.gov/. Retrieved December 2010. Accessed Jan 2010.
- New York State Education Department. (2010a). How No Child Left Behind (NCLB) accountability works in New York State. http://www.nysed.gov/. Retrieved December 2010. Accessed Jan 2010.
- New York State Education Department. (2010b). Accountability peer review, update May 2010. http://www.nysed.gov/. Retrieved December 2010. Accessed Jan 2010.
- New York State Education Department. (2010c). Executive summary differentiated accountability. http://www.nysed.gov/. Retrieved December 2010. Accessed Jan 2010.
- New York State Education Department. (2010d). Proposal submitted to the US Education Department by the New York State Education Department to incorporate measures of student longitudinal growth into determinations of school and district AYP. http://www.nysed.gov/. Retrieved December 2010. Accessed Jan 2010.
- OECD (2005). Modernising government: the way forward, Paris, chapters 2–3. Available at www.oecdbookshop.org.
- Pallas, A. M., & Jennings, J. L. (2009). ‘Progress’ reports. In D. Ravitch, D. Meier, D. Avitia, D. C. Bloomfield, J. F. Brennan, H. N. Dukes, L. Haimson, E. N. Horowitz, J. L. Jennings, S. Koss, M. McAdoo, U. Ofer, A. M. Pallas, S. Sanders, S. Stern, P. J. Sulivan, & A. Wolf (Eds.), NYC schools under Bloomberg and Klein: what parents, teachers and policymakers need to know. New York: Cass Size Matters.Google Scholar
- Ravitch, D., Meier, D., Avitia, D., Bloomfield, D. C., Brennan, J. F., Dukes, H. N., Haimson, L., Horowitz, E. M., Jennings, J. L., Koss, S., McAdoo, M., Ofer, U., Pallas, A. M., Sanders, S., Stern, S., Sulivan, P. J., & Wolf, A. (2009). NYC schools under Bloomberg and Klein: what parents, teachers and policymakers need to know. New York: Cass Size Matters.Google Scholar
- Stecher, B. M. (2002). Consequences of large-scale, high-stakes testing on school and classroom practices. Tests and their use in test-based accountability systems. In L. S. Hamilton, B. M. Stecher, & S. P. Klein (Eds.), Making sense of test-based accountability in education. Santa Monica: Rand cooperation. http://www.rand.org/pubs/monograph_reports/MR1554/. Accessed Feb 2010.
- The Council of School Supervisors and Administrators (CSA) (2009). Oversight - Department of Education's Progress Reports. Presented to: New York City Council, Committee on Education http://www.csa-nyc.org/. Retrieved from http://www.csa-nyc.org/sites/default/files/city%20council%20progress%20reports%20draft%20testimony%2010-30-%202009final.pdf. Accessed Jan 2011.
- Visscher, A. J., & Coe, R. (Eds.). (2002). School improvement through performance feedback (pp. 41–75). Lisse: Swets & Zeitlinger.Google Scholar
- Volante, L. (2004). Teaching to the test: what every educator and policy-maker should know. Canadian Journal of Educational Administration and Policy, 35, 1–6.Google Scholar