Advertisement

Designing, Developing, and Implementing an Accessible Computer-Based National Assessment System

  • Magda ChiaEmail author
  • Rachel Kachchaf
Chapter
First Online:

Abstract

As states adapt new content standards that support college and career readiness, there is a need to develop assessments that produce valid and reliable measures for all students. This chapter describes the overall processes and individual tasks that the Smarter Balanced Assessment Consortium (Smarter Balanced) implemented to produce one of the most accessible mathematics and English language arts/literacy assessment systems. The assessments are aligned with the Common Core State Standards (CCSS) and are geared to students in grades 3–8 and 11. This chapter explains the ways in which the consortium operationalized and implemented universal design principles throughout the entire assessment design and development process, including creation of the test administration platform, item writing, piloting, field testing, and scoring. In addition, the authors share how Smarter Balanced emphasized utilizing a multidisciplinary approach and evidence-based decisions-making processes. The chapter shows how these approaches resulted in a suite of embedded and non-embedded accessibility resources that can help meet individual student needs. The ability to customize individual test instances reinforces a paradigm shift away from considering the needs of student groups (e.g., English learners, students with disabilities) to focusing on each individual student’s specific need(s). The chapter closes with a call for future work and research that includes identifying how technology can meet the needs of individual students, in particular low-instance populations.

Keywords

Common core Standards Accessibility Assessment design Disabilities English learners Accessibility resources 
This is a preview of subscription content, log in to check access.

References

  1. Abedi, J., & Ewers, N. (2013). Accommodations for English language learners and students with disabilities: A research based algorithm. Retrieved from http://www.smarterbalanced.org/wordpress/wp-content/uploads/2012/08/Accomodations-for-under-represented-students.pdf
  2. Abedi, J., Hofstetter, C., & Lord, C. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74(1), 1–28.CrossRefGoogle Scholar
  3. Alliance for Excellence. (2015). Every student succeeds act: Accountability provisions. Retrieved from: https://www.sifassociation.org/NewsRoom/Documents/ESSA_accountability_chart.pdf
  4. Common Core State Standards Initiative (CCSS). (2016a). About the standards. Retrieved from http://www.corestandards.org/about-the-standards/
  5. Common Core State Standards Initiative (CCSS). (2016b). Public license. Retrieved from http://www.corestandards.org/public-license/
  6. Department of Education. (2014). Setting the pace: Expanding opportunity for America’s Students Under Race to the Top. Retrieved from https://www.whitehouse.gov/sites/default/files/docs/settingthepacerttreport_3-2414_b.pdf
  7. Duran, R. (2008). Assessing English-language learners’ achievement. Review of Research in Education, 32, 292–327.CrossRefGoogle Scholar
  8. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MITE Press.Google Scholar
  9. Higgins, J., Famularo, L., Bowman, T., & Hall, R. (2015). Research and development of audio and American Sign Language guidelines for creating accessible computer-based assessments. Retrieved from http://gaap.measuredprogress.org/gaap/docs/GAAP_Research_White_Paper _Final.pdf
  10. Kopriva, R. (2001, June). ELL validity research designs for state academic assessments: An outline of five research designs evaluation the validity of large-scale assessments for English language learners and other test takers. Paper presented at the Council of State School Officers Meeting, Houston, TX.Google Scholar
  11. Partnership for Assessment of Readiness for College and Careers (PARCC). (2016). The PARCC tests: Modern, high-quality assessments. Retrieved from http://www.parcconline.org/about/the-parcc-tests
  12. Smarter Balanced Assessment Consortium (Smarter). (n.d.-a). The individual student assessment accessibility profiles (ISAAP) process. Retrieved from http://www.smarterbalanced.org/assessments/accessibility-and-accommodations/
  13. Smarter Balanced Assessment Consortium (Smarter). (n.d.-b). Interim assessment statement of purpose. Retrieved from www.smarterbalanced.org/wp-content/uploads/2015/09/Interim-Assessment-Statement-Purpose-FINALmerged.pdf
  14. Smarter Balanced Assessment Consortium (Smarter). (2014). Smarter balanced assessment consortium: Accessibility and accommodations framework. Retrieved from https://www.smarterbalanced.org/wp-content/uploads/2015/09/Accessibility-and-Accommodations-Framework.pdf
  15. Smarter Balanced Assessment Consortium (Smarter). (2015a). Smarter balanced assistive technology typology. Retrieved from http://www.smarterbalanced.org/assessments/accessibility-and-accommodations/
  16. Smarter Balanced Assessment Consortium (Smarter). (2015b). Content specifications for the summative assessment of the Common Core State Standards for Mathematics. Retrieved from http://www.smarterbalanced.org/wp-content/uploads/2015/08/Mathematics-Content-Specifications.pdf
  17. Smarter Balanced Assessment Consortium (Smarter). (2015c). Content specifications for the summative assessment of the Common Core State Standards for English language arts and literacy in history/social studies, science, and technical subjects. Retrieved from www.smarterbalanced.org/wp-content/uploads/2015/08/ELA_Content_Specs.pdf
  18. Smarter Balanced Assessment Consortium (Smarter). (2016a). Projected and actual student counts. Unpublished internal document.Google Scholar
  19. Smarter Balanced Assessment Consortium (Smarter). (2016b). Smarter balanced assessment consortium usability, accessibility, and accommodations guidelines (UAAG). Retrieved from http://www.smarterbalanced.org/wp-content/uploads/2015/09/Usability-Accessibility-Accomodations-Guidelines.pdf
  20. Smarter Balanced Assessment Consortium (Smarter). (2016c). Smarter balanced assessment consortium: 2013–14 technical report. Retrieved from www.smarterbalanced.org/wp-content/uploads/2015/08/2013-14_Technical_Report.pdf
  21. Smarter Balanced Assessment Consortium (Smarter). (2016d). Smarter balanced assessment consortium advisory committees. Retrieved from http://www.smarterbalanced.org/about/advisory-committees/
  22. Smarter Balanced Assessment Consortium (Smarter). (2016e). Accessibility and accommodations. Retrieved from http://www.smarterbalanced.org/assessments/accessibility-and-accommodations/
  23. Solano-Flores, G. (2012). Smarter balanced assessment consortium: Translation accommodations framework for testing English language learners in mathematics. Retrieved from http://www.smarterbalanced.org/wp-content/uploads/2015/08/Translation-Accommodations-Framework-for-Testing-ELL-Math.pdf
  24. United States Department of Education (2015). Every Student Succeeds Act. Retrieved from https://www.ed.gov/essa?src=rn
  25. Solano-Flores, G., Backhoff, E., & Contreras-Niño, L. A. (2009). Theory of test translation error. International Journal of Testing, 9(2), 78–91.CrossRefGoogle Scholar
  26. Yell, M. L., & Katsiyannas, A. (2006). Adequate yearly progress, and students with disabilities. Retrieved from http://www.redorbit.com/news/education/424129/the_no_child_left_behind_act_adequate_yearly_progress_and/

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.Stanford University, Understanding Language/Stanford Center for Assessment, Learning, and EquityStanfordUSA
  2. 2.University of California Los Angeles, Smarter Balanced Assessment ConsortiumLos AngelesUSA

Personalised recommendations

Cite chapter

Buy options