Abstract
This study investigated the effects of the use of scaffolds in written classroom assessments through the voices of both native English speakers and English language learners from two middle schools. Students responded to assessment tasks in writing, by speaking aloud using think aloud protocols, and by reflecting in a post-assessment interview. The classroom assessment tasks were designed to engage students in scientific sense making and multifaceted language use, as recommended by the Next Generation Science Standards. Data analyses showed that both groups benefitted from the use of scaffolds. The findings revealed specific ways that modifications were supportive in helping students to comprehend, visualize and organize thinking, and elicit responses. This study offers a model for both sensitizing teachers and strengthening their strategies for scaffolding assessments equitably.
Similar content being viewed by others
References
Abedi, J. (2004). The no child left behind act and English language learners: Assessment and accountability issues. Educational Researcher, 33, 4–14.
Abedi, J. (2009). Guidelines for assessing English learners in academic content areas: Linguistic modifications of assessment. Paper presented at the CCSSO National Conference on Student Assessment, Los Angeles, CA.
Abedi, J., Hofstetter, C. H., & Lord, C. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74, 1–28.
Abedi, J., Lord, C., Hofstetter, C. H., & Baker, E. (2000). Impact of accommodation strategies on English language learners’ test performance. Educational Measurement: Issues and Practice, 19(3), 16–26.
Abell, S. K., & Siegel, M. A. (2011). Assessment literacy: What science teachers need to know and be able to do. In D. Corrigan, J. Dillon, & R. Gunstone (Eds.), The professional knowledge base of science teaching (pp. 205–221). London: Springer.
Baxter, G. P., Shavelson, R. J., Goldman, S. R., & Pine, J. (1992). Evaluation of procedure based scoring for hands-on science assessment. Journal of Educational Measurement, 29, 1–17.
Block, E. (1986). The comprehension strategies of second language readers. TESOL Quarterly, 20, 463–494.
Bryan, L. A., & Atwater, M. M. (2002). Teacher beliefs and cultural models: A challenge for science teacher preparation programs. Science Education, 86, 821–839.
Butler, F., & Stevens, R. (2001). Standardized assessment of the content knowledge of English language learners K-12: Current trends and old dilemmas. Language Testing, 18, 409–427.
Buxton, C. A., Allexsaht-Snider, M., Suriel, R., Kayumova, S., Choi, Y.-J., Bouton, B., & Baker, M. (2013). Using educative assessments to support science teaching for middle school English-language learners. Journal of Science Teacher Education, 24, 347–366.
CRESST. (2001). Policy brief no. 4. Los Angeles, CA: Center for Research on Evaluation, Standards, and Student Testing (CRESST).
Hazel, E., Logan, P., & Gallagher, P. (1997). Equitable assessment of students in physics: Importance of gender and language background. International Journal of Science Education, 19, 381–392.
Hobsbaum, A., Peters, S., & Sylva, K. (1996). Scaffolding in reading recovery. Oxford Review of Education, 22, 17–35.
Jenelle, R. (2004). Like everybody else: Equalizing educational opportunity for English Language Learners. TESOL Quarterly, 38, 43–66.
LaCelle-Peterson, M. W., & Rivera, C. (1994). Is it real for all kids? A framework for equitable assessment policies for English language learners. Harvard Educational Review, 64, 55–75.
Lee, O. (2001). Culture and language in science education: What do we know and what do we need to know? Journal of Research in Science Teaching, 38, 499–501.
Lee, O. (2005). Science education and English language learners: Synthesis and research agenda. Review of Educational Research, 4, 491–530.
Lee, O., Luykx, A., Buxton, C., & Shaver, A. (2007). The challenge of altering elementary school teachers’ beliefs and practices regarding linguistic and cultural diversity in science instruction. Journal of Research in Science Teaching, 44, 1269–1291.
Lee, O., Quinn, H., & Valdes, G. (2013). Science and language for English language learners in relation to next generation science standards and with implications for common core state standards for English language arts and mathematics. Educational Researcher, 42, 223–233.
Lewis-Moreno, B. (2007). Shared responsibility: Achieving success with English-language learners. Phi Delta Kappan, 88, 772–775.
Lincoln, Y. S., & Guba, E. G. (1985). Establishing trustworthiness. In Y. S. Lincoln & E. G. Guba (Eds.), Naturalistic inquiry (pp. 289–331). Newbury Park, CA: Sage.
Lyon, E. (2013). Assessment as discourse: A pre-service physics teacher’s evolving capacity to support an equitable pedagogy. Education Sciences, 3, 279–299.
Moore, F. M. (2007). Language in science education as a gatekeeper to learning, teaching, and professional development. Journal of Science Teacher Education, 18, 319–343.
National Center for Education Statistics (NCES). (2010). The condition of education 2010. Washington, DC: IES.
National Research Council (NRC) (Achieve, NSTA). (2013). Next generation science standards. Retrieved from http://www.nextgenscience.org/next-generation-science-standards
Palincsar, A. S. (1998). Keeping the metaphor of scaffolding fresh: A response to C. Addison Stone’s—The metaphor of scaffolding: Its utility for the field of learning disabilities. Journal of Learning Disabilities, 31, 370–373.
Shaw, J. M. (1997). Threats to the validity of science performance assessments for English language learners. Journal of Research in Science Teaching, 34, 721–743.
Shaw, J. M., Bunch, G. C., & Geaney, E. R. (2010). Analyzing language demands facing English learners on science performance assessments: The SALD framework. Journal of Research in Science Teaching, 47, 909–928.
Siegel, M. A. (2007). Striving for equitable classroom assessments for linguistic minorities: Strategies for and effects of revising life science items. Journal of Research in Science Teaching, 44, 864–881.
Siegel, M. A. (2014). Developing preservice science teachers’ expertise in equitable assessment. Journal of Science Teacher Education, 25, 289–308.
Siegel, M. A., Markey, D., & Swann, S. (2005). Life science assessments for English learners: A teacher’s resource. Berkeley, CA: University of California. http://www.lmri.ucsb.edu
Siegel, M. A., & Wissehr, C. (2011). Preparing for the plunge: Preservice teachers' assessment literacy. Journal of Science Teacher Education, 22, 371–391.
Siegel, M. A., Wissehr, C., & Halverson, K. L. (2008). Sounds like success: A framework for equitable assessment. The Science Teacher, 75(3), 43–46.
Solano-Flores, G. (2008). Who is given tests in what language by whom, when, and where? The need for probabilistic views of language in the testing of English language learners. Educational Researcher, 37, 189–199.
Solano-Flores, G., & Nelson-Barber, S. (2001). On the cultural validity of science assessments. Journal of Research in Science Teaching, 38, 553–573.
Vygotsky, L. S. (1978). Mind in society: The development to higher psychological processes. London: Cambridge University Press.
Walqui, A. (2003). Conceptual framework: Scaffolding instruction for English learners. San Francisco, CA: WestEd.
Wiley, T. G., & Wright, W. E. (2004). Against the undertow: Language-minority policy and politics in the ‘age of accountability’. Educational Policy, 18, 142–168.
Wong-Fillmore, L. (2007). English learners and mathematics learning: Language issues to consider. Assessing Mathematical Proficiency, 53, 333–344.
Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17, 89–100.
Acknowledgments
We would like to thank Jerome Shaw for comments on an earlier version of this manuscript and Jenna Krueger and Emily Lloyd for transcription and research assistance through the College of Education honors program. Also, we are grateful to the students and teachers of the participating schools. Partial funding was provided by MU Research Council and Sandra K. Abell’s MU Science Education Center.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1
Please note that not all aspects of the assessments (e.g., table numbering) could be reproduced due to journal style requirements. Correct versions are available on the first author's web site.
Version A
QUESTION 1:
NGSS: MS-LS1-3, DCI: LS1.A, CC: Structure and function
Imagine taking a bite of food. Follow the food through the digestive system, explaining where the food goes, what organs are involved, and what is taking place as it moves along.
QUESTION 2:
NGSS: MS-LS1-3, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, CC: Cause and Effect, Structure and Function
Rita felt sick and went to the clinic. Her doctor said she had a bacterial infection and gave Rita a prescription for antibiotics. She was told to take the antibiotics for 10 days. Rita took the antibiotics for 3 days and now feels completely better. The antibiotics upset Rita’s stomach, so she wants to stop taking them.
-
A.
What are some good and bad things about stopping the full course of antibiotics? What are some good and bad things about continuing to take the full course of antibiotics? Write your answers in the table:
-
B.
If Rita stops taking the antibiotics, what effect could it have on the bacteria causing Rita’s infection? Be sure to discuss the scientific principles that explain this effect.
-
C.
Should Rita stop taking the antibiotics? Decide yes or no, and explain your decision. Be sure to include any trade-offs involved.
QUESTION 3:
NGSS: MS-LS1-3, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, CC: Cause and Effect, Science is a Human Endeavor
Joe has a cough that may be infectious. Should people with infectious diseases be quarantined from other people. Use the T-chart to organize your thoughts.
Should Joe be quarantined?
QUESTION 4:
NGSS: MS-LS1-3, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, Planning and Carrying out Investigations, CC: Cause and Effect, Science is a Human Endeavor
A drug company developed a new medicine to cure coughs. Scientists performed a trial of this medicine to test how effective the new medicine is in curing coughs.
At the end of 1 week, the scientists asked the patient Fernando
-
Is your cough better, the same, or worse?
-
Do you have any side effects, such as dizziness or upset stomach?
Table 4 gives the results.
-
A.
Why did group B get syrup without cough medicine?
-
B.
Compare the two groups. How well does the new medicine work in curing coughs? Be sure to use data from Table 4 in your answer.
-
C.
What are some good and bad things about the new medicine? Write these in Table 6. Be sure to use results from Tables 4 and 5 in your answer.
-
D.
Even though there are side effects, would you buy this medicine? Explain why and be sure to include the trade-offs.
QUESTION 5:
NGSS: DCI: LS1.B, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, Planning and Carrying out Investigations, CC: Cause and Effect, Science is a Human Endeavor, Common Core: Write Arguments focused on Discipline Content
Joe’s mom had a serious heart problem that doctors now think may have been caused by a genetic disease.
-
A.
Can you catch genetic diseases from other people the same way you can catch the flu? Explain.
-
B.
Should Joe be tested for the genetic disease his mother may have?
Give reasons for testing and against testing:
Should Joe be tested? __________
-
C.
Pretend you are Joe’s friend. Write a letter to Joe telling him whether you think he should be tested. Be sure to include both sides of the issue.
QUESTION 6:
NGSS: MS-LS2-1, MS-LS2-2, MS-LS2-4, MS-LS2-5, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, CC: Cause and Effect, Science is a Human Endeavor
Zebra Mussels are an introduced species that have invaded US lakes and rivers. These mussels normally live in Russia. These small mussels can grow on almost any surface. Scientists believe that some of these mussels attached to the bottom of boats and anchors bringing them to Missouri. Zebra Mussels cause problems because they out compete our native mussels for food. They are so sharp that they can cause beaches to be too dangerous to swim in without shoes. These mussels can also grow so closely together that they often block off pipelines preventing cities from accessing water and limiting hydroelectric power generation.
-
A.
Describe the impact of Zebra Mussels on Missouri ecosystems in terms of competition and the mussels’ effects on man-made structures.
-
B.
How do you think these mussels may affect fisheries in the area?
-
C.
Considering what you know about how zebra mussels can spread, how would you plan to limit the spread of zebra mussels to new lakes and rivers? What steps might you suggest scientists take to begin permanently removing these mussels from the ecosystem?
Version B
QUESTION 1:
NGSS: MS-LS1-3, DCI: LS1.A, CC: Structure and function
Imagine that you have just taken a bite of lunch. Label a diagram or chart of the path that the food takes as it moves through the digestive system, using the words provided. Briefly tell what happens to the food as it passes through each organ.
QUESTION 2:
NGSS: MS-LS1-3, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, CC: Cause and Effect, Structure and Function
Rita began taking a 10-day treatment of antibiotics 3 days ago. The antibiotics worked quickly, and Rita feels completely better after only 3 days. Antibiotics upset Rita’s stomach, so she wants to stop taking them.
Should Rita stop taking the antibiotics or finish the treatment? Explain the advantages and disadvantages of stopping and of continuing the antibiotics.
Be sure to include your final recommendation, any trade-offs involved, and your reasons for your decision.
QUESTION 3:
NGSS: MS-LS1-3, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, CC: Cause and Effect, Science is a Human Endeavor
Joe has a cough that may be infectious. Should people with infectious diseases be quarantined from other people. Use the T-chart to organize your thoughts.
Should Joe be quarantined?
QUESTION 4:
NGSS: MS-LS1-3, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, Planning and Carrying out Investigations, CC: Cause and Effect, Science is a Human Endeavor
Scientists have performed a trial of a new cough medicine. They divided a group of patients with a bad cough into two similar groups. Each group included males and females and people of different ages. Group A received cough syrup. Group B received plain syrup that did not contain any cough medicine. Every day for 4 days, the scientists interviewed the patients to find out whether their coughs were as frequent and as serious. They also asked the patients if they had any new health problems while taking the medicine. The following table summarizes the data.
Table
Group | Total number of patients | Number who feel better | Number who feel the same | Number who feel worse | Number with side effects (dizziness and upset stomach) |
---|---|---|---|---|---|
A (cough syrup) | 50 | 40 | 5 | 5 | 10 |
B (plain syrup) | 50 | 20 | 25 | 5 | 2 |
-
A.
Analyze the data to form a conclusion about how well the medicine works.
-
B.
Should the cough medicine be sold? Be sure to include the advantages and disadvantages of BOTH choosing to sell and choosing not to sell the medicine. Explain the trade-offs of your final decision.
QUESTION 5:
NGSS: DCI: LS1.B, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, Planning and Carrying out Investigations, CC: Cause and Effect, Science is a Human Endeavor, Common Core: Write Arguments focused on Discipline Content
Joe’s mom had a serious heart problem that doctors now think may have been caused by a genetic disease.
-
A.
Can you catch genetic diseases from other people the same way you can catch the flu? Explain.
Answer: __________
Explain:
-
B.
Should Joe be tested for the disease his mother may have? Give reasons for testing and against testing and then make a decision.
Should Joe be tested? __________
Reasons
-
C.
Pretend you are Joe’s friend. Write a letter to Joe telling him whether you think he should be tested. Be sure to include both sides of the issue.
Dear Joe,
I think that you [insert opinion] be tested for a genetic disease. I believe this because [insert reasons that support your opinion]. Although there are other reasons to consider, like [insert reasons that are against your opinion]. I still feel that you [insert opinion].
Sincerely,
[Insert your name]
QUESTION 6:
NGSS: MS-LS2-1, MS-LS2-2, MS-LS2-4, MS-LS2-5, SEP: Engaging in Argument from Evidence, Constructing Explanations and Designing Solutions, CC: Cause and Effect, Science is a Human Endeavor
Zebra Mussels are an introduced species that have invaded US lakes and rivers. These mussels normally live in Russia. These small mussels can grow on almost any surface. Scientists believe that some of these mussels attached to the bottom of boats and anchors bringing them to Missouri. Zebra Mussels cause problems because they out compete our native mussels for food. They are so sharp that they can cause beaches to be too dangerous to swim in without shoes. These mussels can also grow so closely together that they often block off pipelines preventing cities from accessing water and limiting hydroelectric power generation.
-
A.
What has been the impact of the zebra mussel on ecosystems in Missouri in terms of the following:
-
Competition with other mussel species
-
Effects on man-made structures and equipment (dams, boats, etc.)
-
-
B.
How do you think these mussels may affect fisheries in the area?
-
C.
Considering what you know about how zebra mussels can spread, how would you plan to limit the spread of zebra mussel to new lakes and rivers? What steps might you suggest scientists take to begin permanently removing these mussels from the ecosystem?
Appendix 2
Description of modifications by question
Question | Version A | Version B | Modification |
---|---|---|---|
1 | Modified | Reduction of words; addition of visual support | |
2 | Modified | Matching the language of instruction more precisely; linguistic simplification of vocabulary and syntax; Addition of graphic organizer; Breaking of question into parts | |
3 | Same | Same | Graphic organizer |
4 | Modified | Reductions of words in the item stem; addition of visual supports; matching the language within the item more precisely; reduction of non essential information; replacing sentences with bulleted lists; linguistic simplification of vocabulary and syntax; use of bold type for emphasis; addition of graphic organizer | |
5 | Modified | Addition of graphic organizer; linguistic simplification; detailed guide/framework to support answering; matching the language within the item more precisely | |
6 | Modified | Addition of visual support; brief note describing each visual support; reduction of words in the item stem; replacing a long question with two simple questions |
About this article
Cite this article
Siegel, M.A., Menon, D., Sinha, S. et al. Equitable Written Assessments for English Language Learners: How Scaffolding Helps. J Sci Teacher Educ 25, 681–708 (2014). https://doi.org/10.1007/s10972-014-9392-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10972-014-9392-1