Skip to main content

Improving the Equity and Validity of Assessment-based Information Systems

  • Chapter
Measuring Up

Part of the book series: Evaluation in Education and Human Services ((EEHS,volume 48))

Abstract

This chapter focuses on issues of validity and equity of assessments as they guide educational policies and practices for the education of limited English proficient students. Although estimates of the number of students who are English language learners (ELLS) vary, from self-reports in the 1990 census (U.S. Bureau of the Census, 1990) to surveys conducted of school districts (Fleischman & Hopstock, 1993), their proportion is rising and may reach 10% by the end of the century. Although Spanish is the primary language for about three fourths of these students, Asian group languages — Vietnamese, Hmong, Cantonese, Cambodian, Tagalog, Laotian and Korean — are represented in large numbers. Navajo and Russian are also significantly represented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Abedi, J. (1994). Language background as a variable in NAEP Mathematics performance: NAEP TRP Task 3d: Language background study. Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

    Google Scholar 

  • Anderson, T. H. (1979). Study skills and learning strategies. In H. F. O’Neil. Jr., & C. D. Spielberger (Eds.), Cognitive and affective learning strategies. New York: Academic.

    Google Scholar 

  • Anderson, J. R. (1984). Spreading activation. In J. R. Anderson & S. M. Kosslyn (Eds.), Essays in learning and memory. New York: W. H. Freeman & Company.

    Google Scholar 

  • Anderson, T. H., & Armbruster, B. B. (1981). Studying. In P. D. Pearson (Ed.), Handbook on reading research. New York: Longman.

    Google Scholar 

  • Ascher, C. (1991). Testing bilingual students: Do we speak the same language? PTA Today, March.

    Google Scholar 

  • Baker, E. L., Niemi, D., Gearhart, M., & Herman, J. (1990). Validating a hypermedia model of knowledge representation. Paper presented at the annual meeting of the American Educational Research Association, Boston.

    Google Scholar 

  • Baker, E. L., & O’Neil, Jr., H. F. (1996). Performance assessment and equity: A view from the USA. [CD-ROM]. CRESST: 5 Years of Research. Los Angeles: University of California, Center for the Research on Evaluation, Standards, and Student Testing.

    Google Scholar 

  • Bartlett, F. C. (1932). Remembering: A study in experimental and social psychology. New York: Cambridge University.

    Google Scholar 

  • Bond, L. A., Council of Chief State School Officers, & North Central Regional Educational Laboratory. (1996). Statewide assessment of students with disabilities. Oak Brook, IL: North Central Regional Educational Laboratory.

    Google Scholar 

  • Brewer, W. F., & Nakamura, G. V. (1984). The nature and function of Schemas (Tech. Rep. No. 325). Cambridge, MA: Bolt, Beranek and Newman. (ERIC Document Reproduction Service No. ED 248291)

    Google Scholar 

  • Brown, A. L., Kane, M. J., & Echols, C. H. (1986). Young children’s mental models determine analogical transfer across problems with a common goal structure. Cognitive Development, 1(2), 103–121.

    Article  Google Scholar 

  • Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4,55–81.

    Article  Google Scholar 

  • Cheung, O., Clements, B., & Miu, Y. C. (1994). The feasibility of collecting comparable national statistics about students with LEP. Washington, DC: National Center for Education Statistics.

    Google Scholar 

  • Chi, M. T. (1985). Interactive roles of knowledge and strategies in the development of organized sorting and recall. In S. F. Chipman, J. W. Segal, & R. Glaser (Eds.), Thinking and learning skills, Volume 2: Research and open questions. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Chi, M. T., & Ceci, S. J. (1987). Content knowledge: Its role, representation. and restructuring in memory development. Advances in Child Development and behavior, 20, 91–143.

    Article  Google Scholar 

  • Chi, M. T., & Glaser, R. (1983). The measurement of expertise: Analysis of the development of knowledge and skill as a basis for assessing achievement. In E. L. Baker, & E. S. Quellmalz (Eds.), Educational testing and evaluation: Design, analysis, and policy. Beverly Hills, CA: Sage.

    Google Scholar 

  • Chi, M. T., Glaser, R., & Farr, M. J. (1988). The nature of expertise. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Chi, M. T., & Koeske, R. D. (1983). Network representation of a child’s dinosaur knowledge. Developmental Psychology, 19(1), 29–39.

    Article  Google Scholar 

  • Collier, V. P. (1987). Age and rate of acquisition of second language for academic purposes. TESOL Quarterly, 21, 617–641.

    Article  Google Scholar 

  • Collier, V. P. (1989). How long? A synthesis of research on academic achievement in a second language. TESOL Quarterly, 23(3), 509–532.

    Article  Google Scholar 

  • Council of Chief State School Offices and North Central Regional Educational Laboratory. (1996). 1996 State student assessment programs database. Oak Brook, IL: North Central Regional Educational Laboratory.

    Google Scholar 

  • Cummins, J. (1980). Entry and exit fallacy in bilingual education. NABE Journal, 4(3), 25–59.

    Google Scholar 

  • Cummins, J. (1981). Age on arrival and immigrant second language learning in Canada: A reassessment. Applied Linguistics, 2, 132–149.

    Article  Google Scholar 

  • Cummins, J. (1994). Primary language instruction and the education of language minority students. In C. F. Leyba (Ed.), Schooling and language minority students: A theoretical approach. Sacramento, CA: Evaluation, Dissemination and Assessment Center, School of Education California State University, Los Angeles.

    Google Scholar 

  • Dansereau, D. F., & Holley, C. D. (1982). Development and evaluation of a text mapping strategy. In A. Flammer & W. Kintsch (Eds.), Discourse processing: Amsterdam: North Holland.

    Google Scholar 

  • Diekhoff, G. M. (1983). Testing through relationship judgments. Journal of Educational Psychology, 75, 227–233.

    Article  Google Scholar 

  • Elementary and Secondary Education Act of 1965., 20 U.S.C. §§ 236 et seq., 821 et seq.

    Google Scholar 

  • Exec. Order No. 12866, 34 C. F. R. 200, 201, 203, 205, and 212 (1995).

    Google Scholar 

  • Figueroa, R. A. (1990). Assessment of linguistic minority group children. In C. R. Reynolds & R. W. Kamphaus (Eds.), Handbook of psychological and educational assessment of children: Intelligence and achievement. New York: Guilford.

    Google Scholar 

  • Fleischman, H. L., & Hopstock, P. J. (1993). Descriptive study of services to limited English proficient students, Volume 1: Summary of findings and conclusions. Arlington, VA: Development Associates, Inc.

    Google Scholar 

  • Glaser, R. (1984). Education and thinking: The role of knowledge. American Psychologist, 30, 93–104.

    Article  Google Scholar 

  • Gonzalez, L. A. (1986). The effects of first language education on the second language and academic achievement of Mexican immigrant elementary school children in the United states. Doctoral dissertation submitted to the University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Haertel, E. H., & Linn, R. L. (1996). Comparability. In G. W. Phillips (Ed.), Technical issues in largescale performance assessment (pp. 59–78). Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement.

    Google Scholar 

  • Hamer, A. L., & Ulanoff, S. H. (1994). Validity issues and concerns for assessing English learners: One district’s approach. Education-and-Urban-Society. 26(4), 367–389.

    Article  Google Scholar 

  • Herl, H. E., Niemi, D., & Baker, E. L. (1996). Construct validation of an approach to modeling cognitive structure of experts’ and novices’ U.S. history knowledge. Journal of Educational Research, 89(4), 206–218.

    Article  Google Scholar 

  • Holyoak, K. J., Junn, E. N., & Billman, D. O. (1984). Development of analogical problem solving skill. Child Development, 55(6), 2042–2055.

    Article  Google Scholar 

  • Horton, K. J., McCormey, A. A., Gallo, M., Woods, A. L., Sam, G. J., & Hamelin, D. (1993). An investigation of the effectiveness of concept mapping as an instructional tool. Science Education, 77(1), 95–111.

    Article  Google Scholar 

  • Hopstock, P. J., & Bucaro, B. J. (1993). A review and analysis of estimates of the LEP student population. Arlington, VA: Development Associates, Special Issues Analysis Center.

    Google Scholar 

  • Improving America’s Schools Act of 1994, Pub. L. No. 103-382, 108 Stat. 3518 (1994).

    Google Scholar 

  • Jonassen, D. H., Beissner, K., & Yacci, M. (1993). Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • LaCelle-Peterson, M. W. & Rivera, C. (1994). Is it real for all kids? A framework for equitable assessment: Policies for English language learners. Harvard Educational Review, 64(1), 55–75.

    Google Scholar 

  • Lambiotte, J. G., & Dansereau, D. F. (1991). Effects of knowledge maps and prior knowledge on recall of science lecture content. Journal of Experimental Education, 60(3), 189–201.

    Article  Google Scholar 

  • Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance assessment: Expectations and validation criteria. Educational Researcher 20(8), 15–21.

    Google Scholar 

  • Lomask, M., Baron, J., Greig, J., & Harrison, C. (1992). ConnMap: Connecticut’s use of concept mapping to assess the structure of students’ knowledge of science. Symposium presented at the annual meeting of the National Research in Science Teaching; Cambridge, Massachusetts.

    Google Scholar 

  • Mayer, R. E. (1984). Aids to prose comprehension. Educational Psychologist, 19(1), 30–42.

    Article  Google Scholar 

  • National Center on Educational Outcomes. (1995). Compilation of state’s guidelines for accommodations in assessments for students with disabilities (Synthesis Report 18). Minneapolis, MN: Author.

    Google Scholar 

  • Norman, D. A. (1988). The psychology of everyday things. New York: Basic Books.

    Google Scholar 

  • Novak, J. D. (1995). Concept mapping: A strategy for organizing knowledge. In S. M. Glynn & R. Duit, (Eds.), Learning science in the schools: Research reforming practice. (p. 229–245). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Oakes, J. (1990). Multiplying inequalities: The effects of race, social class, and tracking on opportunities to learn mathematics and science. Santa Monica, CA: Academic.

    Google Scholar 

  • Olson, J. F., & Goldstein, A. A. (1997). The inclusion of students with disabilities and limited English proficient students in large-scale assessments. Washington, DC: U.S. Government Printing, Office.

    Google Scholar 

  • Pierce, L. V., & O’Malley, J. M. (1992). Performance and portfolio assessment for language minority students. NCBE Program Information Guide Series, 9.

    Google Scholar 

  • Royer, J. M., Cisero, C. A., & Carlo, M. S. (1993). Techniques and procedures for assessing cognitive skills. Review of Educational Research, 63(2), 201–243.

    Google Scholar 

  • Rosebery, A. S., Warren, B., & Conant F. R. (1992). Appropriating scientific discourse: Finding from language minority classrooms. The Journal of the Learning Sciences, 2(1), 61–94.

    Article  Google Scholar 

  • Ruiz-Primo, M., Schultz, S. E., & Shavelson, R. J. (1996). Concept map-based assessments in science: Two exploratory studies (CRESST deliverable to OERI). Los Angeles: University of California, Center for the Research on Evaluation, Standards, and Student Testing.

    Google Scholar 

  • Rumelhart, D. E. (1980). Schemata: The building blocks of cognition. In R. J. Spiro, B. C. Bruce, & W. F. Brewer (Eds.), Theoretical issues in reading comprehension (pp. 33–58). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Rumelhart, D. E., & Norman, D. A. (1981). Analogical processes in learning. In J. R. Anderson (Ed.), Cognitive skills and their acquisition. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Rumelhart, D. E., & Norman, D. A. (1988). Representation in memory. In R. C. Atkinson, R. J. Hernnstein, G. Lindzey, & R. Duncan Luce (Eds.), Stevens’ handbook of experimental psychology, Vol. 1: Perception and motivation; Vol. 2: Learning and cognition (2nd ed.) pp. 511–587. New York: John Wiley & Sons.

    Google Scholar 

  • Rumelhart, D. E., & Ortony, A. (1977)., The representation of knowledge in memory. In R. C. Anderson, R. J. Spiro, & W. E. Montague (Eds.), Schooling and the acquisition of knowledge. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Saville-Troike, M. (1991). Teaching and testing for academic achievement: The role of language development. NCBE Focus: Occasional papers in bilingual education. 4.

    Google Scholar 

  • Seel, N. M. (1995). Mental models, knowledge transfer, and teaching strategies. Journal of Structural Learning, 12(3), 197–213.

    Google Scholar 

  • Shavelson, R. J., Lang, H., & Lewin, B. (1994). On concept maps as potential authentic assessments in science (CSE Technical Report 388). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing

    Google Scholar 

  • Short, D. J. (1993). Assessing integrated language and content instruction. TESOL Quarterly, 27(4), 627–656.

    Article  Google Scholar 

  • Stanovich, K. E. (1991). Discrepancy definitions of reading disability: Has intelligence led us astray? Reading Research Quarterly, 26(1), 7–29.

    Article  Google Scholar 

  • U.S. Bureau of the Census. (1990). The foreign born population in the United States. Washington, DC: U.S. Government Printing Office.

    Google Scholar 

  • Valdes, G., & Figueroa, R. A. (1995). Bilingualism and testing: A special case of bias. Norwood, NJ: Ablex.

    Google Scholar 

  • Wineburg, S. S. (1991a). On the reading of historical texts: Notes on the breach between school and academy. American Educational Research Journal, 28(3), 495–519.

    Google Scholar 

  • Wineburg, S. S. (1991b). Historical problem solving: A study of the cognitive processes used in the evaluation of documentary and pictorial evidence. Journal of Educational Psychology, 83(1), 73–87.

    Article  Google Scholar 

  • Wong-Fillmore, L. (1991). When learning a second language means losing the first. Early Childhood Research Quarterly, 6, 323–346.

    Article  Google Scholar 

  • Zehler, A. M., Hopstock, P. J., Fleischman, H. L., & Greniuk, C. (1994). An examination of assessment of limited English proficient students. Task Order Report No. D070, Special Issues Analysis Center.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer Science+Business Media New York

About this chapter

Cite this chapter

Aguirre-Muñoz, Z., Baker, E.L. (1999). Improving the Equity and Validity of Assessment-based Information Systems. In: Nettles, A.L., Nettles, M.T. (eds) Measuring Up. Evaluation in Education and Human Services, vol 48. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-4399-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-4399-8_7

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-5890-2

  • Online ISBN: 978-94-011-4399-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics