Abstract
Recent reforms in education call for science teachers to incorporate STEM concepts into their curricula. This study explores the association among student and teacher demographics, and student learning of engineering content and attitudes towards STEM after participation in an elementary or middle school engineering-based science curricula. Analysis of 732 students’ scores on engineering content knowledge assessment and STEM learning attitudes survey revealed several significant factors that influence students’ post-survey and assessment scores. Our analysis identified English language learner (ELL) status and special education (SPED) status as significant predictors for post-test scores at the elementary school level. At the middle school level, SPED status and ethnicity were found to have significant effects for students’ post-test scores. Student gender was found to be a significant predictor of student attitudes after taking the curriculum. Additionally, students who were taught by teachers that participated in two consecutive years of STEM professional development (PD) program had more positive attitudes towards engineering compared to students taught by teachers attending the PD program for only 1 year. These results suggest the ability of design-based science curricula to close the achievement and attitudinal gaps towards STEM in some student demographics. Additionally, our data revealed that continued PD can have positive effects on student attitudinal outcomes, suggesting long-term PD as an avenue to improve science education.
Similar content being viewed by others
References
Abedi, J. (2002). Standardized achievement tests and English language learners: Psychometrics issues. Educational Assessment, 8(3), 231–257.
American Educational Research Association. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
Authors. (2013).
Authors. (2014).
Authors. (2015).
Authors. (2016).
Authors. (2018a)a.
Authors. (2018b)b.
Azevedo, F. S., Martalock, P. L., & Keser, T. (2015). The discourse of design-based science classroom activities. Cultural Studies of Science Education, 10(2), 285–315. https://doi.org/10.1007/s11422-013-9540-5.
Bacharach, V. R., Baumeister, A. A., & Furr, R. M. (2003). Racial and gender science achievement gaps in secondary education. The Journal of genetic Psychology, 164(1), 115–126.
Barton, A. C., & Tan, E. (2010). We be burnin’! Agency, identity, and science learning. The Journal of the Learning Sciences, 19(2), 187–229.
Berland, L., Steingut, R., & Ko, P. (2014). High school student perceptions of the utility of the engineering design process: creating opportunities to engage in engineering practices and apply math and science content. Journal of Science Education and Technology, 23(6), 705–720. https://doi.org/10.1007/s10956-014-9498-4.
Besterfield-Sacre, M., Moreno, M., Shuman, L. J., & Atman, C. J. (2001). Gender and ethnicity differences in freshmen engineering student attitudes: a cross-institutional study. Journal of engineering Education, 90(4), 477–489.
Brophy, S., Klein, S., Portsmore, M., & Rogers, C. (2008). Advancing engineering education in K-12 classrooms. Journal of Engineering Education, 97(3), 369–387.
Capobianco, B. M., Diefes-Dux, H. A., Mena, I., & Weller, J. (2011). What is an engineer? Implications of elementary school student conceptions for engineering education. Journal of Engineering Education, 100(2), 304–328.
Carlson, L. E., & Sullivan, J. F. (1999). Exploiting design to inspire interest in engineering across K-16 curriculum. International Journal of Engineering Education, 20(3), 372–380.
Catsambis, S. (1995). Gender, race, ethnicity, and science education in the middle grades. Journal of Research in Science Teaching, 32(3), 243–257.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
Desimone, L., Smith, T. M., & Phillips, K. (2013). Linking student achievement growth to professional development participation and changes in instruction: a longitudinal study of elementary students and teachers in title I schools. Teachers College Record, 115(5), 1–46.
Dimitrov, D. M., & Rumrill Jr., P. D. (2003). Pretest-posttest designs and measurement of change. Work, 20(2), 159–165.
Dugard, P., & Todman, J. (2006). Analysis of pre-test post-test control group designs in educational research. Educational Psychology, 15(2), 181–198.
Eddy, S. L., & Brownell, S. E. (2016). Beneath the numbers: a review of gender disparities in undergraduate education across science, technology, engineering, and math disciplines. Physical Review Physics Education Research, 12(2), 020106.
Else-Quest, N. M., Hyde, J. S., & Linn, M. C. (2010). Cross-national patterns of gender differences in mathematics: a meta-analysis. Psychological Bulletin, 136(1), 103–127.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: Lawrence Erlbaum.
Felder, R. M., Felder, G. N., Mauney, M., Hamrin, C. E., & Dietz, E. J. (1995). A longitudinal study of engineering student performance and retention. III. Gender differences in student performance and attitudes. Journal of Engineering Education, 84(2), 151–163.
Ganley, C. M., & Vasilyeva, M. (2011). Sex differences in the relation between math performance, spatial skills, and attitudes. Journal of Applied Developmental Psychology, 32(4), 235–242.
Garcia, G. E. (1991). Factors influencing the English reading test performance of Spanish-speaking Hispanic children. Reading Research Quarterly, 26(4), 371–392.
Greenfield, T. A. (1996). Gender, ethnicity, science achievement, and attitudes. Journal of Research in Science Teaching, 33(8), 901–933.
Haberman, M. (2010). The pedagogy of poverty versus good teaching. Phi Delta Kappan, 92(2), 81–87.
Horn, C. (2003). High-stakes testing and students: stopping or perpetuating a cycle of failure? Theory Into Practice, 42(1), 30–41.
Hyde, J. S., Lindberg, S. M., Linn, M. C., Ellis, A. B., & Williams, C. C. (2008). Gender similarities characterize math performance. Science, 321(5888), 494–495.
Jacobs, J. E., Lanza, S., Osgood, D. W., Eccles, J. S., & Wigfield, A. (2002). Changes in children’s self-competence and values: gender and domain differences across grades one through twelve. Child Development, 73(2), 509–527.
Jayaratne, T. E., Thomas, N. G., & Trautmann, M. (2003). Intervention program to keep girls in the science pipeline: outcome differences by ethnic status. Journal of Research in Science Teaching, 40(4), 393–414.
Kolbe, T., & Jorgenson, S. (2018). Meeting instructional standards for middle-level science: which teachers are most prepared? The Elementary School Journal, 118(4), 549–577.
Kutaka, T. S., Smith, W. M., Albano, A. D., Edwards, C. P., Ren, L., Beattie, H. L., et al. (2017). Connecting teacher professional development and student mathematics achievement: a 4-year study of an elementary mathematics specialist program. Journal of Teacher Education, 68(2), 140–154.
Lachapelle, C., & Cunningham, C. (2014). Engineering in elementary schools. In S. Purzer, J. Strobel, & M. Cardella (Eds.), Engineering in pre-college settings: synthesizing research, policy, and practices (pp. 61–88). West Lafayette: Purdue University Press.
Lachapelle, C. P., Cunningham, C. M., Jocz, J., Kay, A. E., Phadnis, P., Wertheimer, J., & Arteaga, R. (2011). Engineering is elementary: an evaluation of years 4 through 6 field testing. Boston: Museum of Science.
Lee, J. (2002). Racial and ethnic achievement gap trends: reversing the progress toward equity? Educational researcher, 31(1), 3–12.
Li, Q. (1999). Teachers’ beliefs and gender differences in mathematics: a review. Educational Research, 41(1), 63–76.
Lindberg, S. M., Hyde, J. S., Petersen, J. L., & Linn, M. C. (2010). New trends in gender and mathematics performance: a meta-analysis.
Liu, O. L., Lee, H. S., & Linn, M. C. (2010). Multifaceted assessment of inquiry-based science learning. Educational Assessment, 15(2), 69–86.
Madaus, G. F., & Clarke, M. (2001). The adverse impact of high stakes testing on minority students: evidence from 100 years of test data.
Maerten-Rivera, J., Myers, N., Lee, O., & Penfield, R. (2010). Student and school predictors of high-stakes assessment in science. Science Education, 94(6), 937–962.
Marulcu, I. (2014). Teaching habitat and animal classification to fourth graders using an engineering-design model. Research in Science & Technological Education, 32(2), 135–161.
Marulcu, I., & Barnett, M. (2013). Fifth graders’ learning about simple machines through engineering design-based instruction using LEGO™ materials. Research in Science Education, 43(5), 1825–1850.
McFadden, J., & Roehrig, G. (2018). Engineering design in the elementary science classroom: supporting student discourse during an engineering design challenge. International Journal of Technology and Design Education, 1–32.
Mehalik, M., Doppelt, Y., & Schuun, C. (2008). Middle school science through design-based learning versus scripted inquiry: better overall science concept learning and equity gap reduction. Journal of Engineering Education, 97(1), 71–85.
Miller, M. C. (1966). Simultaneous statistical inference. New York: McGraw-Hill.
Moreno, M., Besterfield-Sacre, M., Shuman, L. J., Wolfe, H., & Atman, C. J. (2000). Self-assessed confidence in EC-2000 outcomes: a study of gender and ethnicity differences across institutions. In Frontiers in education conference, 2000. FIE 2000. 30th Annual (Vol. 1, pp. T1A-23). IEEE.
Mwamwenda, T. S., & Mwamwenda, B. B. (1989). Teacher characteristics and pupils’ academic achievement in Botswana primary education. International Journal of Educational Development, 9(1), 31–42.
National Academies of Sciences, Engineering, and Medicine (2016). Barriers and opportunities for 2-year and 4-year STEM degrees: systemic change to support students’ diverse pathways. National Academies Press.
National Academy of Engineering (2008). Changing the conversation: messages for improving public understanding of engineering. Washington, DC.
National Academy of Engineering and National Research Council. (2009). Engineering in K-12 education: understanding the status and improving the prospects. Washington, DC: The National Academies.
National Academy of Engineering and National Research Council. (2014). STEM integration in K-12 education: status, prospects, and an agenda for research. Washington, DC: The National Academies Press.
National Academy of Science (2011). Expanding underrepresented minority participation, Washington, DC: National Academies Press. www.nap.edu/catalog.php?record_id=12984#toc (accessed 12 July 2017).
National Science Board. (2003). The science and engineering workforce: realizing America’s potential. Arlington, VA: National Science Foundation.
Nelson, T., Lesseig, K., Slavit, D., Kennedy, C., & Seidel, R. (2015). Supporting middle school teachers implementation of STEM design challenges. Paper presented at NARST conference, Chicago, IL.
NGSS Lead States. (2013). Next generation science standards: for states, by states. Washington, DC: The National Academies Press.
Osborne, J. F., Simon, S., & Collins, S. (2003). Attitudes towards science: a review of the literature and its implications. Int J Sci Educ, 25(9), 1049–1079.
Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: an integrated analysis. J Econ, 22, 229–243.
Petty, T., Wang, C., & Harbaugh, A. P. (2013). Relationships between student, teacher, and school characteristics and mathematics achievement. Sch Sci Math, 113(7), 333–344.
Pisa, O. E. C. D. (2009). Results: what students know and can do. Mathematics and Science: Student Performance in Reading.
President’s Council of Advisors on Science and Technology. (2012). Engage to Excel: producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Retrieved from http://www.whitehouse.gov/administration/eop/ostp/ pcast/docsreports
Quinn, D. M., & Cooc, N. (2015). Science achievement gaps by gender and race/ethnicity in elementary and middle school. Educ Res, 44(6), 336–346.
Reilly, D., Neumann, D. L., & Andrews, G. (2015). Sex differences in mathematics and science achievement: a meta-analysis of National Assessment of Educational Progress assessments.
Riskowski, J. L., Todd, C. D., Wee, B., Dark, M., & Harbor, J. (2009). Exploring the effectiveness of an interdisciplinary water resources engineering module in an eighth grade science course. Int J Eng Educ, 25(1), 181–195.
Roth, W. (1996). Art and artifact of children’s designing: a situated cognition perspective. J Learn Sci, 5(2), 129–166.
Ryan, J. W. (1974). Educational resources and scholastic outcomes: a study of rural primary schooling in Iran. ProQuest Information & Learning: Doctoral dissertation.
Saha, L. J. (1983). Social structure and teacher effects on academic achievement: a comparative analysis. Comp Educ Rev, 27(1), 69–88.
Silk, E. M., Schunn, C. D., & Cary, M. S. (2009). The impact of an engineering design curriculum on science reasoning in an urban setting. J Sci Educ Technol, 18(3), 209–223.
Simpson, R. D., & Oliver, S. J. (1990). A summary of major influences on attitude toward and achievement in science among adolescent students. Sci Educ, 74(1), 1–18.
Solano-Flores, G. (2008). Who is given tests in what language by whom, when, and where? The need for probabilistic views of language in the testing of English language learners. Educ Res, 37(4), 189–199.
Soper D (2015) The free statistics calculators website (v.3.0). Retrived from http://www.danielsoper.com/statcalc3/. Accessed 1 Aug 2017
Thadani, V., Cook, M. S., Griffis, K., Wise, J. A., & Blakey, A. (2010). The possibilities and limitations of curriculum-based science inquiry interventions for challenging the “pedagogy of poverty”. Equity & Excellence in Education, 43(1), 21–37.
Thorndike-Christ, T. (1991). Attitudes toward mathematics: relationships to mathematics achievement, gender, mathematics course-taking plans, and career interests.
Warwick, D. P., & Jatoi, H. (1994). Teacher gender and student achievement in Pakistan. Comp Educ Rev, 38(3), 377–399.
Weinburgh, M. (1995). Gender differences in student attitudes toward science: a meta-analysis of the literature from 1970 to 1991. J Res Sci Teach, 32(4), 387–398.
Weisgram, E. S., & Bigler, R. S. (2007). Effects of learning about gender discrimination on adolescent girls' attitudes toward and interest in science. Psychology of Women Quarterly, 31(3), 262-269
Wendell, K., & Rogers, C. (2013). Engineering design-based science, science content performance, and science attitudes in elementary school. J Eng Educ, 102(4), 513–540.
Wigfield, A., Eccles, J. S., Mac Iver, D., Reuman, D. A., & Midgley, C. (1991). Transitions during early adolescence: changes in children’s domain-specific self-perceptions and general self-esteem across the transition to junior high school. Dev Psychol, 27(4), 552–565.
Funding
This study was funded by the National Science Foundation (Award #1238140).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Human and Animal Rights
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Rights and permissions
About this article
Cite this article
Lie, R., Selcen Guzey, S. & Moore, T.J. Implementing Engineering in Diverse Upper Elementary and Middle School Science Classrooms: Student Learning and Attitudes. J Sci Educ Technol 28, 104–117 (2019). https://doi.org/10.1007/s10956-018-9751-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10956-018-9751-3