Skip to main content
SpringerLink
Log in

Comparing Self-Reported and Performance-Based Online Feedback on Early Childhood Teachers’ Implementation of Language Strategies

  • Published:
Early Childhood Education Journal Aims and scope Submit manuscript

Abstract

This professional development (PD) study examined the effect of feedback type on changing preschool teachers’ use of language enhancement strategies and language outcomes for children. We included 21 Head Start teachers and 107 children. We randomized classrooms to PD feedback condition: (a) self-reported or (b) observed use of strategies. All teachers completed online learning modules on language enhancement strategies (i.e. open-ended questions, self-talk, repetition, expansion, and narration) and teacher self-monitoring. After completing the PD, teachers were provided weekly, individualized feedback based on their submissions of: (a) self-reported, or (b) observed performance (via 10-min video) of their use of language enhancement strategies. Results suggested that the PD experience (less than 8 weeks, 1 h per week) increased teachers’ frequency in using language enhancement strategies (performance, Hedges’ g = 0.65; self-report, Hedges’ g = 1.43) across condition, with no significant differences by condition. Additionally, children demonstrated mean gains in expressive vocabulary and overall language skills. We believe that this brief, but targeted PD experience, warrants further research to explore the impact of using self-reported feedback with a larger sample. Determining more efficient and effective PD approaches will enable the field to better meet the needs of teachers and improve outcomes for children.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Alicke, M. D., Klotz, M. L., Breitenbecher, D. L., Yurak, T. J., & Vredenburg, D. S. (1995). Personal contact, individuation, and the better-than-average effect. Journal of Personality and Social Psychology, 68(5), 804–825.

    Article  Google Scholar 

  • Anderson, T. (2003). Getting the mix right again: An updated and theoretical rationale for interaction. The International Review of Research in Open and Distance Learning, 4(2), 1–18.

    Article  Google Scholar 

  • Artman-Meeker, K. M., & Hemmeter, M. L. (2013). Effects of training and feedback on teachers’ use of classroom preventive practices. Topics in Early Childhood Special Education, 33, 112–123.

    Article  Google Scholar 

  • Barton, E. E., Pribble, L., & Chen, C. (2014). The use of e-mail to deliver performance-based feedback to early childhood practitioners. Journal of Early Intervention, 35(3), 270–297.

    Article  Google Scholar 

  • Berkel, C., Mauricio, A., Schoenfelder, E., & Sandler, I. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 22–33.

    Article  Google Scholar 

  • Dede, C., Ketelhut, D. J., Whitehouse, P., Breit, L., & McCloskey, E. M. (2009). A research agenda for online teacher professional development. Journal of Teacher Education, 60, 8–19.

    Article  Google Scholar 

  • Desimone, L. M. (2009). Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Education and Educational Research, 88, 181–199.

    Article  Google Scholar 

  • Dickinson, D. K., & Caswell, L. (2007). Building support for language and early literacy in preschool classrooms through in-service professional development: Effects of the Literacy Environment Enrichment Program (LEEP). Early Childhood Research Quarterly, 22, 243–260.

    Article  Google Scholar 

  • Early, D. M., Bryant, D. M., Pianta, R. C., Clifford, R. M., Burchinal, M. R., Ritchie, S., … Barbarin, O. (2006). Are teachers’ education, major, and credentials related to classroom quality and children’s academic gains in pre-kindergarten? Early Childhood Research Quarterly, 21, 174–195.

    Article  Google Scholar 

  • Fallon, L. M., Collier-Meek, M. A., Maggin, D. M., Sanetti, L. M. H., & Johnson, A. H. (2015). Is Performance feedback for educators an evidence-based practice? A systematic review and evaluation based on single-case research. Exceptional Children, 81, 227–246.

    Google Scholar 

  • Feingold, A. (2009). Effect sizes for growth-modeling analysis for controlled clinical trials in the same metric as for classical analysis. Psychological Methods, 14(1), 43–53.

    Article  Google Scholar 

  • Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38, 915–945.

    Article  Google Scholar 

  • Gast, D. L. (2010). Single subject research methodology in behavioral sciences. New York: Routledge.

    Google Scholar 

  • Girolametto, L., & Weitzman, E. (2002). Responsiveness of child care providers in interactions with toddlers and preschoolers. Language, Speech, and Hearing Services in Schools, 33, 268–281.

    Article  Google Scholar 

  • Girolametto, L., Weitzman, E., & Greenberg, J. (2006). Facilitating language skills: In-service education for early childhood educators and preschool teachers. Infants and Young Children, 19, 36–48.

    Article  Google Scholar 

  • Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327.

    Article  Google Scholar 

  • Harms, T., & Clifford, R. (1980). Early childhood environment rating scale (ECERS). New York, NY: Teacher’s College Press.

    Google Scholar 

  • Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore, MD: Brookes.

    Google Scholar 

  • Hedges, L., & Olkin, I. (1985). Statistical models for meta-analysis. San Diego: Academic Press.

    Google Scholar 

  • Hemmeter, M. L., Snyder, P., Kinder, K., & Artman, K. (2011). Impact of performance feedback delivered via electronic mail on preschool teachers’ use of descriptive praise. Early Childhood Research Quarterly, 26, 96–109.

    Article  Google Scholar 

  • Hendricks, G. C., Thoresen, C. E., & Hubbard, D. R. (1974). Effects of behavioral self observation on elementary teachers and students. Stanford Center for Research and Development, Memorandum No. 121.

  • Higgins, E. T. (1989). Self-discrepancy theory: What patterns of self-beliefs cause people to suffer? Advances in experimental social psychology, 22, 93–136.

    Google Scholar 

  • Justice, L. M., Mashburn, A. J., Hamre, B. K., & Pianta, R. C. (2008). Quality of language and literacy instruction in preschool classrooms serving at-risk pupils. Early Childhood Research Quarterly, 23, 51–68.

    Article  Google Scholar 

  • Lambert, R. G., Kim, D. H., & Burts, D. C. (2015). The measurement properties of the Teaching Strategies GOLD® assessment system. Early Childhood Research Quarterly, 33, 49–63.

    Article  Google Scholar 

  • Maguire, M. C. (1999). Treating the dyad as the unit of analysis: A primer on three analytic approaches. Journal of Marriage and the Family, 61, 213–223.

    Article  Google Scholar 

  • McConnell, S., Bradfield, T., Wackerle-Hollman, A., & Rodriguez, M. (2012). Individual growth and development indicators of early literacy (IGDIs-EL) (2nd ed.). Saint Paul: Early Learning Labs, Inc.

    Google Scholar 

  • McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22, 276–282.

    Article  Google Scholar 

  • McNeish, D., & Stapleton, L. M. (2016). Modeling clustered data with very few clusters. Multivariate Behavioral Research, 51, 495–518.

    Article  Google Scholar 

  • NICHD Early Child Care Research Network. (2002). Early child care and children’s development prior to school entry: Results from the NICHD study of early child care. American Educational Research Journal, 39, 133–164.

    Article  Google Scholar 

  • Odom, S. L. (2009). The tie that binds: Evidence-based practice, implementation science and outcomes for children. Topics in Early Childhood Special Education, 29, 53–61.

    Article  Google Scholar 

  • Pellecchia, M., Connell, J. E., Eisenhart, D., Kane, M., Schoener, C., Turkel, K., … Mandell, D. S. (2011). We’re all in this together now: Group performance feedback to increase classroom team data collection. Journal of School Psychology, 49, 411–431.

    Article  Google Scholar 

  • Pianta, R. C., Mashburn, A. J., Downer, J. T., Hamre, B. K., & Justice, L. (2008). Effects of web-mediated professional development resources on teacher-child interactions in pre-kindergarten classrooms. Early Childhood Research Quarterly, 23, 431–451.

    Article  Google Scholar 

  • Piasta, S. B., Justice, L. M., Cabell, S. Q., Wiggins, A. K., Turnbull, K. P., & Curenton, S. M. (2012). Impact of professional development on preschool teachers’ conversational responsivity and children’s linguistic productivity and complexity. Early Childhood Research Quarterly, 27, 387–400.

    Article  Google Scholar 

  • Powell, D. R., Diamond, K. E., Burchinal, M. R., & Koehler, M. (2010). Effects of an early literacy professional development intervention on head start teachers and children. Journal of Educational Psychology, 102, 299–312.

    Article  Google Scholar 

  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (Vol. 1). Thousand Oaks: Sage.

    Google Scholar 

  • Reinke, W. M., Lewis-Palmer, T., & Martin, E. (2008). The effect of visual performance feedback on teacher use of behavior-specific praise. Behavior Modification, 31, 247–263.

    Article  Google Scholar 

  • Roberts, A. M., LoCasale-Crouch, J., DeCoster, J., Hamre, B. K., Downer, J. T., Williford, A. P., & Pianta, R. C. (2015). Individual and contextual factors associated with pre- kindergarten teachers: Responsiveness to the MyTeachingPartner coaching intervention. Prevention Science, 16, 1044–1053.

    Article  Google Scholar 

  • Ryan, J., & Scott, A. (2008). How online discussion can be used to develop informed and critical literacy teachers. Teaching and Teacher Education, 24, 1635–1644.

    Article  Google Scholar 

  • Simonsen, B., MacSuga, A. S., Fallon, L. M., & Sugai, G. (2012). The effects of self-monitoring on teachers’ use of specific praise. Journal of Positive Behavior, 15, 5–15.

    Article  Google Scholar 

  • Snyder, P., Hemmeter, M. L., & McLaughlin, T. (2012). Professional development in early childhood intervention: Where we stand on the silver anniversary of PL 99–457. Journal of Early Intervention, 33, 357–370.

    Article  Google Scholar 

  • Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teachers’ treatment. School Psychology Review, 41, 74074.

    Google Scholar 

  • Treacy, B., Kleiman, G., & Peterson, K. (2002). Successful online professional development. International Society for Technology in Education, 30, 42–47.

    Google Scholar 

  • U.S. Department of Health and Human Services, Administration for Children and Families. (2016). Program Information Report. Washington, DC: Author.

    Google Scholar 

  • Van Houten, R., & Sullivan, K. (1975). Effects of an audio cueing system on the rate of teacher praise. Journal of Applied Behavior Analysis, 8, 197–201.

    Article  Google Scholar 

  • Vasilyeva, M., & Waterfall, H. (2011). Variability in language development: Relation to SES and environmental input. In S. Neuman & D. Dickinson (Eds.), Handbook of early literacy research (pp. 36–48). New York: Guilford Press.

    Google Scholar 

  • Vazire, S. (2010). Who knows what about a person? The self–other knowledge asymmetry (SOKA) model. Journal of Personality and Social Psychology, 98(2), 281–300.

    Article  Google Scholar 

  • Wasik, B. A., Bond, M. A., & Hindman, A. (2006). The effects of a language and literacy intervention on Head Start children and teachers. Journal of Educational Psychology, 98, 63–74.

    Article  Google Scholar 

  • Wackerle-Hollman, A., Duran, L., & Rodriguez, M. (2015). Individual growth and development indicators-espanol. Mendota Heights, MN: Early Learning Labs.

    Google Scholar 

  • Yoon, K. S., Duncan, T., Lee, S. W. Y., Scarloss, B., & Shapley, K. L. (2007). Reviewing the evidence on how teacher professional development affects student achievement Reviewing the evidence on how teacher professional development. Evaluation, (REL 2007033), 62. Retrieved from http://ies.ed.gov/ncee/edlabs.

  • Zaslow, M., Tout, K., Halle, T., Whittaker, J. V., & Lavelle, B. (2010). Toward the identification of features of effective professional development for early educators, Literature review. Washington, DC: U.S. Department of Education, Office of Planning. Retrieved from http://www.ed.gov/about/offices/ list/opepd/ppss/reports.html.

  • Zauche, L. H., Thul, T. A., Mahoney, A. E. D., & Stapel-Wax, J. L. (2016). Influence of language nutrition on children’s language and cognitive development: An integrated review. Early Childhood Research Quarterly, 36, 318–333.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of South Carolina, Columbia, SC, USA

    Kate Ascetta

  2. University of Oregon, Eugene, OR, USA

    Beth Harn & Lillian Durán

Authors
  1. Kate Ascetta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Beth Harn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lillian Durán
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kate Ascetta.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ascetta, K., Harn, B. & Durán, L. Comparing Self-Reported and Performance-Based Online Feedback on Early Childhood Teachers’ Implementation of Language Strategies. Early Childhood Educ J 47, 353–365 (2019). https://doi.org/10.1007/s10643-019-00934-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10643-019-00934-8

Keywords

Search

Navigation