Leveraging Technology to Facilitate Teachers’ Use of a Targeted Classroom Intervention: Evaluation of the Daily Report Card.Online (DRC.O) System
Historically, teachers’ uptake and implementation of empirically supported classroom interventions have involved substantial face-to-face consultation. However, most schools do not have the resources to provide this intensive level of support and many teachers may not need it. Thus, evaluation of alternative supports is warranted. In this pilot study, we evaluated the feasibility and effectiveness of an interactive web-based technology [i.e., the Daily Report Card.Online (DRC.O)] designed to facilitate teachers’ use of the DRC with minimal external support and examined individual teacher characteristics associated with DRC use. Elementary school teachers (N = 54) were given access to the DRC.O Web site and asked to use it to implement a DRC with one child. With regard to implementation, 16% were short-term adopters (less than 1 month) and 39% were long-term adopters (1–7 months of use). On average, short-term adopters adhered to 37% of data entry procedures, whereas long-term adopters adhered to 74% of data entry procedures. Higher teacher stress was associated with shorter use and lower adherence. Web site analytics revealed that, on average, long-term adopters completed all steps of DRC development in less than 1 h and spent only 3 min per day engaged in data entry for progress monitoring. The magnitude of change in student target behaviors and Strengths and Difficulties Questionnaire scores was moderate to large. These results reveal the feasibility and promise of the DRC.O and generate hypotheses for future research. Implications for additional evaluation of technology-driven implementation supports for teachers are discussed.
KeywordsDaily report card Technology Adoption Implementation Teachers Classroom management
The authors express their gratitude to the educators, administrators, and families in the participating school districts for their collaboration.
This study was funded by the PolicyWise for Children & Families, Alberta, Canada (Grant No. 1609SM). The opinions expressed are those of the authors and do not represent views of PolicyWise.
Compliance with Ethical Standards
Conflict of interest
The first author received no financial benefit from the DRC.O program, but is the primary developer of the Web site. Other authors have no conflicts of interest to disclose.
Procedures were approved by the Institutional Review Boards at both universities and within all school districts. All procedures were performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Alberta Government. (2013). A transformation in progress: Alberta’s K-12 education workforce 2011–2012. Retrieved at https://open.alberta.ca/publications/9781460106884 on December 8, 2018.
- Canadian Teachers’ Federation. (2018). Teacher voices on work-life balance. Available from https://www.ctf-fce.ca/en/Pages/Issues/Teachers-Survey-Infographic.aspx. Retrieved on September 27, 2018.
- Carey, R., Kleiman, G., Russell, M., Douglas Venable, J. D., & Louie, J. (2008). Online courses for math teachers: Comparing self-paced and facilitated cohort approaches. The Journal of Technology, Learning and Assessment, 7(3), 4–35.Google Scholar
- Epstein, M., Atkins, M., Culinan, D., Kutash, K., & Weaver, R. (2008). Reducing behavior problems in the elementary school classroom. IES Practice Guide (NCEE 2008-012). U.S. Department of Education, National Center for Education Statistics. Washington, DC: U.S. Government Printing Office.Google Scholar
- Fabiano, G. A., Vujnovic, R., Pelham, W. E., Waschbusch, D. A., Massetti, G. M., Yu, J., et al. (2010). Enhancing the effectiveness of special education programming for children with ADHD using a daily report card. School Psychology Review, 39, 219–239.Google Scholar
- Farley-Ripple, E., & Buttram, J. (2015). The development of capacity for data use: The role of teacher networks in an elementary school. Teachers College Record, 117(4), 1–34.Google Scholar
- Fimian, M. J. (1988). Teacher stress inventory. Brandon, VT: Clinical Psychology Publishing Company.Google Scholar
- Frank, J. L., & Kratochwill, T. R. (2014). School-based problem-solving consultation. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation (2nd ed., pp. 18–39). New York: Routledge.Google Scholar
- Hart, K. C., Fabiano, G. A., Evans, S. W., Manos, M. J., Hannah, J. N., & Vujnovic, R. K. (2017). Elementary and middle school teachers’ self-reported use of positive behavioral supports for children with ADHD: A national survey. Journal of Emotional and Behavioral Disorders, 25(4), 246–256.CrossRefGoogle Scholar
- Holdaway, A. S., Owens, J. S., Evans, S. W., Coles, E. K., Egan, T. E., & Himawan, L. K. (2018, October). Incremental benefits of a daily report card over time for youth with or at-risk for ADHD: Replication and extension. Poster presented at the Annual Conference on Advancing School Mental Health, Las Vegas, NV.Google Scholar
- McLeod, B. D., Sutherland, K. S., Martinez, R. G., Conroy, M. A., Snyder, P. A., & Southam-Gerow, M. A. (2017). Identifying common practice elements to improve social, emotional, and behavioral outcomes of young children in early childhood classrooms. Prevention Science, 18(2), 204–213.CrossRefGoogle Scholar
- Owens, J. S., Coles, E. K., & Evans, S. W. (2014, September). The role of teacher knowledge, skills, and beliefs in the implementation of classroom management skills. Presentation at the Annual School Mental Health Research Summit, Pittsburgh, PA.Google Scholar
- Owens, J. S., Coles, E. K., Evans, S. W., Himawan, L. K., Girio-Herrera, E., Holdaway, A. S., et al. (2017). Using multi-component consultation to increase the integrity with which teachers implement behavioral classroom interventions: A pilot study. School Mental Health, 9, 218–234.CrossRefGoogle Scholar
- Owens, J. S., Evans, S. W., Coles, E. K., Himawan, L. K., Holdaway, A. S., Mixon, C., et al. (2018). Consultation for classroom management and targeted interventions: examining benchmarks for teacher practices that produce desired change in student behavior. Journal of Emotional and Behavioral Disorders. https://doi.org/10.1177/106342661879544.Google Scholar
- Pyle, K., & Fabiano, G. A. (2017). Daily report card intervention and attention deficit hyperactivity disorder: A meta-analysis of single-case studies. Exceptional Children, 83(4), 378–395.Google Scholar
- Russell, M., Carey, R., Kleiman, G., & Venable, J. D. (2009). Face-to-face and online professional development for mathematics teachers: A comparative study. Journal of Asynchronous Learning Networks, 13(2), 71–87.Google Scholar
- Sanetti, L. M. H., & Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38(4), 445–459.Google Scholar
- Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teachers’ treatment integrity: A meta-analysis of the single-case literature. School Psychology Review, 41(2), 160–175.Google Scholar
- Troutman, A. C., Owens, J. S., Monopoli, W. J., Evans, S. W., & Coles, E. C. (2018, October). School, teacher, and student factors that predict use of effective classroom management practices. Poster presented at the Annual Conference on Advancing School Mental Health, Las Vegas, NV.Google Scholar
- Vannest, K. J., Davis, J. L., Davis, C. R., Mason, B. A., & Burke, M. D. (2010). Effective intervention for behavior with a daily behavior report card: A meta-analysis. School Psychology Review, 39(4), 654–672.Google Scholar