The Utility of Universal Screening to Guide School-Based Prevention Initiatives: Comparison of Office Discipline Referrals to Standardized Emotional and Behavioral Risk Screening
- 7 Downloads
A critical component of any school-based prevention program is early identification of student risk as reported by Lane et al. (Remedial and Special Education 32:39–54, 2011). While screening for academic risk has grown in the last decade, screening for behavioral risk has remained stagnant. Few schools systematically screen for behavioral and emotional risk, and those that do rely on subjective referral systems that have been linked to disproportionality in special education and exclusionary discipline practices. An alternative to these subjective referral systems is universal screening for behavioral and emotional risk. Despite evidence that this standardized screening measure is both valid and reliable, few schools have adopted universal screening tools for behavioral and emotional risk. One potential reason for the lagging use of screening for behavioral and emotional risk is lack of information regarding the utility of these measures. This study compares the predicative validity of a universal screening tool for behavioral and emotional risk, and the predictive validity of the more traditionally used office discipline referrals. Results indicate that the universal screening measure, the Behavioral and Emotional Screening System Teacher Form (BESS TF), is a more reliable predictor of student GPA (t(132) = 5.062, p < .001) and absences (t(132) = 2.370, p < .02) than office discipline referrals (ODRs), while both ODRs and the BESS TF reliably predict student suspension rates. The ability of the BESS TF to identify students experiencing behavioral and emotional risk that impacts both their academic and behavioral functioning at school makes it a more useful measure than ODRs alone.
KeywordsUniversal screening Office discipline referral School-based prevention Progress monitoring Assessment Early identification 3-tiered model At-risk
Compliance with Ethical Standards
Conflict of Interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants performed by any of the authors.
- American Psychological Association. (2010). Ethical Principles of Psychologists and Code of Conduct. Available from http://www.apa.org/ethics/code/Google Scholar
- Bear, G. C., Webster-Stratton, E., Furlong, M. J., & Rhee, S. (2000). Preventing school violence. In K. M. Minke & G. C. Bear (Eds.), Preventing school problems, promoting school success: strategies and programs that work (pp. 1–69). Bethesda: National Association of School Psychologists.Google Scholar
- Chafouleas, S. M., Volpe, R. J., Gresham, F. M., & Cook, C. R. (2010). School-based behavioral assessment within problem-solving models: current status and future directions. School Psychology Review, 39(3), 343.Google Scholar
- Dever, B. V., Dowdy, E., Raines, T. C., & Carnazzo, K. (2015). Stability and change of behavioral and emotional screening scores. Psychology in the Schools. https://doi.org/10.1002/pits.21825
- Dowdy, E., Doane, K., Eklund, K., & Dever, B. V. (2013). A comparison of teacher nomination and screening to identify behavioral and emotional risk within a sample of underrepresented students. Journal of Emotional and Behavioral Disorders, 21(2), 127–137. https://doi.org/10.1177/1063426611417627 CrossRefGoogle Scholar
- Dowdy, E., Furlong, M., Raines, T. C., Bovery, B., Kauffman, B., Kamphaus, R. W., Dever, B. V., Price, M., & Murdock, J. (2014). Enhancing school-based mental health services with a preventive and promotive approach to universal screening for complete mental health. Journal of Educational and Psychological Consultation. https://doi.org/10.1080/10474412.2014.929951.2014
- Duckworth, A. L., Quinn, P. D., & Tsukayama, E. (2012). What No Child Left Behind leaves behind: the roles of IQ and self-control in predicting standardized achievement test scores and report card grades. Journal of Educational Psychology, 104(2), 439–451. https://doi.org/10.1037/a0026280 CrossRefPubMedGoogle Scholar
- Eklund, K., Renshaw, T. L., Dowdy, E., Jimerson, S. R., Hart, S. R., Jones, C. N., & Earhart, J. (2009). Early identification of behavioral and emotional problems in youth: universal screening versus teacher-referral identification. The California Psychologist, 14, 89–95 Retrieved from http://files.eric.ed.gov/fulltext/EJ878355.pdf CrossRefGoogle Scholar
- Fish, R. E. (2016). The racialized construction of exceptionality: experimental evidence of race/ethnicity effects on teachers’ interventions. Social Science Research. https://doi.org/10.1016/j.ssresearch.2016.08.007 .
- Gershoff, E. T. & Font, S. A. (2016). Corporal punishment in U.S. public schools: prevalence, disparities in use, and status in state and federal policy. Society for Research in Child Development Social Policy Report, 30(1). Retrieved from http://www.srcd.org/sites/default/files/documents/spr_30_1.pdf.
- Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., & Vincent, C. G. (2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions. Journal of Positive Behavior Interventions, 6(3), 131–147. https://doi.org/10.1177/10983007040060030201 CrossRefGoogle Scholar
- Jellinek, M. S., Murphy, J. M., Little, M., Pagano, M. E., Comer, D. M., & Kelleher, K. J. (1999). Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Archives of Pediatrics & Adolescent Medicine, 153(3), 254–260 Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3905751/ CrossRefGoogle Scholar
- Kamphaus, R. W., & Reynolds, C. R. (2007). Behavior assessment system for children—second edition (BASC–2): behavioral and emotional screening system (BESS). Bloomington: Pearson.Google Scholar
- Kamphaus, R. W., DiStefano, C., Dowdy, E., Eklund, K., & Dunn, A. R. (2010). Determining the presence of a problem: comparing two approaches for detecting youth behavioral risk. School Psychology Review, 39(3), 395.Google Scholar
- Kamphaus, R., Reynolds, C., & Dever, B. (2014). Behavioral and mental health screening. In Kettler, R., Glover, A., Albers, C., Feeny-Kettler, K. (Eds.) Universal screening in educational settings: Evidence-based decision making for schools. Washington, DC: APA.Google Scholar
- Kamphaus, R. W., Reynolds, C. R., Hatcher, N. M., & Kim, S. (2014). Treatment planning and evaluation with the Behavior Assessment System for Children (BASC). In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (Vol. 2. Instruments for children and adolescents, pp. 331–354). Mahwah: Lawrence Erlbaum.Google Scholar
- Kamphaus, R. W., Thorpe, J. S., Winsor, A. P., Kroncke, A. P., Dowdy, E. T., & VanDeventer, M. C. (2007). Development and predictive validity of a teacher screener for child behavioral and emotional problems at school. Educational and Psychological Measurement, 67(2), 342–356. https://doi.org/10.1177/00131644070670021001 CrossRefGoogle Scholar
- Kern, L., & Manz, P. (2004). A look at current validity issues of school-wide behavior support. Behavioral Disorders, 47–59. https://doi.org/10.1177/019874290403000102.
- King, K., Reschly, A. L., & Appleton, J. J. (2012). An examination of the validity of the behavioral and emotional screening system in a rural elementary school: validity of the BESS. Journal of Psychoeducational Assessment, 30(6), 527–538. https://doi.org/10.1177/0734282912440673 CrossRefGoogle Scholar
- Lane, K. L., Kalberg, J. R., & Menzies, H. M. (2009). Developing school-wide programs to prevent and manage problem behaviors (p. 157). New York: Guilford.Google Scholar
- Lane, K. L., Kalberg, J. R., Menzies, H., Bruhn, A., Eisner, S., & Crnobori, M. (2011). Using systematic screening data to assess risk and identify students for targeted supports: illustrations across the K–12 continuum. Remedial and Special Education, 32, 39–54. https://doi.org/10.1177/0741932510361263 CrossRefGoogle Scholar
- Losen, D., Hodson, S., Keith, M. A., Morrison, K., & Belway, S. (2015). Are we closing the school discipline gap? The Center for Civil Rights Remedies at the Civil Rights Project. Retrieved from https://www.civilrightsproject.ucla.edu/resources/projects/center-for-civil-rights-remedies/school-to-prison-folder/federal-reports/are-we-closing-the-school-discipline-gap/AreWeClosingTheSchoolDisciplineGap_FINAL221.pdf.
- Mathis, W.J. & Trujillo, T.M. (2016). Lessons from NCLB for the Every Student Succeeds Act. Boulder CO: National Education Policy Center. Retrieved from http://nepc.colorado.edu/files/publications/PB%20Mathis-Trujillo%20ESSA_0.pdf.
- McIntosh, K., Frank, J. L., & Spaulding, S. A. (2010). Establishing research-based trajectories of office discipline referrals for individual students. School Psychology Review, 39(3), 380–394 Retrieved from http://web.b.ebscohost.com.libproxy.tulane.edu:2048/ehost/pdfviewer/pdfviewer?sid=331bfb61-aff4-4676-b91e-0bf9235fd2b2%40sessionmgr198&vid=2&hid=113 Google Scholar
- Merrell, K. W., Juskelis, M. P., Tran, O. K. Buchanan, R. (2008). Social and Emotional Learning in the Classroom: Evaluation of and on Students' Social-Emotional Knowledge and Symptoms . Journal of Applied School Psychology 24(2), 209–224. https://doi.org/10.1080/15377900802089981
- National Education Association. (n.d.). Indicators of future success: GPA and noncognitive skills. Washington: NEA Education Policy and Practice Department, Center for Great Public Schools Retrieved from https://www.nea.org/assets/docs/Indicators_of_Success-BGH_ac5-final.pdf
- No Child Left Behind Act of 2001, Pub. L. No. 107–110 (2001). Retrieved from http://www2.ed.gov/nclb/landing.jhtml.
- New Orleans Parents Guide. (2015). Available from http://neworleansparentsguide.org/Google Scholar
- O’Connell, M. E., Boat, T., & Warner, K. E. (2009). Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. Washington: The National Academies Press.Google Scholar
- Oakes, W. P., Lane, K. L., Cox, M. L., & Messenger, M. (2014). Logistics of behavior screenings: how and why do we conduct behavior screenings at our school? Preventing School Failure: Alternative education for children and youth, 58(3), 159–170. https://doi.org/10.1080/1045988X.2014.895572 CrossRefGoogle Scholar
- Parisi, D. M., Ihlo, T., & Glover, T. A. (2014). Screening within a multitiered early prevention model: using assessment to inform instruction and promote students’ response to intervention. In R. J. Kettler, T. A. Glover, C. A. Albers, & K. A. Feeney-Kettler (Eds.), Universal screening in educational settings: evidence-based decision making for schools (pp. 19–45). Washington: American Psychological Association.CrossRefGoogle Scholar
- Raines, T. C., Dever, B. V., Kamphaus, R. W., & Roach, A. T. (2012). Universal screening for behavioral and emotional risk: a promising method for reducing disproportionate placement in special education. The Journal of Negro Education, 81(3), 283–296. https://doi.org/10.7709/jnegroeducation.81.3.0283 CrossRefGoogle Scholar
- Rebell, M. A. (2012). The right to comprehensive educational opportunity. Harvard Civil Rights-Civil Liberties Law Review., 47, 48–117 Retrieved from http://harvardcrcl.org/wp-content/uploads/2012/03/Rebell.pdf Google Scholar
- Reid, J.B., Patterson, G.R., & Snyder, J.J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and a model for intervention. Washington, DC: American Psychological Association.Google Scholar
- Renshaw, E., Eklund, K., Dowdy, E., Jimerson, S., Hart, S., Earhart, J., & Jones, C. (2009). Examining the relationship between scores on the Behavioral and Emotional Screening System and student academic, behavioral, and engagement outcomes: an investigation of concurrent validity in elementary school. The California School Psychologist, 14, 89–95 Retrieved from http://files.eric.ed.gov/fulltext/EJ878363.pdf CrossRefGoogle Scholar
- Skiba, R. J., Horner, R. H., Chung, C. G., Rausch, M. K., May, S. L., & Tobin, T. (2011). Race is not neutral: a national investigation of African American and Latino disproportionality in school discipline. School Psychology Review, 40(1), 85–107 Retrieved from http://www.indiana.edu/~equity/docs/Skiba%20et%20al%20Race%20is%20Not%20Neutral%202011.pdf Google Scholar
- Skiba, R. J., Ritter, S., Simmons, A., Peterson, R., & Miller, C. (2006). The Safe and Responsive Schools Project: a school reform model for implementing best practices in violence prevention. In S. R. Jimerson & M. J. Furlong (Eds.), Handbook of school violence and school safety: from research to practice (pp. 631–650). New York: Routledge.Google Scholar
- Staats, C., & Patton, C. (2014). State of the science: implicit bias review 2014. Kirwan Institute for the Study of Race and Ethnicity. Retrieved from http://kirwaninstitute.osu.edu/wp-content/uploads/2014/03/2014-implicit-bias.pdf.
- Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics (5th ed.). London: Pearson Education, Inc.Google Scholar
- Vaillancourt, K., Cowan, K. C., & Skalski, A. K. (2013). Providing mental health services within a multi-tiered system of supports. In J. Desrochers & G. Houck (Eds.), Depression in children and adolescents: guidelines for school practice. Bethesda: NASP & NASN.Google Scholar
- Vander S. A., Weiss, N. S., Kuo, E. S., Cheney, D., & Cohen, P. (2003). What proportion of failure to complete secondary school in the US population is attributable to adolescent psychiatric disorder? Journal of Behavioral Health Services and Research, 30(1), 119–124. https://doi.org/10.1007/BF02287817
- Wadsworth, M., & Rienks, S. (2012). Stress as a mechanism of poverty’s ill effects on children: making a case for family strengthening interventions that counteract poverty-related stress. CYF News, Special Edition on Poverty, Health Disparities, and the Nation’s Children. Retrieved from http://www.apa.org/pi/families/resources/newsletter/2012/07/stress-mechanism.aspx.
- Walker, H., Severson, H. H., & Seeley, J. (2010). Universal, school-based screening for the early detection of academic and behavioral problems contributing to later destructive outcomes. In H. M. Walker & M. Shinn (Eds.), Interventions for achievement and behavior problems in a three-tier model including RTI (pp. 677–703). Bethesda: National Association of School Psychologists.Google Scholar
- Warren, J. S., Edmonson, H. M., Griggs, P., Lassen, S. R., McCart, A., Turnbull, A., & Sailor, W. (2003). Urban applications of school-wide positive behavior support critical issues and lessons learned. Journal of Positive Behavior Interventions, 5(2), 80–91. https://doi.org/10.1177/10983007030050020301 CrossRefGoogle Scholar