Advertisement

The Utility of Universal Screening to Guide School-Based Prevention Initiatives: Comparison of Office Discipline Referrals to Standardized Emotional and Behavioral Risk Screening

  • Shereen Naser
  • Jeffery Brown
  • Jorge Verlenden
Article
  • 47 Downloads

Abstract

A critical component of any school-based prevention program is early identification of student risk as reported by Lane et al. (Remedial and Special Education 32:39–54, 2011). While screening for academic risk has grown in the last decade, screening for behavioral risk has remained stagnant. Few schools systematically screen for behavioral and emotional risk, and those that do rely on subjective referral systems that have been linked to disproportionality in special education and exclusionary discipline practices. An alternative to these subjective referral systems is universal screening for behavioral and emotional risk. Despite evidence that this standardized screening measure is both valid and reliable, few schools have adopted universal screening tools for behavioral and emotional risk. One potential reason for the lagging use of screening for behavioral and emotional risk is lack of information regarding the utility of these measures. This study compares the predicative validity of a universal screening tool for behavioral and emotional risk, and the predictive validity of the more traditionally used office discipline referrals. Results indicate that the universal screening measure, the Behavioral and Emotional Screening System Teacher Form (BESS TF), is a more reliable predictor of student GPA (t(132) = 5.062, p < .001) and absences (t(132) = 2.370, p < .02) than office discipline referrals (ODRs), while both ODRs and the BESS TF reliably predict student suspension rates. The ability of the BESS TF to identify students experiencing behavioral and emotional risk that impacts both their academic and behavioral functioning at school makes it a more useful measure than ODRs alone.

Keywords

Universal screening Office discipline referral School-based prevention Progress monitoring Assessment Early identification 3-tiered model At-risk 

Notes

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants performed by any of the authors.

References

  1. American Psychological Association Zero Tolerance Task Force. (2008). Are zero tolerance policies effective in the schools? An evidentiary review and recommendations. American Psychological Association, 63(9), 852–862.  https://doi.org/10.1037/0003-066X.6 CrossRefGoogle Scholar
  2. American Psychological Association. (2010). Ethical Principles of Psychologists and Code of Conduct. Available from http://www.apa.org/ethics/code/Google Scholar
  3. Bear, G. C., Webster-Stratton, E., Furlong, M. J., & Rhee, S. (2000). Preventing school violence. In K. M. Minke & G. C. Bear (Eds.), Preventing school problems, promoting school success: strategies and programs that work (pp. 1–69). Bethesda: National Association of School Psychologists.Google Scholar
  4. Belser, C. T., Shillingford, M., & Joe, J. R. (2016). The ASCA model and a multi-tiered system of supports: a framework to support students of color with problem behavior. Professional Counselor, 6(3), 251–262.  https://doi.org/10.15241/cb.6.3.251 CrossRefGoogle Scholar
  5. Bruhn, A. L., Woods-Groves, S., & Huddle, S. (2014). A preliminary investigation of emotional and behavioral screening practices in K–12 schools. Education and Treatment of Children, 37(4), 611–634.  https://doi.org/10.1353/etc.2014.0039 CrossRefGoogle Scholar
  6. Chafouleas, S. M., Volpe, R. J., Gresham, F. M., & Cook, C. R. (2010). School-based behavioral assessment within problem-solving models: current status and future directions. School Psychology Review, 39(3), 343.Google Scholar
  7. Clonan, S. M., McDougal, J. L., Clark, K., & Davison, S. (2007). Use of office discipline referrals in school-wide decision making: a practical example. Psychology in the Schools, 44(1), 19–27.  https://doi.org/10.1002/pits.20202 CrossRefGoogle Scholar
  8. Dever, B. V., Dowdy, E., Raines, T. C., & Carnazzo, K. (2015). Stability and change of behavioral and emotional screening scores. Psychology in the Schools.  https://doi.org/10.1002/pits.21825
  9. Dever, B. V., Mays, K. L., Kamphaus, R. W., & Dowdy, E. (2012). The factor structure of the BASC-2 behavioral and emotional screening system teacher form, child/adolescent. Journal of Psychoeducational Assessment, 30(5), 488–495.  https://doi.org/10.1177/0734282912438869 CrossRefGoogle Scholar
  10. Dowdy, E., Doane, K., Eklund, K., & Dever, B. V. (2013). A comparison of teacher nomination and screening to identify behavioral and emotional risk within a sample of underrepresented students. Journal of Emotional and Behavioral Disorders, 21(2), 127–137.  https://doi.org/10.1177/1063426611417627 CrossRefGoogle Scholar
  11. Dowdy, E., Furlong, M., Raines, T. C., Bovery, B., Kauffman, B., Kamphaus, R. W., Dever, B. V., Price, M., & Murdock, J. (2014). Enhancing school-based mental health services with a preventive and promotive approach to universal screening for complete mental health. Journal of Educational and Psychological Consultation.  https://doi.org/10.1080/10474412.2014.929951.2014
  12. Duckworth, A. L., Quinn, P. D., & Tsukayama, E. (2012). What No Child Left Behind leaves behind: the roles of IQ and self-control in predicting standardized achievement test scores and report card grades. Journal of Educational Psychology, 104(2), 439–451.  https://doi.org/10.1037/a0026280 CrossRefPubMedGoogle Scholar
  13. Eklund, K., & Dowdy, E. (2014). Screening for behavioral and emotional risk versus traditional school identification methods. School Mental Health, 6(1), 40–49.  https://doi.org/10.1007/s12310-013-9109-1 CrossRefGoogle Scholar
  14. Eklund, K., Renshaw, T. L., Dowdy, E., Jimerson, S. R., Hart, S. R., Jones, C. N., & Earhart, J. (2009). Early identification of behavioral and emotional problems in youth: universal screening versus teacher-referral identification. The California Psychologist, 14, 89–95 Retrieved from http://files.eric.ed.gov/fulltext/EJ878355.pdf CrossRefGoogle Scholar
  15. Fish, R. E. (2016). The racialized construction of exceptionality: experimental evidence of race/ethnicity effects on teachers’ interventions. Social Science Research.  https://doi.org/10.1016/j.ssresearch.2016.08.007 .
  16. Gershoff, E. T. & Font, S. A. (2016). Corporal punishment in U.S. public schools: prevalence, disparities in use, and status in state and federal policy. Society for Research in Child Development Social Policy Report, 30(1). Retrieved from http://www.srcd.org/sites/default/files/documents/spr_30_1.pdf.
  17. Glover, T., & Albers, C. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117–135.  https://doi.org/10.1016/j.jsp.2006.05.005 CrossRefGoogle Scholar
  18. Golann, J. W. (2015). The paradox of success at a no-excuses school. Sociology of Education, 88(2), 103–119.  https://doi.org/10.1177/0038040714567866 CrossRefPubMedPubMedCentralGoogle Scholar
  19. Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., & Vincent, C. G. (2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions. Journal of Positive Behavior Interventions, 6(3), 131–147.  https://doi.org/10.1177/10983007040060030201 CrossRefGoogle Scholar
  20. Jellinek, M. S., Murphy, J. M., Little, M., Pagano, M. E., Comer, D. M., & Kelleher, K. J. (1999). Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Archives of Pediatrics & Adolescent Medicine, 153(3), 254–260 Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3905751/ CrossRefGoogle Scholar
  21. Kamphaus, R. W., & Reynolds, C. R. (2007). Behavior assessment system for children—second edition (BASC–2): behavioral and emotional screening system (BESS). Bloomington: Pearson.Google Scholar
  22. Kamphaus, R. W., DiStefano, C., Dowdy, E., Eklund, K., & Dunn, A. R. (2010). Determining the presence of a problem: comparing two approaches for detecting youth behavioral risk. School Psychology Review, 39(3), 395.Google Scholar
  23. Kamphaus, R., Reynolds, C., & Dever, B. (2014). Behavioral and mental health screening. In Kettler, R., Glover, A., Albers, C., Feeny-Kettler, K. (Eds.) Universal screening in educational settings: Evidence-based decision making for schools. Washington, DC: APA.Google Scholar
  24. Kamphaus, R. W., Reynolds, C. R., Hatcher, N. M., & Kim, S. (2014). Treatment planning and evaluation with the Behavior Assessment System for Children (BASC). In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (Vol. 2. Instruments for children and adolescents, pp. 331–354). Mahwah: Lawrence Erlbaum.Google Scholar
  25. Kamphaus, R. W., Thorpe, J. S., Winsor, A. P., Kroncke, A. P., Dowdy, E. T., & VanDeventer, M. C. (2007). Development and predictive validity of a teacher screener for child behavioral and emotional problems at school. Educational and Psychological Measurement, 67(2), 342–356.  https://doi.org/10.1177/00131644070670021001 CrossRefGoogle Scholar
  26. Kern, L., & Manz, P. (2004). A look at current validity issues of school-wide behavior support. Behavioral Disorders, 47–59.  https://doi.org/10.1177/019874290403000102.
  27. King, K. R., & Reschly, A. L. (2014). A comparison of screening instruments: predictive validity of the BESS and BSC. Journal of Psychoeducational Assessment, 32(8), 687–698.  https://doi.org/10.1177/0734282914531714 CrossRefGoogle Scholar
  28. King, K., Reschly, A. L., & Appleton, J. J. (2012). An examination of the validity of the behavioral and emotional screening system in a rural elementary school: validity of the BESS. Journal of Psychoeducational Assessment, 30(6), 527–538.  https://doi.org/10.1177/0734282912440673 CrossRefGoogle Scholar
  29. Lane, K. L., Kalberg, J. R., & Menzies, H. M. (2009). Developing school-wide programs to prevent and manage problem behaviors (p. 157). New York: Guilford.Google Scholar
  30. Lane, K. L., Kalberg, J. R., Menzies, H., Bruhn, A., Eisner, S., & Crnobori, M. (2011). Using systematic screening data to assess risk and identify students for targeted supports: illustrations across the K–12 continuum. Remedial and Special Education, 32, 39–54.  https://doi.org/10.1177/0741932510361263 CrossRefGoogle Scholar
  31. Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764–766.  https://doi.org/10.1016/j.jesp.2013.03.013 CrossRefGoogle Scholar
  32. Losen, D., Hodson, S., Keith, M. A., Morrison, K., & Belway, S. (2015). Are we closing the school discipline gap? The Center for Civil Rights Remedies at the Civil Rights Project. Retrieved from https://www.civilrightsproject.ucla.edu/resources/projects/center-for-civil-rights-remedies/school-to-prison-folder/federal-reports/are-we-closing-the-school-discipline-gap/AreWeClosingTheSchoolDisciplineGap_FINAL221.pdf.
  33. Mathis, W.J. & Trujillo, T.M. (2016). Lessons from NCLB for the Every Student Succeeds Act. Boulder CO: National Education Policy Center. Retrieved from http://nepc.colorado.edu/files/publications/PB%20Mathis-Trujillo%20ESSA_0.pdf.
  34. McIntosh, K., Frank, J. L., & Spaulding, S. A. (2010). Establishing research-based trajectories of office discipline referrals for individual students. School Psychology Review, 39(3), 380–394 Retrieved from http://web.b.ebscohost.com.libproxy.tulane.edu:2048/ehost/pdfviewer/pdfviewer?sid=331bfb61-aff4-4676-b91e-0bf9235fd2b2%40sessionmgr198&vid=2&hid=113 Google Scholar
  35. Merrell, K. W., Juskelis, M. P., Tran, O. K. Buchanan, R. (2008). Social and Emotional Learning in the Classroom: Evaluation of and on Students' Social-Emotional Knowledge and Symptoms . Journal of Applied School Psychology 24(2), 209–224.  https://doi.org/10.1080/15377900802089981
  36. Miller, F. G., Cohen, D., Chafouleas, S. M., Riley-Tillman, T. C., Welsh, M. E., & Fabiano, G. A. (2015). A comparison of measures to screen for social, emotional, and behavioral risk. School Psychology Quarterly, 30(2), 184.  https://doi.org/10.1037/spq0000085 CrossRefPubMedGoogle Scholar
  37. National Education Association. (n.d.). Indicators of future success: GPA and noncognitive skills. Washington: NEA Education Policy and Practice Department, Center for Great Public Schools Retrieved from https://www.nea.org/assets/docs/Indicators_of_Success-BGH_ac5-final.pdf
  38. Nelson, R., Benner, G., Reid, R., & Currin, D. (2002). The convergent validity of office discipline referrals with the CBCL-TRF. Journal of Emotional and Behavioral Disorders, 10(3), 181–188.  https://doi.org/10.1177/10634266020100030601 CrossRefGoogle Scholar
  39. No Child Left Behind Act of 2001, Pub. L. No. 107–110 (2001). Retrieved from http://www2.ed.gov/nclb/landing.jhtml.
  40. New Orleans Parents Guide. (2015). Available from http://neworleansparentsguide.org/Google Scholar
  41. O’Connell, M. E., Boat, T., & Warner, K. E. (2009). Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. Washington: The National Academies Press.Google Scholar
  42. Oakes, W. P., Lane, K. L., Cox, M. L., & Messenger, M. (2014). Logistics of behavior screenings: how and why do we conduct behavior screenings at our school? Preventing School Failure: Alternative education for children and youth, 58(3), 159–170.  https://doi.org/10.1080/1045988X.2014.895572 CrossRefGoogle Scholar
  43. Parisi, D. M., Ihlo, T., & Glover, T. A. (2014). Screening within a multitiered early prevention model: using assessment to inform instruction and promote students’ response to intervention. In R. J. Kettler, T. A. Glover, C. A. Albers, & K. A. Feeney-Kettler (Eds.), Universal screening in educational settings: evidence-based decision making for schools (pp. 19–45). Washington: American Psychological Association.CrossRefGoogle Scholar
  44. Perfect, M. M., & Morris, R. J. (2011). Delivering school-based mental health services by school psychologists: education, training, and ethical issues. Psychology in the Schools, 48(10), 1049–1063.  https://doi.org/10.1002/pits.20612 CrossRefGoogle Scholar
  45. Predy, L., McIntosh, K., & Frank, J. L. (2014). Utility of number and type of office discipline referrals in predicting chronic problem behavior in middle schools. School Psychology Review, 43(4), 472–489.  https://doi.org/10.17105/SPR-13-0043.1 CrossRefGoogle Scholar
  46. Proctor, S. L., Graves, S. L., & Esch, R. C. (2012). Assessing African American students for specific learning disabilities: the promises and perils of response to intervention. The Journal of Negro Education, 81(3), 268–282.  https://doi.org/10.7709/jnegroeducation.81.3.0268 CrossRefGoogle Scholar
  47. Raines, T. C., Dever, B. V., Kamphaus, R. W., & Roach, A. T. (2012). Universal screening for behavioral and emotional risk: a promising method for reducing disproportionate placement in special education. The Journal of Negro Education, 81(3), 283–296.  https://doi.org/10.7709/jnegroeducation.81.3.0283 CrossRefGoogle Scholar
  48. Rebell, M. A. (2012). The right to comprehensive educational opportunity. Harvard Civil Rights-Civil Liberties Law Review., 47, 48–117 Retrieved from http://harvardcrcl.org/wp-content/uploads/2012/03/Rebell.pdf Google Scholar
  49. Reid, J.B., Patterson, G.R., & Snyder, J.J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and a model for intervention. Washington, DC: American Psychological Association.Google Scholar
  50. Renshaw, E., Eklund, K., Dowdy, E., Jimerson, S., Hart, S., Earhart, J., & Jones, C. (2009). Examining the relationship between scores on the Behavioral and Emotional Screening System and student academic, behavioral, and engagement outcomes: an investigation of concurrent validity in elementary school. The California School Psychologist, 14, 89–95 Retrieved from http://files.eric.ed.gov/fulltext/EJ878363.pdf CrossRefGoogle Scholar
  51. Skiba, R. J., Horner, R. H., Chung, C. G., Rausch, M. K., May, S. L., & Tobin, T. (2011). Race is not neutral: a national investigation of African American and Latino disproportionality in school discipline. School Psychology Review, 40(1), 85–107 Retrieved from http://www.indiana.edu/~equity/docs/Skiba%20et%20al%20Race%20is%20Not%20Neutral%202011.pdf Google Scholar
  52. Skiba, R. J., Michael, R. S., Nardo, A. C., & Paterson, R. L. (2002). The color of discipline: sources of racial and gender disproportionality in school punishment. The Urban Review, 34(4), 317–342.CrossRefGoogle Scholar
  53. Skiba, R. J., Ritter, S., Simmons, A., Peterson, R., & Miller, C. (2006). The Safe and Responsive Schools Project: a school reform model for implementing best practices in violence prevention. In S. R. Jimerson & M. J. Furlong (Eds.), Handbook of school violence and school safety: from research to practice (pp. 631–650). New York: Routledge.Google Scholar
  54. Staats, C., & Patton, C. (2014). State of the science: implicit bias review 2014. Kirwan Institute for the Study of Race and Ethnicity. Retrieved from http://kirwaninstitute.osu.edu/wp-content/uploads/2014/03/2014-implicit-bias.pdf.
  55. Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics (5th ed.). London: Pearson Education, Inc.Google Scholar
  56. Vaillancourt, K., Cowan, K. C., & Skalski, A. K. (2013). Providing mental health services within a multi-tiered system of supports. In J. Desrochers & G. Houck (Eds.), Depression in children and adolescents: guidelines for school practice. Bethesda: NASP & NASN.Google Scholar
  57. Vander S. A., Weiss, N. S., Kuo, E. S., Cheney, D., & Cohen, P. (2003). What proportion of failure to complete secondary school in the US population is attributable to adolescent psychiatric disorder? Journal of Behavioral Health Services and Research, 30(1), 119–124.  https://doi.org/10.1007/BF02287817
  58. Wadsworth, M., & Rienks, S. (2012). Stress as a mechanism of poverty’s ill effects on children: making a case for family strengthening interventions that counteract poverty-related stress. CYF News, Special Edition on Poverty, Health Disparities, and the Nation’s Children. Retrieved from http://www.apa.org/pi/families/resources/newsletter/2012/07/stress-mechanism.aspx.
  59. Walker, H., Severson, H. H., & Seeley, J. (2010). Universal, school-based screening for the early detection of academic and behavioral problems contributing to later destructive outcomes. In H. M. Walker & M. Shinn (Eds.), Interventions for achievement and behavior problems in a three-tier model including RTI (pp. 677–703). Bethesda: National Association of School Psychologists.Google Scholar
  60. Warren, J. S., Edmonson, H. M., Griggs, P., Lassen, S. R., McCart, A., Turnbull, A., & Sailor, W. (2003). Urban applications of school-wide positive behavior support critical issues and lessons learned. Journal of Positive Behavior Interventions, 5(2), 80–91.  https://doi.org/10.1177/10983007030050020301 CrossRefGoogle Scholar

Copyright information

© California Association of School Psychologists 2018

Authors and Affiliations

  1. 1.Cleveland State UniversityClevelandUSA
  2. 2.Minnesota State UniversityMankatoUSA
  3. 3.Satcher Health Leadership InstituteMorehouse School of MedicineDecaturUSA

Personalised recommendations