Initial Development and Validation of the Student Wellbeing Teacher-Report Scale
Given that youth mental health is associated with success in school and life more broadly, it is important that school-based psychological service providers embrace best-practice prevention and intervention strategies that target mental health when working with student populations. One line of study in this area has begun exploring the incorporation of a dual-factor model of mental health within universal screening systems in schools. The dual-factor model is differentiated from the traditional unidimensional mental health model, which focuses on the presence or absence of psychopathology, by conceptualizing mental health alternatively as consisting of both psychopathology and wellbeing dimensions. The present study involved the preliminary development and validation of the Student Wellbeing Teacher-Report Scale (SWTRS)—a brief behavior rating scale intended as a screening tool for measuring the wellbeing dimension of youths’ mental health at school. Specifically, the study involved drafting pilot items for the SWTRS and explored their latent factor structure, concurrent validity with school-related outcomes (i.e., attendance, academic achievement, and time on-task), as well as concurrent and incremental validity in comparison with two psychopathology screeners. Results suggested that the SWTRS items may better represent three context-specific indicators of youth wellbeing behavior—(a) academic, (b) social, and (c) emotional wellbeing—rather than the hypothesized “feeling good” and “functioning well” dimensions. The SWTRS scores also demonstrated incremental validity and were uniformly stronger concurrent predictors of all school-related outcomes compared to the psychopathology scales. Implications for theory and future research are discussed.
KeywordsWellbeing Student mental health Universal screening Dual-factor mental health Behavior rating scales
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Armistead, R. J., & Smallwood, D. L. (2014). The National Association of School Psychologists model for comprehensive and integrated school psychological services. In P. Harrison & A. Thomas (Eds.), Best practices in school psychology: Data-based and collaborative decision making (pp. 9–23). Bethesda, MD: The National Association of School Psychologists.Google Scholar
- Bradshaw, C. P., Buckley, J. A., & Ialongo, N. S. (2008). School-based service utilization among urban children with early onset educational and mental health problems: The squeaky wheel phenomenon. School Psychology Quarterly, 23, 169–186. https://doi.org/10.1037/1045-38184.108.40.206.CrossRefGoogle Scholar
- Caldarella, P., & Merrell, K. W. (1997). Common dimensions of social skills of children and adolescents: A taxonomy of positive behaviors. School Psychology Review, 26, 264–278.Google Scholar
- Cook, C. R. (2013). Manual: Student internalizing behavior screener and student externalizing behavior screener. Unpublished manual.Google Scholar
- Cook, C. R., Rasetshwane, K. B., Truelson, E., Grant, S., Dart, E. H., Collins, T. A., et al. (2011). Development and validation of the Student Internalizing Behavior Screener: Examination of reliability, validity, and classification accuracy. Assessment for Effective Intervention, 36, 71–79. https://doi.org/10.1177/1534508410390486.CrossRefGoogle Scholar
- Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, 1–9.Google Scholar
- D’Agostino, R. B., Belanger, A., & D’Agostino, R. B., Jr. (1990). A suggestion for using powerful and informative tests of normality. The American Statistician, 44, 316–321.Google Scholar
- DeVellis, R. F. (2012). Scale development: Theory and applications (3rd ed., Vol. 26). Thousand Oaks, CA: Sage.Google Scholar
- Dowdy, E., Furlong, M., Raines, T. C., Bovery, B., Kauffman, B., Kamphaus, R. W., et al. (2014). Enhancing school-based mental health services with a preventive and promotive approach to universal screening for complete mental health. Journal of Educational and Psychological Consultation, 25, 179–197. https://doi.org/10.1080/10474412.2014.929951.Google Scholar
- Drummond, T. (1993). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program.Google Scholar
- Earhart, J., Jr., Jimerson, S. R., Eklund, K., Hart, S. R., Jones, C. N., Dowdy, E., et al. (2009). Examining relationships between measures of positive behaviors and negative functioning for elementary school children. The California School Psychologist, 14, 97–104. https://doi.org/10.1007/BF03340955.CrossRefGoogle Scholar
- Fredricks, J., McColskey, W., Meli, J., Mordica, J., Montrosse, B., & Mooney, K. (2011). Measuring student engagement in upper elementary through high school: A description of 21 instruments. (Issues & Answers Report, REL 2011–No. 098). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Southeast. Retrieved from http://ies.ed.gov/ncee/edlabs.
- Furlong, M. J., Gilman, R., & Huebner, E. S. (Eds.). (2014). Handbook of positive psychology in the schools (2nd ed.). New York, NY: Routledge.Google Scholar
- Individuals with Disabilities Education Improvement Act, 20 U.S.C. § 1400 et seq. (2004).Google Scholar
- Kamphaus, R. W., DiStefano, C., Dowdy, E., Eklund, K., & Dunn, A. R. (2010). Determining the presence of a problem: Comparing two approaches for detecting youth behavioral risk. School Psychology Review, 39, 395–407.Google Scholar
- Kelley, K. (2016). MBESS: The MBESS R package (R package version 4.1.0). Retrieved December 27, 2018 from https://CRAN.R-project.org/package=MBESS.
- Kilgus, S. P., Eklund, K., von der Embse, N. P., Taylor, C. N., & Sims, W. A. (2016). Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) Teacher Rating Scale and multiple gating procedure within elementary and middle school samples. Journal of School Psychology, 58, 21–39. https://doi.org/10.1016/j.jsp.2016.07.001.CrossRefGoogle Scholar
- Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). New York, NY: Guilford.Google Scholar
- Lane, K. L., Little, M. A., Casey, A. M., Lambert, W., Wehby, J., Weisenbach, J. L., et al. (2009). A comparison of systematic screening tools for emotional and behavioral disorders. Journal of Emotional and Behavioral Disorders, 17, 93–105. https://doi.org/10.1177/1063426608326203.CrossRefGoogle Scholar
- Lane, K. L., Oakes, W., & Menzies, H. (2010). Systematic screenings to prevent the development of learning and behavior problems: Considerations for practitioners, researchers, and policy makers. Journal of Disability Policy Studies, 21, 160–172. https://doi.org/10.1177/1044207310379123.CrossRefGoogle Scholar
- Menard, S. (1995). Applied logistic regression analysis. Sage University Paper Series on Quantitative Applications in the Social Sciences. Thousand Oaks, CA: Sage.Google Scholar
- Merikangas, K. J., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., et al. (2010). Lifetime prevalence of mental disorder in U.S. adolescents: Results from the national comorbidity study—Adolescent supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 49, 980–989. https://doi.org/10.1016/j.jaac.2010.05.017.CrossRefGoogle Scholar
- Merrell, K. W. (2008). Behavioral, social, and emotional assessment of children and adolescents (3rd ed.). New York, NY: Taylor & Francis.Google Scholar
- Myers, R. (1990). Classical and modern regression with applications (2nd ed.). Boston, MA: Duxbury.Google Scholar
- Naglieri, J. A., LeBuffe, P. A., & Shapiro, V. (2010). Devereux Student Strengths Assessment-mini. Lewisville, NC: Kaplan Press.Google Scholar
- National Association of School Psychologists. (2010). Model for comprehensive and integrated school psychological services. Retrieved December 27, 2018 from http://www.nasponline.org/standards/2010standards/2_PracticeModel.pdf.
- Presaghi, F., & Desimoni, M. (2016). random.polychor.pa: A parallel analysis with polychoric correlation matrices. R package version 1.1.4-2.Google Scholar
- Quay, H. C. (1986). Classification. In H. C. Quay & J. S. Werry (Eds.), Psychopathological disorders of childhood (3rd ed., pp. 1–34). New York, NY: Wiley.Google Scholar
- R Core Team. (2016). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved December 27, 2018 from https://www.R-project.org/.
- Rapport, M. D., Denney, C. B., Chung, K.-M., & Hustace, K. (2001). Internalizing behavior problems and scholastic achievement in children: Cognitive and behavioral pathways as mediators of outcome. Journal of Clinical Child & Adolescent Psychology, 30, 536–551. https://doi.org/10.1207/S15374424JCCP3004_10.CrossRefGoogle Scholar
- Renshaw, T. L., Eklund, K., Bolognino, S. J., & Adodo, I. (2016). Bidimensional emotional health in college students: A comparison of categorical and continuous analytic approaches. Journal of Psychopathology & Behavioral Assessment, 38, 681–694. https://doi.org/10.1007/s10862-016-9558-6.CrossRefGoogle Scholar
- Renshaw, T. L., Furlong, M. J., Dowdy, E., Rebelez, J., Smith, D. C., O’Malley, M. D., et al. (2014a). Covitality: A synergistic conception of youths’ mental health. In M. J. Furlong, R. Gilman, & E. S. Huebner (Eds.), Handbook of positive psychology in the schools (2nd ed., pp. 12–32). New York, NY: Routledge.Google Scholar
- Renshaw, T. L., Long, A. C. J., & Cook, C. R. (2014b). Assessing adolescents’ positive psychological functioning at school: Development and validation of the Student Subjective Wellbeing Questionnaire. School Psychology Quarterly, 30, 534–552. https://doi.org/10.1037/spq0000088.CrossRefGoogle Scholar
- Revelle, W. (2017). psych: Procedures for personality and psychological research. Northwestern University, Evanston, Illinois, USA. Retrieved December 27, 2018 from https://CRAN.R-project.org/package=psych. Version = 1.7.5.
- Seligman, M. E. P. (2002). Positive psychology, positive prevention, and positive therapy. In C. R. Snyder & S. J. Lopez (Eds.), Handbook of positive psychology (pp. 3–12). New York, NY: Oxford University Press.Google Scholar
- Suldo, S., Thalji, A., & Ferron, J. (2011). Longitudinal academic outcomes predicted by early adolescents’ subjective wellbeing, psychopathology, and mental health status yielded from a dual factor model. The Journal of Positive Psychology, 6, 17–30. https://doi.org/10.1080/17439760.2010.536774.CrossRefGoogle Scholar
- Suldo, S. M., & Shaffer, E. J. (2008). Looking beyond psychopathology: The dual-factor model of mental health in youth. School Psychology Review, 37, 52–68.Google Scholar
- Volpe, R. J., DuPaul, G. J., DiPerna, J. C., Jitendra, A. K., Lutz, J. G., Tresco, K., et al. (2006). Attention deficit hyperactivity disorder and scholastic achievement: A model of mediation via academic enablers. School Psychology Review, 35, 47–61.Google Scholar
- von der Embse, N. P., Pendergast, L. L., Kilgus, S. P., & Eklund, K. R. (2015). Evaluating the applied use of a mental health screener: Structural validity of the Social, Academic, and Emotional Behavior Risk Screener. Psychological Assessment, 28, 1265–1275. https://doi.org/10.1037/pas0000253.CrossRefGoogle Scholar
- Wickham, H. (2014). Tidy data. The Journal of Statistical Software, 59, 1–24. Retrieved December 27, 2018 from http://www.jstatsoft.org/v59/i10/.
- World Health Organization. (2004). Promoting mental health: Concepts, emerging evidence, practice (summary report). Geneva, Switzerland: Author. Retrieved December 27, 2018 from http://www.who.int/mental_health/evidence/en/promoting_mhh.pdf.
- Ysseldyke, J., & Reschly, D. J. (2014). The evolution of school psychology: Origins, contemporary status, and future directions. In P. Harrison & A. Thomas (Eds.), Best practices in school psychology: Data-based and collaborative decision making (pp. 71–84). Bethesda, MD: The National Association of School Psychologists.Google Scholar