Abstract
There is perhaps no other time in recent history that provides such a compelling case for the essential role of school-based counselors as today. Advocates of school-based counselors have stressed the importance of organizational structure to school-based counseling programs, a core curriculum, and program evaluation for improvement and accountability. This chapter argues for the essential role of statewide evaluation in supporting policies that promote the development and implementation of effective school-based counseling programs. The rationale is that the state often has the most leverage to bring about broad change within its borders. To this end, the chapter provides a content analysis of existing statewide evaluation studies found in the literature and assesses the evaluations against the National Leadership Cadre (2007) suggestions for statewide evaluations. Seven recommendations are provided that include (1) expansion of cost-effective, statewide evaluations; (2) use of evaluation strategies that support outcome evaluation; (3) wider use of methodological approaches and evaluation strategies; (4) deliberate evaluation of promising practices; (5) promotion of evaluation use; (6) finding ways to take advantage of existing policy research studies in promoting school-based counseling as a viable education reform tool; and (7) reaching out to the broader education policy and policy research community to argue for school-based counselors as essential personnel in the drive toward attainment of critical student outcomes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
American Evaluation Association. (2004). American evaluation association guiding principles for evaluators. http://www.eval.org/p/cm/ld/fid=51. Accessed 15 Jan 2015.
American School Counselor Association. (2012). The ASCA National Model: A framework for school counseling programs (3rd ed.). Alexandria, VA: Author.
Barley, Z. A., & Jenness, M. (1993). Cluster evaluation: A method to strengthen evaluation in smaller programs with similar purposes. Evaluation Practice, 14, 141–147.
Borders, L. D., & Drury, S. M. (1992). Comprehensive school counseling programs: A review for policymakers and practitioners. Journal of Counseling & Development, 70(4), 487–498.
Byrne, D. (2013). Editorial. Evaluation: The International Journal of Theory, Research and Practice, 19(3), 213–216.
California Department of Education. (2003). Assembly bill 722: Study of pupil personnel ratios, services, and programs. Sacramento, CA: Counseling and Student Support Office.
Campbell, M. (2016). Policy, policy research on school-based counseling in Australia. In J. C. Carey, B. Harris, S. M. Lee, & J. Mushaandja (Eds.), International handbook for policy research on school-based counseling. Zug, Switzterland: Springer.
Carey, J., Harrity, J., & Dimmitt, C. (2005). The development of a self-assessment instrument to measure a school district's readiness to implement the ASCA national model. Professional School Counseling, 8(5), 305–312.
Carey, J., & Dimmitt, C. (2012). School counseling and student outcomes: Summary of six statewide studies. Professional School Counseling, 16(2), 146–153.
Carey, J., Harrington, K., Martin, I., & Hoffman, D. (2012). A statewide evaluation of the outcomes of the implementation of ASCA National Model school counseling programs in rural and suburban Nebraska high schools. Professional School Counseling, 16(2), 100–107.
Carey, J., Harrington, K., Martin, I., & Stevenson, D. (2012). A statewide evaluation of the outcomes of the implementation of ASCA national model school counseling programs in Utah high schools. Professional School Counseling, 16(2), 89–99.
Carey, J., & Martin, I. (2015). A review of the major school counseling policy studies in the United States: 2000 through 2014. Research Monograph, No. 4. Amherst, MA: The Ronald H. Frederickson Center for School Counseling Outcome Research & Evaluation.
Cronbach, L. J. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass Publishers.
Dahir, C. A. (2004). Supporting a nation of learners: The role of school counseling in educational reform. Journal of Counseling and Development, 82, 344–353.
Dimmitt, C. (2009). Why evaluation matters: Determining effective school counseling practices. Professional School Counseling, 12(6), 395–399.
Dimmitt, C., & Wilkerson, B. (2012). Comprehensive school counseling in Rhode Island: Access to services and student outcomes. Professional School Counseling, 16(2), 125–135.
Elsner, D., & Carey, J. C. (2005). School counseling program implementation survey. Unpublished assessment instrument.
Erickson, F., & Gutierrez, K. (2002). Culture, rigor, and science in educational research. Educational Researcher, 31(8), 21–24.
Feuer, M. J., Towne, L., & Shavelson, R. J. (2002). Scientific culture and educational research. Educational Researcher, 31(8), 4–14.
Feuer, M. J. (2009). Commentary: Disciplined education policy research. In G. Sykes, B. Schneider, & D. N. Plank (Eds.), Handbook of education policy research (pp. 101–105). New York/Routledge/Washington, D. C: American Educational Research Association.
Gysbers, N. C., & Moore, E. J. (1981). Improving guidance programs. Englewood Cliffs, NJ: Prentice Hall.
Gysbers, N. C., & Henderson, P. (1994). Developing and managing your school guidance program (2nd ed.). Alexandria, VA: American Counseling Association.
Gysbers, N. C. (2006). Improving school guidance and counseling practices through effective and sustained state leadership: A response to Miller. Professional School Counseling, 9(3), 245–247.
Herrell, J. M., & Straw, R. B. (Eds.). (2002). Conducting multi-site evaluations in real world settings, New directions for evaluation, number (Vol. 94). San Francisco: Jossey-Bass.
Hurwitz, M., & Howell, J. (2014). Estimating causal impacts of school counselors with regression discontinuity designs. Journal of Counseling & Development, 92(3), 316–327.
Institute of Education Sciences. (2013). Common guidelines for education research and development: A report from the Institute of Education Sciences and the National Science Foundation. Washington, D.C.: U.S. Department of Education.
Lapan, R. T., Gysbers, N. C., & Sun, Y. (1997). The impact of more fully implemented guidance programs on the school experiences of high school students: A statewide evaluation study. Journal of Counseling & Development, 75(4), 292–302.
Lapan, R. T., Gysbers, N. C., & Petroski, G. F. (2001). Helping seventh graders be safe and successful: A statewide study of the impact of comprehensive guidance and counseling programs. Journal of Counseling & Development, 79(3), 320–330.
Lapan, R. T., Gysbers, N. C., & Kayson, M. (2006). The relationship between implementation of the Missouri comprehensive guidance program and student academic achievement. Columbia, MO: University of Missouri.
Lapan, R. T., Gysbers, N. C., Stanley, B., & Pierce, M. E. (2012). Missouri professional school counselors: Ratios matter, especially in high-poverty schools. Professional School Counseling, 16(2), 108–116.
Lapan, R. T., Whitcomb, S. A., & Aleman, N. M. (2012). Connecticut professional school counselors: College and career counseling services and smaller ratios benefit students. Professional School Counseling, 16(2), 117–124.
Martin, I., Carey, J., & DeCoster, K. (2009). A national study of the current status of state school counseling models. Professional School Counseling, 12(5), 378–386.
Martin, I., & Carey, J. (2012). Evaluation capacity within state-level school counseling programs: A cross-case analysis. Professional School Counseling, 15(3), 132–143.
Martin, I., & Carey, J. (2014). Development of a logic model to guide evaluations of the ASCA national model for school counseling programs. The Professional Counselor, 4, 455–466.
Martin, I., & Rallis, S. (2014). Building on strengths and addressing challenges: Enhancing external school counseling program evaluation. Journal of School Counseling, 12(10), 1–29.
Mayne, J. (2014). Issues in enhancing evaluation use. In M. L. Loud & J. Mayne (Eds.), Enhancing evaluation use: Insights from internal evaluation units (pp. 1–14). Thousand Oaks, CA: Sage.
McGannon, W., Carey, J., & Dimmitt, C. (2005). The current status of school counseling outcome research. Research monograph, number 2. Amherst, MA: The Ronald H. Frederickson Center for School Counseling Outcome Research.
Miller, G. D. (2006). How collaboration and research can affect school counseling practices: The Minnesota story. Professional School Counseling, 9(3), 238–244.
National Leadership Cadre. (2007). A multi-level school counseling outcome evaluation model. http://www.umass.edu/schoolcounseling/NLC/page2/assets/EvaluationPaper_final.doc. Accessed 19 Feb 2015.
National Research Council. (2002). In R. J. Shavelson & L. Towne (Eds.), Committee on Scientific Principles for Educational Research Scientific research in education. Washington, DC: National Academy Press.
Nelson, D. E., Fox, D. G., Haslam, M., & Gardner, J. (2007). An evaluation of Utah’s comprehensive guidance program: The fourth major study of Utah’s thirteen-year program. Salt Lake City, UT: The Institute for Behavioral Research in Creativity.
Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: SAGE Publications, Inc.
Patton, M. Q. (2015). Qualitative research and evaluation methods: Integrating theory and practice (4th ed.). Thousand Oaks: SAGE Publications, Inc.
Pellegrino, J. W., & Goldman, S. R. (2002). Be careful what you wish for – You may get it: Educational research in the spotlight. Educational Researcher, 31(8), 15–17.
Redding, S., & Rhim, L. M. (2014). Evolution of school turnaround. In L. M. Rhim & S. Redding (Eds.), The state role in school turnaround: Emerging best practices (p. 10). Charlotte, NC: Information Age Publishing, Inc.
Rhim, L. M., & Redding, S. (Eds.). (2014). The state role in school turnaround: Emerging best practices. Charlotte, NC: Information Age Publishing, Inc.
Rog, D. J. (2010). Designing, managing, and analyzing multisite evaluations. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (pp. 208–236). San Francisco: Jossey-Bass.
Salina, C., Girtz, S., Eppinga, J., Martinez, D., Kilian, D. B., Lozano, E., et al. (2013). All hands on deck: A comprehensive, results-driven counseling model. Professional School Counseling, 17(1), 63–75.
Shadish, W. R. (2000). The empirical program of quasi-experimentation. In L. Bickman (Ed.), Research design: Donald Campbell’s legacy (pp. 13–36). Thousand, Oaks: Sage Publications.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
Sink, C. A., & Stroh, H. R. (2003). Raising achievement test scores of early elementary school students through comprehensive school counseling programs. Professional School Counseling, 6(5), 350–364.
Sink, C. A., Akos, P., Turnbull, R. J., & Mvududu, N. (2008). An investigation of comprehensive school counseling programs and academic achievement in Washington state middle schools. Professional School Counseling, 12(1), 43–53.
Smith, M. S., & O’Day, J. (1991). Systematic school reform. In S. Furhman & B. Malen (Eds.), The politics of curriculum and lasting (pp. 233–267). London/New York: Falmer Press.
Spillane, J. P., Gomez, L. M., & Mesler, L. (2009). Notes on reframing the role of organizations in policy implementation. In G. Sykes, B. Schneider, & D. N. Plank (Eds.), Handbook of education policy research (pp. 409–425). New York/Routledge/Washington, D.C: American Educational Research Association.
Straw, R. B., & Herrell, J. M. (2002). A framework for understanding and improving multisite evaluations. In J. M. Herrell & R. B. Straw (Eds.), Conducting multiple site evaluations in real world settings, New directions for evaluation, number 94. San Francisco: Jossey-Bass.
Trevisan, M. S. (2000). The status of program evaluation expectations in state school counselor certification requirements. American Journal of Evaluation, 21(1), 81–94.
Trevisan, M. S., & Walser, T. M. (2015). Evaluability assessment: Improving evaluation quality and use. Los Angeles: SAGE Publications, Inc.
Weiss, C. H. (1988). Evaluation for decisions: Is anybody there? Does anybody care? Evaluation Practice, 9(1), 5–19.
Weiss, C. H. (1998). Have we learned anything new about the use of evaluation? American Journal of Evaluation, 19(1), 21–34.
Whiston, S. C., Tai, W. L., Rahardja, D., & Eder, K. (2011). School counseling outcome: A meta-analytic examination of interventions. Journal of Counseling & Development, 89(1), 37–55.
Wholey, J. S. (1979). Evaluation: Promise and performance. Washington, DC: Urban Institute.
Wilkerson, K., Pérusse, R., & Hughes, A. (2013). Comprehensive school counseling programs and student achievement outcomes: A comparative analysis of Ramp versus non-Ramp schools. Professional School Counseling, 16(3), 172–184.
Worthen, B. R., & Schmitz, C. C. (1997). Conceptual challenges confronting cluster evaluation. Evaluation, 3, 300–310.
Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.
Yin, R. I. (1989). Case study research: Design and methods. Newbury Park, CA: Sage.
Yin, R. K. (1993). Applications of case study research. Applied social research methods series, volume 34. Newbury Park, CA: Sage.
Yin, R. K. (2013). Validity and generalization in future case study evaluations. Evaluation: The International Journal of Theory, Research and Practice, 19(3), 321–332.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
S. Trevisan, M. (2017). Evaluating the Impact of National and State Policies on School-Based Counseling Practices and Student Outcomes. In: Carey, J., Harris, B., Lee, S., Aluede, O. (eds) International Handbook for Policy Research on School-Based Counseling. Springer, Cham. https://doi.org/10.1007/978-3-319-58179-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-58179-8_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58177-4
Online ISBN: 978-3-319-58179-8
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)