Skip to main content
SpringerLink
Log in

Evaluating Service Leadership Programs with Multiple Strategies

  • Chapter
Promoting Service Leadership Qualities in University Students

Part of the book series: Quality of Life in Asia ((QLAS,volume 6))

Abstract

Despite the growing numbers of leadership programs, little is known about the effectiveness of such programs. In view of this, evaluation research is integrated into the implementation of service leadership programs at The Hong Kong Polytechnic University (PolyU). In this chapter, evaluation methods based on objective outcome evaluation, subjective outcome evaluation, process evaluation, and qualitative evaluation are outlined. The findings of evaluation research adopting these methods are reported to show the effectiveness of service leadership programs at PolyU. Overall, results indicate that service leadership programs at PolyU have a beneficial impact for students.

This preparation for this paper and the Service Leadership project are financially supported by the Victor and William Fung Foundation. The authorship is equally shared by the first author and second author.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Andenoro, A. C., Allen, S. J., Haber-Curran, P., Jenkins, D. M., Sowcik, M., Dugan, J. P., & Osteen, L. (2013). National leadership education research agenda 2013–2018: Providing strategic direction for the field of leadership education. Retrieved from Association of Leadership Educators website: http://leadershipeducators.org/ResearchAgenda

  • Astin, A. W., & Astin, H. S. (2000). Leadership reconsidered: Engaging higher education in social change [Online]. Retrieved from: http://www.wkkf.org/Pubs/CCT/Leadership/Pub3368.PDF

  • Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5(3), 233–237.

    Article  PubMed  Google Scholar 

  • Barker, R. L. (Ed.). (2003). The social work dictionary (5th ed.). Washington, DC: NASW.

    Google Scholar 

  • Boatman, S. A. (2000). Assessment of leadership programs: Enhancing student leadership development. Concepts & Connections, 9(1), 5–8.

    Google Scholar 

  • Brestan, E. V., Jacobs, J. R., Rayfield, A. D., & Eyberg, S. M. (1999). A consumer satisfaction measure for parent-child treatments and its relation to measures of child behavior change. Behavior Therapy, 30(1), 17–30.

    Article  Google Scholar 

  • Brungardt, C., & Crawford, C. B. (1996). A comprehensive approach to assessing leadership students and programs: Preliminary findings. Journal of Leadership & Organizational Studies, 3(1), 37–48.

    Article  Google Scholar 

  • Brungardt, C., Greenleaf, J., Brungardt, C., & Arensdorf, J. (2006). Majoring in leadership: A review of undergraduate leadership degree programs. Journal of Leadership Education, 5(1), 4–25.

    Article  Google Scholar 

  • Cashin, W. E. (1990). Student ratings of teaching: Recommendations for use. Manhattan: Center for Faculty Evaluation and Development (IDEA No. 22).

    Google Scholar 

  • Centra, J. A. (1998). Development of the student instructional report II. Princeton: Educational Testing Service.

    Google Scholar 

  • Chambers, T. (1994). Criteria to evaluate student leadership programs: What leadership educators consider important. NASPA Journal, 31(3), 225–234.

    Google Scholar 

  • Datta, L. E. (1997). A pragmatic basis for mixed‐method designs. New Directions for Evaluation, 1997(74), 33–46.

    Article  Google Scholar 

  • Delp, L., Brown, M., & Domenzain, A. (2005). Fostering youth leadership to address workplace and community environmental health issues: A university-school-community partnership. Health Promotion Practice, 6(3), 270–285.

    Article  PubMed  Google Scholar 

  • Denzin, N. K., & Lincoln, Y. S. (Eds.). (2011). The Sage handbook of qualitative research. Thousand Oaks: Sage.

    Google Scholar 

  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350.

    Google Scholar 

  • Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.

    Google Scholar 

  • Eyberg, S. M. (1993). Consumer satisfaction measures for assessing parent training programs. In L. VandeCreek, S. Knapp & T. L. Jackson (Eds.), Innovations in clinical practice: A source book (Vol. 12). Sarasota: Professional Resource Press.

    Google Scholar 

  • Hall, W. J., Zeveloff, A., Steckler, A., Schneider, M., Thompson, D., Pham, T., … & McMurray, R. G. (2012). Process evaluation results from the HEALTHY physical education intervention. Health Education Research, 27(2), 307–318.

    Google Scholar 

  • Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27(5), 711–731.

    Article  PubMed  Google Scholar 

  • Helitzer, D., Yoon, S. J., & Wallerstein, N. (2000). The role of process evaluation in the training of facilitators for an adolescent health education program. Journal of School Health, 70(4), 141–147.

    Article  PubMed  Google Scholar 

  • Howard, G. S. (1980). Response-shift bias a problem in evaluating interventions with pre/post self-reports. Evaluation Review, 4(1), 93–106.

    Article  Google Scholar 

  • Kalafat, J., Illback, R. J., & Sanders, D. (2007). The relationship between implementation fidelity and educational outcomes in a school-based family support program: Development of a model for evaluating multidimensional full-service programs. Evaluation and Program Planning, 30(2), 136–148.

    Article  PubMed  Google Scholar 

  • Kass, D., & Grandzol, C. (2011). Learning to lead at 5,267 feet. Journal of Leadership Education, 10(1), 41–62.

    Article  Google Scholar 

  • Keating, K., Rosch, D., & Burgoon, L. (2014). Developmental readiness for leadership: The differential effects of leadership courses on creating “ready, willing, and able” leaders. Journal of Leadership Education, 13(3), 1–16.

    Article  Google Scholar 

  • Komives, S. R. (2011). Advancing leadership education. In S. R. Komives, J. P. Dugan, J. E. Owen, W. Wagner, C. Slack & Associates (Eds.), Handbook for student leadership development (pp. 1–34). San Francisco: Wiley.

    Google Scholar 

  • Law, B. M. F., & Shek, D. T. L. (2011). Process evaluation of a positive youth development program: Project P.A.T.H.S. Research on Social Work Practice, 21, 539–548.

    Google Scholar 

  • Lebow, J. L. (1983). Research assessing consumer satisfaction with mental health treatment: A review of findings. Evaluation and Program Planning, 6(3), 211–236.

    Article  PubMed  Google Scholar 

  • Ma, H. K., & Shek, D. T. L. (2010). Subjective outcome evaluation of a positive youth development program in Hong Kong: Profiles and correlates. The Scientific World Journal, 10, 192–200.

    Article  PubMed  Google Scholar 

  • Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319–383). Dordrecht: Springer.

    Chapter  Google Scholar 

  • Marsh, H. W., Hau, K. T., Chung, C. M., & Siu, T. L. (1997). Students’ evaluations of university teaching: Chinese version of the students’ evaluations of educational quality instrument. Journal of Educational Psychology, 89(3), 568–572.

    Article  Google Scholar 

  • McCall, R. B., Green, B. L., Strauss, M. S., & Groark, C. J. (1998). Issues in community-based research and program evaluation. In W. Damon, I. E. Sigel & K. A. Renninger (Eds.), Handbook of child psychology (5th ed., Vol. 4): Child psychology in practice (pp. 955–997). New York: Wiley.

    Google Scholar 

  • Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice: A comprehensive guide. New York: Guilford Press.

    Google Scholar 

  • Ngai, N. P., Cheung, C. K., Ngai, S. S. Y., & To, S. M. (2012). Youth leadership training in Hong Kong: Current developments and the way ahead. International Journal of Adolescence and Youth, 17(2–3), 165–179.

    Google Scholar 

  • Owen, J. E. (2011). Assessment and evaluation. In S. R. Komives, J. P. Dugan, J. E. Owen, W. Wagner, C. Slack & Associates (Eds.), The handbook for student leadership development (pp. 177–202). San Francisco: Wiley.

    Google Scholar 

  • Patton, M. Q. (1990). Qualitative evaluation and research methods. Newbury Park: Sage.

    Google Scholar 

  • Posner, B. Z. (2009). A longitudinal study examining changes in students’ leadership behavior. Journal of College Student Development, 50(5), 551–563.

    Article  Google Scholar 

  • Priest, K. L., & Donley, S. (2014). Developing leadership for life: Outcomes from a collegiate student-alumni mentoring program. Journal of Leadership Education, 13(3), 107–117.

    Article  Google Scholar 

  • Riggio, R. E. (2008). Leadership development: The current state and future expectations. Consulting Psychology Journal: Practice and Research, 60(4), 383–392.

    Article  Google Scholar 

  • Rohs, F. R. (2002). Improving the evaluation of leadership programs. Journal of Leadership Education, 1(2), 50–61.

    Article  Google Scholar 

  • Royse, D. (2007). Research methods in social work. Belmont: Thomson Brooks/Cole.

    Google Scholar 

  • Royse, D., Thyer, B., & Padgett, D. (2006). Program evaluation: An introduction (4th ed.). Belmont: Wadsworth.

    Google Scholar 

  • Shapiro, J. P., Welker, C. J., & Jacobson, B. J. (1997). The youth client satisfaction questionnaire: Development, construct validation, and factor structure. Journal of Clinical Child Psychology, 26(1), 87–98.

    Article  PubMed  Google Scholar 

  • Shek, D. T. L. (2009). Subjective outcome and objective outcome evaluation findings: Insights from a Chinese context. Research on Social Work Practice, 20(3), 293–301.

    Article  Google Scholar 

  • Shek, D. T. L. (2013). Evaluation of the Project P.A.T.H.S. using multiple evaluation strategies. In D. T. L. Shek & R. C. F. Sun (Eds.), Development and evaluation of positive adolescent training through holistic social programs (P.A.T.H.S.) (pp. 53–67). Singapore: Springer.

    Google Scholar 

  • Shek, D. T. L. (2014). Evaluation data of subject “Service Leadership”. Unpublished data.

    Google Scholar 

  • Shek, D. T. L., & Li, X. (in press). Evaluation of an innovative leadership training program for Chinese students: Subjective outcome evaluation. International Journal on Disability and Human Development.

    Google Scholar 

  • Shek, D. T. L., & Liang, J. Q. (in press). Subjective outcome evaluation of a university subject on service leadership. International Journal on Disability and Human Development.

    Google Scholar 

  • Shek, D. T. L., Lin, L., & Liu, T. T. (2014a). Service leadership education for university students in Hong Kong: Subjective outcome evaluation. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0349.

  • Shek, D. T. L., Lin, L., Leung, H., Law, M. Y. M., & Li, X. (2014b, May 14–15). Evaluation of service leadership programs using multiple evaluation methods. Paper presented at the International Conference on Service Leadership Education for University Students: Experience in Hong Kong, Hong Kong.

    Google Scholar 

  • Shek, D. T. L., Lin, L., Liu, T. T., & Law, M. Y. M. (2014c). Process evaluation of a pilot subject on service leadership for university students in Hong Kong. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0351.

  • Shek, D. T. L., Lin, L., Liu, T. T., & Law, M. Y. M. (2014d). Service leadership education for university students in Hong Kong: Qualitative evaluation. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0350.

  • Shek, D. T. L., Yu, L., & Ma, C. M. S. (2014e). The students were happy but did they change positively? Yes, they did. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0348

  • Shek, D. T. L., Liu, T. T., & Law, M. Y. M. (in press-a). Focus group evaluation of a service leadership subject in Hong Kong. International Journal on Disability and Human Development.

    Google Scholar 

  • Shek, D. T. L., Xie, Q. Z., Lin, L., & Law, M. Y. M. (in press-b). Evaluation of a service leadership subject in Chinese university students in Hong Kong using focus groups. International Journal on Disability and Human Development.

    Google Scholar 

  • Thomas, L., & Beauchamp, C. (2011). Understanding new teachers’ professional identities through metaphor. Teaching and Teacher Education, 27(4), 762–769.

    Article  Google Scholar 

  • Weinbach, R. W. (2005). Evaluating social work services and programs. Boston: Allyn and Bacon.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Applied Social Sciences, The Hong Kong Polytechnic University, HJ407, Hunghom, Hong Kong, China

    Daniel T. L. Shek Ph.D., S.B.S., J.P

  2. Department of Applied Social Sciences, The Hong Kong Polytechnic University, V1214, Hunghom, Kowloon, Hong Kong

    Li Lin Ph.D

Authors
  1. Daniel T. L. Shek Ph.D., S.B.S., J.P
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Li Lin Ph.D
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel T. L. Shek Ph.D., S.B.S., J.P .

Editor information

Editors and Affiliations

  1. Department of Applied Social Sciences, The Hong Kong Polytechnic University, Hunghom, Hong Kong, China

    Daniel T.L. Shek

  2. Hong Kong Institute of Service Leadership & Management Limited, Wanchai, Hong Kong, China

    Po Chung

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Shek, D.T.L., Lin, L. (2015). Evaluating Service Leadership Programs with Multiple Strategies. In: Shek, D., Chung, P. (eds) Promoting Service Leadership Qualities in University Students. Quality of Life in Asia, vol 6. Springer, Singapore. https://doi.org/10.1007/978-981-287-515-0_13

Download citation

Publish with us

Policies and ethics

Search

Navigation