Skip to main content
SpringerLink
Log in

Evaluation of the Project P.A.T.H.S. Using Multiple Evaluation Strategies

  • Chapter
  • First Online:
Development and Evaluation of Positive Adolescent Training through Holistic Social Programs (P.A.T.H.S.)

Part of the book series: Quality of Life in Asia ((QLAS,volume 3))

Abstract

To give a comprehensive and all-round evaluation of the Tier 1 Program of the Project P.A.T.H.S., an evaluation design incorporating the elements of post-positivism and pragmatism was proposed. There were several emphases in the evaluation design: use of multiple evaluation strategies, use of multiple outcome indicators, capturing the views of different stakeholders including program participants and implementers, collection of quantitative and qualitative data, inclusion of process and outcome evaluation, and evaluation at different time points. Several evaluation strategies including objective outcome evaluation, subjective outcome evaluation, process evaluation, qualitative evaluation based on focus groups, student weekly diaries and in-depth interviews, and repertory grid test evaluation were carried out to evaluate the Tier 1 Program of the Project P.A.T.H.S. in Hong Kong.

The preparation for this chapter and the Project P.A.T.H.S. were financially supported by The Hong Kong Jockey Club Charities Trust. Address all correspondence to Daniel T.L. Shek, Department of Applied Social Sciences, The Hong Kong Polytechnic University, Hunghom, Hong Kong (e-mail address: daniel.shek@polyu.edu.hk).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5(3), 233–237.

    Article  PubMed  Google Scholar 

  • Carr, L. T. (1994). The strengths and weakness of quantitative and qualitative research: What method for nursing? Journal of Advanced Nursing, 20(4), 716–721.

    Article  PubMed  Google Scholar 

  • Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., & Hawkins, J. D. (2004). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. The Annals of the American Academy of Political and Social Science, 591, 98–124.

    Article  Google Scholar 

  • Cnaan, R. A. (1991). Applying clinical trials in social work practice. Research on Social Work Practice, 1(2), 139–161.

    Article  Google Scholar 

  • Cook, T. D. (2003). Why have educational evaluators chosen not to do randomized experiments? The Annals of the American Academy of Political and Social Science, 589, 114–149.

    Article  Google Scholar 

  • Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45.

    Article  PubMed  Google Scholar 

  • Datta, L. (1994). Paradigm wars: A basis for peaceful coexistence and beyond. In C. S. Reichardt & S. F. Rallis (Eds.), The qualitative-quantitative debate: New perspectives (pp. 53–70). San Francisco: Jossey-Bass.

    Google Scholar 

  • Denzin, N. K., & Lincoln, Y. S. (2011). Handbook of qualitative research (4th ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Denzin, N. K. (1978). The research act: A theoretical introduction to sociological methods. New York: McGraw-Hill.

    Google Scholar 

  • Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193–221.

    Article  Google Scholar 

  • Durlak, J. A. (1997). Successful prevention programs for children and adolescents. New York: Plenum.

    Book  Google Scholar 

  • Ginsberg, L. H. (2001). Social work evaluation: Principles and methods. Boston: Allyn & Bacon.

    Google Scholar 

  • Greene, J. C., & Caracelli, V. J. (1997). Advances in mixed-method evaluation: The challenges and benefits of integrating diverse paradigms. San Francisco: Jossey-Bass.

    Google Scholar 

  • Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Education Evaluation and Policy Analysis, 11(3), 255–274.

    Google Scholar 

  • Holcomb, W. R., Adams, N. A., Ponder, H. M., & Reitz, R. (1989). The development and construct validation of a consumer satisfaction questionnaire for psychiatric inpatients. Evaluation and Program Planning, 12(2), 189–194.

    Article  PubMed  Google Scholar 

  • Janesick, V. J. (1998). The dance of qualitative research design. In N. K. Denzin & Y. S. Lincoln (Eds.), Strategies of qualitative inquiry (pp. 35–55). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Kelly, G. (1955). The psychology of personal constructs (Vol. 1–2). New York: Norton.

    Google Scholar 

  • LaSala, M. C. (1997). Client satisfaction: Consideration of correlates and response bias. Families in Society, 78(1), 54–64.

    Article  Google Scholar 

  • Linnan, L., & Steckler, A. (2002). Process evaluation for public health interventions and research: An overview. In A. Steckler & L. Linnan (Eds.), Process evaluation for public health interventions and research (pp. 1–23). San Francisco: Jossey-Bass.

    Google Scholar 

  • Luk, A. L., & Shek, D. T. L. (2006). Perceived personal changes in Chinese ex-mental patients attending a holistic psychiatric rehabilitation program. Social Behavior and Personality, 34(8), 939–954.

    Article  Google Scholar 

  • Mathison, S. (1988). Why triangulate? Educational Researcher, 17(2), 13–17.

    Article  Google Scholar 

  • McCall, R. B., Green, B. L., Strauss, M. S., & Groark, C. J. (1998). Issues in community-based research and program evaluation. In I. E. Siegel & K. A. Renninger (Eds.), Handbook of child psychology: Child psychology in practice (Vol. 4, pp. 955–997). New York: Wiley.

    Google Scholar 

  • Meinart, C. L., Heinz, E. C., & Forman, S. A. (1983). The Coronary Drug Project. Role and method of the coordinating center. Controlled Clinical Trials, 4(4), 355–375.

    Article  Google Scholar 

  • Ng, H. Y., & Shek, D. T. L. (2001). Religion and therapy: Religious conversion and the mental health of chronic heroin-addicted persons. Journal of Religion and Health, 40(4), 399–410.

    Article  Google Scholar 

  • Patton, M. Q. (1987). Creative evaluation (2nd ed.). Newbury Park, CA: Sage.

    Google Scholar 

  • Patton, M. Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage.

    Google Scholar 

  • Patton, M. Q. (2002). Two decades of developments in qualitative inquiry: A personal, experiential perspective. Qualitative Social Work, 1(3), 261–283.

    Article  Google Scholar 

  • Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2002). Scared Straight and other juvenile awareness programs for preventing juvenile delinquency. Retrieved from http://www.campbellcollaboration.org/lib/download/13/

  • Petrosino, A., Turpin-Petrosino, C., & Finckenauer, J. O. (2000). Well-meaning programs can have harmful effects! Lessons from experiments in Scared Straight and other like programs. Crime and Delinquency, 46, 354–379.

    Article  Google Scholar 

  • Royse, D. (2004). Research methods in social work (4th ed.). Chicago: Nelson-Hall.

    Google Scholar 

  • Scales, P. C., Benson, P. L., Leffert, N., & Blyth, D. A. (2000). Contribution of developmental assets to the prediction of thriving among adolescents. Applied Developmental Science, 4(1), 27–46.

    Article  Google Scholar 

  • Scheirer, M. A. (1994). Designing and using process evaluation. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (pp. 40–68). San Francisco: Jossey-Bass.

    Google Scholar 

  • Shek, D. T. L. (2010). Subjective outcome and objective outcome evaluation findings: Insights from a Chinese context. Research on Social Work Practice, 20(3), 293–301.

    Article  Google Scholar 

  • Shek, D. T. L., & Lam, C. W. (2011). Evaluation of a prevention drug education program in Hong Kong using the repertory grid method. International Journal of Child Health and Human Development, 4(4), 421–432.

    Google Scholar 

  • Shek, D. T. L., & Ma, C. M. S. (2010). Dimensionality of the Chinese Positive Youth Development Scale: Confirmatory factor analyses. Social Indicators Research, 98(1), 41–59.

    Article  Google Scholar 

  • Shek, D. T. L., & Ma, C. M. S. (2011). Longitudinal data analyses using linear mixed models in SPSS: Concepts, procedures and illustrations. The Scientific World Journal: TSW Child Health and Human Development, 11, 42–76.

    Article  Google Scholar 

  • Shek, D. T. L., Siu, A. M. H., & Lee, T. Y. (2007). The Chinese Positive Youth Development Scale: A validation study. Research on Social Work Practice, 17(3), 380–391.

    Article  Google Scholar 

  • Shek, D. T. L., & Sun, R. C. F. (2012). Epilogue: The Project P.A.T.H.S. in Hong Kong: Lessons learned and implications for positive youth development programs. The Scientific World Journal. Advance online publication, 2012, 6p. doi:10.1100/2012/687536.

  • Shek, D. T. L., & Yu, L. (2011). A review of validated youth prevention and positive youth development programs in Asia. International Journal of Adolescent Medicine and Health, 23(4), 317–324.

    PubMed  Google Scholar 

  • Stanley, B. (1985). Alienation in young offenders. In N. Beail (Ed.), Repertory grid technique and personal constructs: Applications in clinical and educational settings (pp. 47–60). London: Croom Helm.

    Google Scholar 

  • Tashakori, A., & Teddlie, C. (2010). Sage handbook of mixed methods in social and behavioral research (2nd ed.). Los Angeles: Sage.

    Google Scholar 

  • Thyer, B. (2002). Evaluation of social work practice in the new millennium: Myths and realities. In D. T. L. Shek, M. C. Lam, C. F. Au, & J. J. Lee (Eds.), Entering a new millennium: Advances in social welfare service and research (pp. 3–18). Hong Kong: New Asia College and the Chinese University Press, The Chinese University of Hong Kong.

    Google Scholar 

  • Vandiver, V., Jordan, C., Keopraseuth, K., & Yu, M. (1995). Family empowerment and service satisfaction: An exploratory study of Laotian families who care for a family member with mental illness. Psychiatric Rehabilitation Journal, 19(1), 47–55.

    Article  Google Scholar 

  • Walsh, T., & Lord, B. (2004). Client satisfaction and empowerment through social work intervention. Social Work in Health Care, 38(4), 37–56.

    Article  PubMed  Google Scholar 

  • Weinbach, R. W. (2005). Evaluating social work services and programs. Boston: Allyn & Bacon.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Applied Social Sciences, The Hong Kong Polytechnic University, Hung Hom, Hong Kong

    Daniel T. L. Shek Ph.D., FHKPS, BBS, JP

Authors
  1. Daniel T. L. Shek Ph.D., FHKPS, BBS, JP
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel T. L. Shek Ph.D., FHKPS, BBS, JP .

Editor information

Editors and Affiliations

  1. Department of Applied Social Sciences, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR

    Daniel T.L. SHEK

  2. Faculty of Education, The University of Hong Kong, Pok Fu Lam Rd, Hong Kong, Hong Kong SAR

    Rachel C. F. Sun

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Shek, D.T.L. (2013). Evaluation of the Project P.A.T.H.S. Using Multiple Evaluation Strategies. In: SHEK, D., Sun, R. (eds) Development and Evaluation of Positive Adolescent Training through Holistic Social Programs (P.A.T.H.S.). Quality of Life in Asia, vol 3. Springer, Singapore. https://doi.org/10.1007/978-981-4451-54-3_4

Download citation

Publish with us

Policies and ethics

Search

Navigation