Step 3 of EBP: Part 2—Evaluating Research Methods

  • James W. Drisko
  • Melissa D. Grady
Part of the Essential Clinical Social Work Series book series (ECSWS)


Step 3 of EBP centers on evaluating research quality and relevance. This chapter explores sampling, measures, definitions of treatments, and the use of the correct statistical tests in EBP research evaluation. Level of measure, sampling distributions, and different types of statistics are addressed. Treatment manuals are described and illustrated. All these components of research work in tandem to yield valid and rigorous results in quantitative clinical research. Of particular interest is how relevant research methods are to the unique client. This may be important for racially, ethnically, and/or gender nonconforming clients and for immigrant clients. This chapter examines these research methods issues in depth.


  1. Aberson, C. (2010). Applied power analysis for the behavioral sciences. New York: Routledge Academic.Google Scholar
  2. Abu-Bader, S. (2006). Using statistical methods in social work practice. New York: Lyceum Books.Google Scholar
  3. Abu-Bader, S. (2010). Advanced and multivariate statistical methods for social science research. New York: Oxford University Press.Google Scholar
  4. Achenbach, T., & Rescorla, L. (2000). Manual for the ASEBA preschool forms and profiles. Burlington, VT: University of Vermont Department of Psychiatry.Google Scholar
  5. Achenbach, T., & Rescorla, L. (2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.Google Scholar
  6. American Psychological Association. (2009). Publication manual of the American Psychological Association (6th ed.). Washington, D.C.: American Psychological Association.Google Scholar
  7. Anastas, J. W. (1999). Research design for social work and the human services (2nd ed.). New York: Columbia University Press.Google Scholar
  8. Andrews, G., Creamer, M., Crino, R., Hunt, C., Lampe, L., & Page, A. (2002). The treatment of anxiety disorders: Clinician guides and patient manuals. New York: Cambridge University Press.CrossRefGoogle Scholar
  9. Beck, A., Steer, R., Ball, R., & Ranieri, W. (1996). Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. Journal of Personality Assessment, 67(3), 588–597. CrossRefPubMedGoogle Scholar
  10. Benedek, D., & Wynn, G. (Eds.). (2011). Clinical manual for management of PTSD. Arlington, VA: American Psychiatric Publishing.Google Scholar
  11. Benuto, L. (2013). Guide to psychological assessment with Hispanics. New York: Springer Science+Business Media.CrossRefGoogle Scholar
  12. Benuto, L., & Leany, B. D. (Eds.). (2015). Guide to psychological assessment with African Americans. New York: Springer Science+Business Media.Google Scholar
  13. Benuto, L., Thaler, N., & Leany, B. D. (Eds.). (2014). Guide to psychological assessment with Asians. New York: Springer Science+Business Media.Google Scholar
  14. Binks, C., Fenton, M., McCarthy, L., Lee, T., Adams, C., & Duggan, C. (2006). Psychological therapies for people with borderline personality disorder. Cochrane Database of Systematic Reviews, (1), CD005652.
  15. Campbell, D., & Stanley, J. (1963). Experimental and quasi-experimental designs for research. New York: Wadsworth.Google Scholar
  16. Carlson, J., Geisinger, K., & Jonson, J. (Eds.). (2017). The twentieth mental measurements yearbook. Lincoln, NE: Buros Center for Testing.Google Scholar
  17. Center for Substance Abuse Treatment. (2007). Counselor’s treatment manual: Matrix intensive outpatient treatment for people with stimulant use disorders. DHHS Publication No. (SMA) 07-4152. Rockville, MD: Substance Abuse and Mental Health Services Administration. Retrieved from
  18. Cherubini, A., Del Signore, S., Ouslander, J., Semla, T., & Michel, J.-P. (2010). Fighting against age discrimination in clinical trials. Journal of the American Geriatrics Society, 58(9), 1791–1796.CrossRefGoogle Scholar
  19. Clarkin, J., Yoemans, F., & Kernberg, O. (2006). Psychotherapy for borderline personality: Focusing on object relations. Arlington, VA: American Psychiatric Publishing.Google Scholar
  20. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.CrossRefGoogle Scholar
  21. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Routledge Academic.Google Scholar
  22. Cook, T., & Campbell, D. (1979). Quasi-experimentation: Design & analysis issues for field settings. New York: Houghton Mifflin.Google Scholar
  23. Corcoran, K., & Fischer, J. (2014). Measures for clinical practice and research (5th ed.; 2 Vols.). New York: Oxford University Press.Google Scholar
  24. Cowger, C. (1984). Statistical significance tests: Scientific ritualism or scientific method? Social Service Review, 8(3), 358–372.CrossRefGoogle Scholar
  25. Dar, R., Serlin, R., & Omer, H. (1994). Misuse of statistical tests in three decades of psychotherapy research. Journal of Consulting and Clinical Psychology, 62(1), 75–82.CrossRefGoogle Scholar
  26. Dattalo, P. (2008). Determining sample size: Balancing power, precision, and practicality. New York: Oxford University Press.CrossRefGoogle Scholar
  27. Drisko, J. (2003, January 17). Improving sampling strategies and terminology in qualitative research. Paper presented at the Society for Social Work and Research Annual Meeting, Washington, D.C..Google Scholar
  28. Endicott, J., Spitzer, R., Fleiss, J., & Cohen, J. (1976). The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33(6), 766–771.CrossRefGoogle Scholar
  29. Engel, R., & Schutt, R. (2016). The practice of social work research (4th ed.). Thousand Oaks, CA: Sage.Google Scholar
  30. Furr, R. M., & Bacharach, V. (2007). Psychometrics: An introduction. Thousand Oaks, CA: Sage.Google Scholar
  31. Glickman, S., McHutchison, J., Peterson, E., Cairns, C., Harrington, R., Califf, R., et al. (2009). Ethical and scientific implications of the globalization of clinical research. New England Journal of Medicine, 360, 816–823.CrossRefGoogle Scholar
  32. Goldstein, E. (1995). Ego psychology and social work practice (2nd ed.). New York: Free Press.Google Scholar
  33. Goldstein, E. (2001). Object relations theory and self psychology in social work practice. New York: Free Press.Google Scholar
  34. Gormally, J., Black, S., Daston, S., & Rardin, D. (1982). The assessment of binge eating severity among obese persons. Addictive Behaviors, 7(1), 47–55.CrossRefGoogle Scholar
  35. Gupta, S. (2011). Intention-to-treat concept: A review. Perspectives in Clinical Research, 2(3), 109–112.CrossRefGoogle Scholar
  36. Haynes, R., Devereaux, P., & Guyatt, G. (2002). Clinical expertise in the era of evidence-based medicine and patient choice. Evidence-Based Medicine, 7, 36–38.CrossRefGoogle Scholar
  37. Horowitz, L., Alden, L., Wiggins, J., & Pincus, A. (2000). Inventory of Interpersonal Problems manual. Odessa, FL: The Psychological Corporation.Google Scholar
  38. Hudson, W. (1982). A measurement package for clinical workers. The Journal of Applied Behavioral Science, 18(2), 229–238.CrossRefGoogle Scholar
  39. Huxley, P. (1986). Statistical errors in papers in the British Journal of Social Work (Volumes 1–14). British Journal of Social Work, 16(6), 645–658.Google Scholar
  40. Jones, R. (1996). Handbook of test and measurements for black populations. (2 vols.). Hampton, VA: Cobb & Henry.Google Scholar
  41. Kraemer, H., & Blasey, C. (2016). How many subjects? Statistical power analysis in research. Thousand Oaks, CA: Sage.CrossRefGoogle Scholar
  42. Kuzel, A. (1999). Sampling in qualitative research. In B. Crabtree & W. Miller (Eds.), Doing qualitative research (pp. 33–46). Thousand Oaks, CA: Sage.Google Scholar
  43. LeCroy, C. W. (2008). Handbook of evidence-based treatment manuals for children and adolescents. New York: Oxford University Press.Google Scholar
  44. Leeper, J. (n.d.). Choosing the correct statistical test. Retrieved from
  45. Lock, J., Le Grange, D., Agras, W. S., & Dare, C. (2002). Treatment manual for Anorexia Nervosa: A family-based approach. New York: Guilford Press.Google Scholar
  46. Marshall, M., Lockwood, A., Bradley, C., Adams, C., Joy, C., & Fenton, M. (2000). Unpublished rating scales: A major source of bias in randomised controlled trails of treatment for schizophrenia. British Journal of Psychiatry, 176, 249–252.CrossRefGoogle Scholar
  47. Murphy, K., & Myers, B. (2014). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests (4th ed.). New York: Routledge.CrossRefGoogle Scholar
  48. Norman, G., & Streiner, D. (Eds.). (2003). PDQ statistics (3rd ed.). Shelton, CT: People’s Medical Publishing House (PMPH).Google Scholar
  49. Ollendick, T., King, N., & Chorpita, B. (2006). Empirically supported treatments for children and adolescents. In P. Kendall (Ed.), Child and adolescent therapy: Cognitive-behavioral procedures. New York: Guilford Press.Google Scholar
  50. Overall, J., & Gorham, D. (1962). The brief psychiatric rating scale. Psychological Reports, 10, 799–812.CrossRefGoogle Scholar
  51. Patton, M. Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage.Google Scholar
  52. Reilly, P., & Shopshire, M. (2002). Anger management for substance abuse and mental health clients: A cognitive behavioral therapy manual. Washington, D.C.: SAMHSA.Google Scholar
  53. Rubin, A., & Babbie, E. (2017). Research methods for social work (8th ed.). Boston, MA: Cengage.Google Scholar
  54. Rust, J., & Golombok, S. (2009). Modern psychometrics: The science of psychological assessment (3rd ed.). New York: Routledge.Google Scholar
  55. Sanderson, W., & Woody, S. (1995). Manuals for empirically validated treatments: A project of the Task Force on Psychological Interventions, Division of Clinical Psychology, American Psychological Association. Washington, D.C.: American Psychological Association.CrossRefGoogle Scholar
  56. Silverman, W. (1996). Cookbooks, manuals and paint by numbers: Psychotherapy in the 1990s. Psychotherapy, 33, 2017–2215.CrossRefGoogle Scholar
  57. Smith, E. (1995). A passionate, rationale response to the ‘manualization’ of psychotherapy. Psychological Bulletin, 22, 36–40.Google Scholar
  58. Spitzer, R., Williams, J., Gibbon, M., & First, M. (1990). Structured Clinician Interview for DSM-III-R Axis II Disorders (SCID-II). Washington, D.C.: American Psychiatric Press.Google Scholar
  59. Stark, K., Streusand, W., Krumholz, L., & Patel, P. (2010). Cognitive-behavioral therapy for depression: The ACTION treatment program for girls. In J. Weisz & A. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 93–109). New York: Guilford.Google Scholar
  60. Telch, C., Agras, W. S., & Linehan, M. (2002). Dialectal behavior therapy for binge eating disorder. Journal of Consulting and Clinical Psychology, 69(6), 1061–1065.CrossRefGoogle Scholar
  61. Trepper, T., McCollum, E., DeJong, P., Korman, H., Gingerich, W., & Franklin, C. (n.d.). Solution focused therapy: Treatment manual for working with individuals (preliminary). Research Committee of the Association for Solution Focused Therapy. Retrieved from
  62. Truijens, F., Zühlke-van Hulzen, L., & Vanheule, S. (2019). To manualize, or not to manualize: Is that still the question? A systematic review of empirical evidence for manual superiority in psychological treatment. Journal of Clinical Psychology, 75, 329–343. CrossRefPubMedPubMedCentralGoogle Scholar
  63. Weinbach, R., & Grinnell, R. (2014). Statistics for social workers (9th ed.). New York: Pearson.Google Scholar
  64. Wilt, T., MacDonald, R., Rutks, I., Shamliyan, T., Taylor, B., & Kane, R. (2008). Systematic review: Comparative effectiveness and harms of treatments for clinically localized prostate cancer. Annals of Internal Medicine, 148(6), 435–448.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • James W. Drisko
    • 1
  • Melissa D. Grady
    • 2
  1. 1.School for Social WorkSmith CollegeNorthamptonUSA
  2. 2.School of Social ServiceCatholic University of AmericaWashington, DCUSA

Personalised recommendations