Advertisement

What Motivates Mental Health Clinicians-in-Training to Implement Evidence-Based Assessment? A Survey of Social Work Trainees

  • Viktor LushinEmail author
  • Emily M. Becker-Haimes
  • David Mandell
  • Jordan Conrad
  • Victor Kaploun
  • Sophia Bailey
  • Ai Bo
  • Rinad S. Beidas
Original Article

Abstract

Mental health clinicians do not consistently use evidence-based assessment (EBA), a critical component of accurate case conceptualization and treatment planning. The present study used the Unified Theory of Behavior to examine determinants of intentions to use EBA in clinical practice among a sample of Masters’ level social work trainees (N = 241). Social norms had the largest effect on intentions to use EBA. Injunctive norms in reference to respected colleagues accounted for the most variance in EBA intentions. Findings differed for respondents over 29 years of age versus younger respondents. Implications for implementation strategies and further research are discussed.

Keywords

Pre-service implementation strategies Behavioral health Evidence-based assessment Measurement-based care 

Notes

Acknowledgements

The authors express cordial gratitude to Benjamin Lane, Rachel Shin, H’Vanna Samuels, Lily Kirschenbaum, Unique Starks, Leilei Huang, and Matthew Macauley, for coordinating and conducting data collection and other important functions during this research project.

Compliance with Ethical Standards

Conflict of interest

All authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study was approved by New York University Internal Renew Board (IRB Number: IRB-FY2017-603). This article does not contain any studies with animals performed by any of the authors.

References

  1. Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34(4), 411–419.PubMedCrossRefGoogle Scholar
  2. Aarons, G. A., & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3(1), 61.PubMedPubMedCentralCrossRefGoogle Scholar
  3. Ajzen, I., & Fishbein, M. (2005). The influence of attitudes on behavior. The Handbook of Attitudes, 173(221), 31.Google Scholar
  4. Bandura, A. (1986). The explanatory and predictive scope of self-efficacy theory. Journal of Social and Clinical Psychology, 4(3), 359.CrossRefGoogle Scholar
  5. Bandura, A. (2004). Health promotion by social cognitive means. Health Education & Behavior, 31(2), 143–164.CrossRefGoogle Scholar
  6. Becker-Haimes, E. M., Okamura, K. H., Baldwin, C. D., Wahesh, E., Schmidt, C., & Beidas, R. S. (2018). Understanding the landscape of behavioral health pre-service training to inform evidence-based intervention implementation. Psychiatric Services.  https://doi.org/10.1176/appi.ps.201800220 PubMedCrossRefGoogle Scholar
  7. Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., … Adams, D. R. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382.PubMedPubMedCentralCrossRefGoogle Scholar
  8. Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., Aarons, G., Hoagwood, K., Evans, A., Hurford, M., Rubin, R., Hadley, T., Mandell, D. S., & Barg, F. K. (2016). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 893–908.PubMedCrossRefGoogle Scholar
  9. Bollen, K. A., & Long, J. S. (1992). Tests for structural equation models: Introduction. Sociological Methods & Research, 21(2), 123–131.CrossRefGoogle Scholar
  10. Budescu, D. V., & Azen, R. (2004). Beyond global measures of relative importance: Some insights from dominance analysis. Organizational Research Methods, 7(3), 341–350.CrossRefGoogle Scholar
  11. Burns, H. K., Puskar, K., Flaherty, M. T., Mitchell, A. M., Hagle, H., Braxter, B., … Terhorst, L. (2012). Addiction Training for undergraduate nurses using screening, brief intervention, and referral to treatment. Journal of Nursing Education and Practice, 2(4), 167.CrossRefGoogle Scholar
  12. Chang, A. M., & Crowe, L. (2011). Validation of scales measuring self-efficacy and outcome expectancy in evidence-based practice. Worldviews on Evidence-Based Nursing, 8(2), 106–115.PubMedCrossRefGoogle Scholar
  13. Colton, C. W., & Manderscheid, R. W. (2006). PEER REVIEWED: Congruencies in increased mortality rates, years of potential life lost, and causes of death among public mental health clients in eight states. Preventing Chronic Disease, 3(2), A42PubMedPubMedCentralGoogle Scholar
  14. De Los Reyes, A., & Aldao, A. (2015). Introduction to the special issue: Toward implementing physiological measures in clinical child and adolescent assessments. Journal of Clinical Child & Adolescent Psychology, 44(2), 221–237.CrossRefGoogle Scholar
  15. Donaldson, A. L. (2015). Pre-professional training for serving children with ASD: An apprenticeship model of supervision. Teacher Education and Special Education, 38(1), 58–70.CrossRefGoogle Scholar
  16. Estrada, N. (2009). Exploring perceptions of a learning organization by RNs and relationship to EBP beliefs and implementation in the acute care setting. Worldviews on Evidence-Based Nursing, 6(4), 200–209.PubMedCrossRefGoogle Scholar
  17. Fishbein, M., & Ajzen, I. (2011). Predicting and changing behavior: The reasoned action approach. Boca Raton: Taylor & Francis.CrossRefGoogle Scholar
  18. Fishman, J., Beidas, R., Reisinger, E., & Mandell, D. S. (2018). The utility of measuring intentions to use best practices: A longitudinal study among teachers supporting students with autism. Journal of School Health, 88(5), 388–395.PubMedCrossRefGoogle Scholar
  19. French, S. D., Green, S. E., O’Connor, D. A., McKenzie, J. E., Francis, J. J., Michie, S., … Grimshaw, J. M. (2012). Developing theory-informed behaviour change interventions to implement evidence into practice: A systematic approach using the Theoretical Domains Framework. Implementation Science, 7(1), 38.PubMedCrossRefGoogle Scholar
  20. Grady, M. D., Wike, T., Putzu, C., Field, S., Hill, J., Bledsoe, S. E., … Massey, M. (2018). Recent social work practitioners’ understanding and use of evidence-based practice and empirically supported treatments. Journal of Social Work Education, 54(1), 163–179.CrossRefGoogle Scholar
  21. Guilamo-Ramos, V., Bouris, A., Jaccard, J., Gonzalez, B., McCoy, W., & Aranda, D. (2011). A parent-based intervention to reduce sexual risk behavior in early adolescence: Building alliances between physicians, social workers, and parents. Journal of Adolescent Health, 48(2), 159–163.PubMedCrossRefGoogle Scholar
  22. Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52(9), 1179–1189.PubMedCrossRefGoogle Scholar
  23. Huey, L. Y. (2002). Problems in behavioral health care: Leap-frogging the status quo. Administration and Policy in Mental Health and Mental Health Services Research, 29(4–5), 403–419.PubMedCrossRefGoogle Scholar
  24. Jaccard, J., Dodge, T., & Dittus, P. (2002). Parent-adolescent communication about sex and birth control: A conceptual framework. New Directions for Child and Adolescent Development, 2002(97), 9–42.CrossRefGoogle Scholar
  25. Jaccard, J., & Jacoby, J. (2009). Theory construction and model-building skills: A practical guide for social scientists. New York: Guilford Press.Google Scholar
  26. Jaccard, J., & Levitz, N. (2015). Parent-based interventions to reduce adolescent problem behaviors: New directions for self-regulation approaches. In Self-regulation in adolescence. New York: Cambridge University Press.Google Scholar
  27. Jensen-Doss, A. (2011). Practice involves more than treatment: How can evidence-based assessment catch up to evidence-based treatment? Clinical Psychology: Science and Practice, 18(2), 173–177.Google Scholar
  28. Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896.CrossRefGoogle Scholar
  29. Jensen-Doss, A., Smith, A. M., Becker-Haimes, E. M., Ringle, V. M., Walsh, L. M., Nanda, M., … Lyon, A. R. (2017). Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. Administration and Policy in Mental Health and Mental Health Services Research 45(3), 392–403CrossRefGoogle Scholar
  30. Kanfer, F. H., Karoly, P., & Newman, A. (1975). Reduction of children’s fear of the dark by competence-related and situational threat-related verbal cues. Journal of Consulting and Clinical Psychology, 43(2), 251.PubMedCrossRefGoogle Scholar
  31. Kazdin, A. E. (2017). Addressing the treatment gap: A key challenge for extending evidence-based psychosocial interventions. Behaviour Research and Therapy, 88, 7–18.PubMedCrossRefGoogle Scholar
  32. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301.Google Scholar
  33. Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., … Rutkowski, D. (2015). Implementing measurement-based care (iMBC) for depression in community mental health: A dynamic cluster randomized trial study protocol. Implementation Science, 10(1), 127.PubMedCrossRefGoogle Scholar
  34. Love, S. M., Koob, J. J., & Hill, L. E. (2007). Meeting the challenges of evidence-based practice: Can mental health therapists evaluate their practice? Brief Treatment and Crisis Intervention, 7(3), 184.CrossRefGoogle Scholar
  35. Lushin, V. (2017). Underage drinking, parental self-efficacy and communication of alcohol expectations among latino families in New York (Doctoral dissertation, New York University).Google Scholar
  36. Lushin, V., Beidas, R., Conrad, J., Marcus, S., & Mandell, D. (In preparation). Implementation of evidence-based assessment: Thoughts and experiences of social work trainees.Google Scholar
  37. Lyon, A. R., Dorsey, S., Pullmann, M., Silbaugh-Cowdin, J., & Berliner, L. (2015). Clinician use of standardized assessments following a common elements psychotherapy training and consultation program. Administration and Policy in Mental Health and Mental Health Services Research, 42(1), 47–60.PubMedCrossRefGoogle Scholar
  38. MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological methods, 7(1), 83.PubMedPubMedCentralCrossRefGoogle Scholar
  39. McLeod, B. D., Jensen-Doss, A., & Ollendick, T. H. (2013). Overview of diagnostic and behavioral assessment. In B. D. McLeod, A. Jensen-Doss & T. H. Ollendick (Eds.), Diagnostic and behavioral assessment in children and adolescents: A clinical guide (pp. 3–33). New York: Guilford Press.Google Scholar
  40. McNeill, T. (2006). Evidence-based practice in an age of relativism: Toward a model for practice. Social Work, 51(2), 147–156.PubMedCrossRefGoogle Scholar
  41. Middlestadt, S. E. (2012). Beliefs underlying eating better and moving more: Lessons learned from comparative salient belief elicitations with adults and youths. The Annals of the American Academy of Political and Social Science, 640(1), 81–100.CrossRefGoogle Scholar
  42. Middlestadt, S. E., Bhattacharyya, K., Rosenbaum, J., Fishbein, M., & Shepherd, M. (1996). The use of theory based semistructured elicitation questionnaires: Formative research for CDC’s prevention marketing initiative. Public Health Reports, 111(Suppl 1), 18.PubMedPubMedCentralGoogle Scholar
  43. Nelson, K. M., Helfrich, C., Sun, H., Hebert, P. L., Liu, C. F., Dolan, E., … Sanders, W. (2014). Implementation of the patient-centered medical home in the Veterans Health Administration: Associations with patient satisfaction, quality of care, staff burnout, and hospital and emergency department use. JAMA Internal Medicine, 174(8), 1350–1358.PubMedCrossRefGoogle Scholar
  44. New York University Silver School of Social Work. Masters of social work course descriptions. Retrieved 02 February 2018 from https://socialwork.nyu.edu/academics/msw/course-descriptions.html.
  45. Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46(3), 598.CrossRefGoogle Scholar
  46. Pignotti, M., & Thyer, B. A. (2009). Use of novel unsupported and empirically supported therapies by licensed clinical social workers: An exploratory study. Social Work Research, 33(1), 5–17.CrossRefGoogle Scholar
  47. Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879.PubMedCrossRefPubMedCentralGoogle Scholar
  48. Polanyi, M. (1966). The logic of tacit inference. Philosophy, 41(155), 1–18.CrossRefGoogle Scholar
  49. Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467.CrossRefGoogle Scholar
  50. Posner, K. (2016). Evidence-based assessment to improve assessment of suicide risk, ideation, and behavior. Journal of the American Academy of Child & Adolescent Psychiatry, 55(10), S95.CrossRefGoogle Scholar
  51. Prince, M. A., & Carey, K. B. (2010). The malleability of injunctive norms among college students. Addictive Behaviors, 35(11), 940–947.PubMedPubMedCentralCrossRefGoogle Scholar
  52. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24–34.PubMedCrossRefPubMedCentralGoogle Scholar
  53. Rosenstock, I. M., Strecher, V. J., & Becker, M. H. (1988). Social learning theory and the health belief model. Health education quarterly, 15(2), 175–183.PubMedCrossRefGoogle Scholar
  54. SAMHSA. (2013). Behavioral Health, United States, 2013. HHS Publication No. (SMA) 13-4797. Rockville, MD: SAMSHA.Google Scholar
  55. Santa Maria, D., Markham, C., Crandall, S., & Guilamo-Ramos, V. (2017). Preparing student nurses as parent-based adolescent sexual health educators: Results of a pilot study. Public Health Nursing, 34(2), 130–137.PubMedCrossRefGoogle Scholar
  56. Schacht, R. L., Dimidjian, S., George, W. H., & Berns, S. B. (2009). Domestic violence assessment procedures among couple therapists. Journal of Marital and Family Therapy, 35(1), 47–59.PubMedCrossRefGoogle Scholar
  57. Stanhope, V., Tuchman, E., & Sinclair, W. (2011). The implementation of mental health evidence based practices from the educator, clinician and researcher perspective. Clinical Social Work Journal, 39(4), 369–378.CrossRefGoogle Scholar
  58. Szydlowski, S., & Smith, C. (2009). Perspectives from nurse leaders and chief information officers on health information technology implementation. Hospital Topics, 87(1), 3–9.PubMedCrossRefGoogle Scholar
  59. Tennille, J., Solomon, P., Brusilovskiy, E., & Mandell, D. (2016). Field instructors extending EBP learning in dyads (FIELD): Results of a pilot randomized controlled trial. Journal of the Society for Social Work and Research, 7(1), 1–22.CrossRefGoogle Scholar
  60. Touati, N., Roberge, D., Denis, J. L., Cazale, L., Pineault, R., & Tremblay, D. (2006). Clinical leaders at the forefront of change in health-care systems: Advantages and issues. Lessons learned from the evaluation of the implementation of an integrated oncological services network. Health Services Management Research, 19(2), 105–122.PubMedCrossRefGoogle Scholar
  61. Townsend, M. C., & Morgan, K. I. (2017). Psychiatric mental health nursing: Concepts of care in evidence-based practice. Philadelphia: FA Davis.Google Scholar
  62. Triandis, H. C. (1996). The psychological measurement of cultural syndromes. American Psychologist, 51(4), 407.CrossRefGoogle Scholar
  63. Williams, E. C., Johnson, M. L., Lapham, G. T., Caldeiro, R. M., Chew, L., Fletcher, G. S., … Bradley, K. A. (2011). Strategies to implement alcohol screening and brief intervention in primary care settings: A structured literature review. Psychology of Addictive Behaviors, 25(2), 206.PubMedCrossRefGoogle Scholar
  64. Youngstrom, E. A., Van Meter, A., Frazier, T. W., Hunsley, J., Prinstein, M. J., Ong, M. L., & Youngstrom, J. K. (2017). Evidence-based assessment as an integrative model for applying psychological science to guide the voyage of treatment. Clinical Psychology: Science and Practice, 24(4), 331–363Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.University of Pennsylvania Perelman School of MedicinePhiladelphiaUSA
  2. 2.New York University School of Social WorkNew YorkUSA
  3. 3.National Research University Higher School of EconomicsSt. PetersburgRussia

Personalised recommendations