Advertisement

Prevention Science

, Volume 12, Issue 3, pp 235–246 | Cite as

Sustaining Fidelity Following the Nationwide PMTO™ Implementation in Norway

  • Marion S. Forgatch
  • David S. DeGarmo
Article

Abstract

This report describes three studies from the nationwide Norwegian implementation of Parent Management Training—Oregon Model (PMTO™), an empirically supported treatment for families of children with behavior problems (Forgatch and Patterson 2010). Separate stages of the implementation were evaluated using a fidelity measure based on direct observation of intervention sessions. Study 1 assessed growth in fidelity observed early, mid, and late in the training of a group of practitioners. We hypothesized increased fidelity and decreased variability in practice. Study 2 evaluated method fidelity over the course of three generations of practitioners trained in PMTO. Generation 1 (G1) was trained by the PMTO developer/purveyors; Generation 2 (G2) was trained by selected G1 Norwegian trainers; and Generation 3 (G3) was trained by G1 and G2 trainers. We hypothesized decrease in fidelity with each generation. Study 3 tested the predictive validity of fidelity in a cross-cultural replication, hypothesizing that higher fidelity scores would correlate with improved parenting practices observed in parent–child interactions before and after treatment. In Study 1, trainees’ performance improved and became more homogeneous as predicted. In Study 2, a small decline in fidelity followed the transfer from the purveyor trainers to Norwegian trainers in G2, but G3 scores were equivalent to those attained by G1. Thus, the hypothesis was not fully supported. Finally, the FIMP validity model replicated; PMTO fidelity significantly contributed to improvements in parenting practices from pre- to post-treatment. The data indicate that PMTO was transferred successfully to Norwegian implementation with sustained fidelity and cross-cultural generalization.

Keywords

Fidelity Implementation PMTO Intervention Parenting practices 

References

  1. Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J., Jr. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors: The Communities That Care Youth Survey. Evaluation Review, 26, 575–601.PubMedGoogle Scholar
  2. Bagner, D. M., & Eyberg, S. M. (2003). Father involvement in parent training: When does it matter? Journal of Clinical Child and Adolescent Psychology, 32, 599–605.PubMedCrossRefGoogle Scholar
  3. Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of 1-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388.PubMedCrossRefGoogle Scholar
  4. Bernal, G., Bonilla, J., & Bellido, J. (1995). Ecological validity and cultural sensitivity for outcome research: Issues for the cultural adaptation and development of psychosocial treatments with Hispanics. Journal of Abnormal Child Psychology, 23, 67–82.PubMedCrossRefGoogle Scholar
  5. Björnsdóttir, A., & Simarsdóttir, M. (2009). Parent Management Training—The Oregon Model (PMTO™): Effect of a prevention and treatment program for behavioral problems among kindergarten and elementary school children in Hafnarfjördur. Icelandic Journal of Education, 18, 9–28.Google Scholar
  6. Brown, H. C., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74–S104.PubMedCrossRefGoogle Scholar
  7. Bullard, L., Wachlarowicz, M., DeLeeuw, J., Snyder, J., Low, S., Forgatch, M. S., et al. (2010). Effects of the Oregon Model of Parent Management Training (PMTO) on marital adjustment in new stepfamilies: A randomized trial. Journal of Family Psychology, 24, 485–496.PubMedCrossRefGoogle Scholar
  8. Chamberlain, P., Davis, B., Forgatch, M. S., Frey, S., Patterson, G. R., Ray, J. R., et al. (1986). The Therapy Process Code: An observational system. Eugene: Oregon Social Learning Center.Google Scholar
  9. Clarke, P. (2008). When can group level clustering be ignored? Multilevel models versus single-level models with sparse data. Journal of Epidemiological Community Health, 62, 752–758.CrossRefGoogle Scholar
  10. DeGarmo, D. S., & Forgatch, M. S. (2007). Efficacy of parent training for stepfathers: From playful spectator and polite stranger to effective stepfathering. Parenting: Science and Practice, 7, 1–25.Google Scholar
  11. DeGarmo, D. S., Patterson, G. R., & Forgatch, M. S. (2004). How do outcomes in a specified parent training intervention maintain or wane over time? Prevention Science, 5, 73–89.PubMedCrossRefGoogle Scholar
  12. Domenech Rodríguez, M. M., Baumann, A. A., & Schwartz, A. L. (2011). Cultural adaptation of an evidence based intervention: From theory to practice in a Latino/a community context. American Journal of Community Psychology, 47, 170–186.PubMedCrossRefGoogle Scholar
  13. Dumas, J. E., Lynch, A. M., Laughlin, J. E., Smith, E. P., & Prinz, R. J. (2001). Promoting intervention fidelity: Conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. American Journal of Preventive Medicine, 20, 38–47.PubMedCrossRefGoogle Scholar
  14. Eames, C. (2008). The Leader Observation Tool: A process skills treatment fidelity measure for the Incredible Years parenting programme. Child Care, Health and Development, 34, 391–400.PubMedCrossRefGoogle Scholar
  15. Eddy, J. M., & Chamberlain, P. (2000). Family management and deviant peer association as mediators of the impact of treatment condition on youth antisocial behavior. Journal of Consulting and Clinical Psychology, 68, 857–863.PubMedCrossRefGoogle Scholar
  16. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.Google Scholar
  17. Fixsen, D. L., Naoom, S. F., Blase, K. A., & Wallace, F. (2007). Implementation: The missing link between research and practice. The APSAC Advisor, Winter/Spring, 4–11.Google Scholar
  18. Follette, W. C., & Beitz, K. (2003). Adding a more rigorous scientific agenda to the empirically supported treatment movement. Behavior Modification, 27, 369–386.PubMedCrossRefGoogle Scholar
  19. Forgatch, M. S., Principal Investigator. (2002–2007). Implementing parent management training in Norway (Grant No. R0116097). NIDA NNPRI: Community Multi-Site Prevention Trials (CMPT). Eugene: Oregon Social Learning Center.Google Scholar
  20. Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.PubMedCrossRefGoogle Scholar
  21. Forgatch, M. S., & Patterson, G. R. (2010). Parent management training—Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 159–178). New York: Guilford.Google Scholar
  22. Forgatch, M. S., Knutson, N. M., & Mayne, T. (1992). Coder impressions of ODS lab tasks. Eugene: Oregon Social Learning Center.Google Scholar
  23. Forgatch, M. S., DeGarmo, D. S., & Beldavs, Z. (2005a). An efficacious theory-based intervention for stepfamilies. Behavior Therapy, 36, 357–365.PubMedCrossRefGoogle Scholar
  24. Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005b). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training (PMTO). Behavior Therapy, 36, 3–13.PubMedCrossRefGoogle Scholar
  25. Forgatch, M. S., Patterson, G. R., DeGarmo, D. S., & Beldavs, Z. G. (2009). Testing the Oregon delinquency model with nine-year follow-up of the Oregon Divorce Study. Development and Psychopathology, 21, 637–660.PubMedCrossRefGoogle Scholar
  26. Glisson, C. (2007). Assessing and changing organizational culture and climate for effective services. Research on Social Work Practice, 17, 736–747.CrossRefGoogle Scholar
  27. Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11, 267–288.CrossRefGoogle Scholar
  28. Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33, 191–211.CrossRefGoogle Scholar
  29. Jeličić, H., Phelps, E., & Lerner, R. M. (2009). Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental Psychobiology, 45, 1195–1199.Google Scholar
  30. Knutson, N. M., Forgatch, M. S., Rains, L. A., & Sigmarsdóttir, M. (2009). Fidelity of Implementation Rating System (FIMP): The manual for PMTO™ (Revised ed.). Eugene, OR: Implementation Sciences International, Inc.Google Scholar
  31. McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84.PubMedCrossRefGoogle Scholar
  32. Muthén, L. K., & Muthén, B. O. (2010). MPlus: Statistical analysis with latent variables user’s guide (6th ed.). Los Angeles, CA: StatModel.Google Scholar
  33. Ogden, T., & Amlund-Hagen, K. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76, 607–621.PubMedCrossRefGoogle Scholar
  34. Ogden, T., Forgatch, M. S., Askeland, E., Patterson, G. R., & Bullock, B. M. (2005). Implementation of parent management training at the national level: The case of Norway. Journal of Social Work Practice, 19, 317–329.CrossRefGoogle Scholar
  35. Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys (Vol. 4). Eugene, OR: Castalia.Google Scholar
  36. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841.PubMedCrossRefGoogle Scholar
  37. Price, R. H. (2000, December). Mobilization, reinvention, and scaling up: Three core processes in knowledge exchange, adaptation, and implementation. Paper presented at the Inaugural World Conference, “The Promotion of Mental Health and Prevention of Mental and Behavioral Disorders,” Atlanta, GA.Google Scholar
  38. Reid, J. B., Fleischman, M. J., Arthur, J., Toobert, D. J., Stern, S., & Patterson, G. R. (1979, December). Therapist performance observational system. Paper presented at the Association for the Advancement of Behavior Therapy, San Francisco.Google Scholar
  39. Reid, J. B., Patterson, G. R., & Snyder, J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and model for intervention. Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  40. Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.Google Scholar
  41. Rohrbach, L. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.CrossRefGoogle Scholar
  42. Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471–499.PubMedCrossRefGoogle Scholar
  43. Stevens, V., Bourdeaudhuij, I. D., & Oost, P. V. (2001). Anti-bullying interventions at school: Aspects of programme adaptation and critical issues for further programme development. Health Promotion International, 16, 155–167.PubMedCrossRefGoogle Scholar
  44. Stoolmiller, M., & Bank, L. (1995). Autoregressive effects in structural equation models: We see some problems. In J. M. Gottman & G. Sackett (Eds.), The analysis of change (pp. 263–276). Hillsdale, NJ: Erlbaum.Google Scholar
  45. Stoolmiller, M., Duncan, T. E., Bank, L., & Patterson, G. R. (1993). Some problems and solutions in the study of change: Significant patterns of client resistance. Journal of Consulting and Clinical Psychology, 61, 920–928.PubMedCrossRefGoogle Scholar
  46. Stubbs, J., Crosby, L., Forgatch, M. S., & Capaldi, D. M. (1998). Family and peer process code: A synthesis of three Oregon Social Learning Center behavior codes. (Training manual.) Available at www.oslc.org/resources/codemanuals/familypeerprocesscode.pdf.
  47. Tremblay, R. E., Pagani-Kurtz, L., Mâsse, L. C., Vitaro, F., & Pihl, R. O. (1995). A bimodal preventive intervention for disruptive kindergarten boys: Its impact through mid-adolescence. Journal of Consulting and Clinical Psychology, 63, 560–568.PubMedCrossRefGoogle Scholar
  48. Waller, G. (2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119–127.PubMedCrossRefGoogle Scholar
  49. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.PubMedCrossRefGoogle Scholar

Copyright information

© Society for Prevention Research 2011

Authors and Affiliations

  1. 1.Oregon Social Learning CenterEugeneUSA
  2. 2.Implementation Sciences International, Inc.EugeneUSA

Personalised recommendations