The Impact of Teachers’ Modifications of an Evidenced-Based HIV Prevention Intervention on Program Outcomes
The degree to which evidence-based program outcomes are affected by modifications is a significant concern in the implementation of interventions. The ongoing national implementation of an evidence-based HIV prevention program targeting grade 6 students in The Bahamas [Focus on Youth in The Caribbean (FOYC)] offers an opportunity to explore factors associated with teachers’ modification of FOYC lessons and to examine the impact of types and degrees of modifications on student outcomes. Data were collected in 2012 from 155 teachers and 3646 students in 77 government elementary schools. Results indicate that teachers taught 16 of 30 core activities, 24.5 of 46 total activities and 4.7 of 8 sessions. Over one-half of the teachers made modifications to FOYC core activities; one-fourth of the teachers modified 25 % or more core activities that they taught (heavily modified FOYC). Omitting core activities was the most common content modification, followed by lengthening FOYC lessons with reading, writing assignments or role-play games, and shortening core activities or adding educational videos. Mixed-effects modeling revealed that omitting core activities had negative impacts on all four student outcomes. Shortening core activities and adding videos into lessons had negative impacts on HIV/AIDS knowledge and/or intention to use condom protection. Heavy modifications (>1/4 core activities) were associated with diminished program effectiveness. Heavy modifications and omitting or shortening core activities were negatively related to teachers’ level of implementation. We conclude that poorer student outcomes were associated with heavy modifications.
KeywordsImplementation HIV prevention Modification of the intervention Fidelity of implementation Adolescents The Bahamas
Compliance with Ethical Standards
This study was funded by the National Institute of Child Health and Human Development (R01HD064350).
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all participants included in the study.
- Chen, X., Stanton, B., Gomez, P., Lunn, S., Deveaux, L., Brathwaite, N., et al. (2010). Effects on condom use of an HIV prevention programme 36 months postintervention: A cluster randomized controlled trial among Bahamian youth. International Journal of STD & AIDS, 21, 622–630.CrossRefGoogle Scholar
- Galbraith, J. S., Stanton, B., Boekeloo, B., King, W., Desmond, S., Howard, D., et al. (2009). Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: Lessons learned from the focus on kids diffusion case study. Health Education & Behavior, 36, 532–549.CrossRefGoogle Scholar
- Kalichman, S. C., Kelly, J. A., Hunter, T. L., Murphy, D. A., & Tyler, R. (1993). Culturally tailored HIV-AIDS risk-reduction messages targeted to African-American urban women: Impact on risk sensitization and risk reduction. Journal of Consulting and Clinical Psychology, 61, 291–295.PubMedCrossRefGoogle Scholar
- Lyles, C. M., Kay, L. S., Crepaz, N., Herbst, J. H., Passin, W. F., Kim, A. S., et al. (2007). Best-evidence interventions: Findings from a systematic review of HIV behavioral interventions for US populations at high risk, 2000-2004. American Journal of Public Health, 97, 133–143.PubMedPubMedCentralCrossRefGoogle Scholar
- Renju, J. R., Andrew, B., Medard, L., Kishamawe, C., Kimaryo, M., Changalucha, J., et al. (2011). Scaling up adolescent sexual and reproductive health interventions through existing government systems? A detailed process evaluation of a school-based intervention in Mwanza region in the northwest of Tanzania. Journal of Adolescent Health, 48, 79–86.PubMedCrossRefGoogle Scholar
- Stanton, B., Deveaux, L., Lunn, S., Yu, S., Brathwaite, N., Li, X., et al. (2009). Condom-use skills checklist: A proxy for assessing condom-use knowledge and skills when direct observation is not possible. Journal of Health, Population, and Nutrition, 27, 406–413.PubMedPubMedCentralCrossRefGoogle Scholar
- Wang, B., Stanton, B., Deveaux, L., Poitier, M., Lunn, S., Koci, V., et al. (2015b). Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program. Implementation Science, 10, 44. doi: 10.1186/s13012-015-0236-y.PubMedPubMedCentralCrossRefGoogle Scholar