Skip to main content

Establishing and Evaluating the Key Functions of an Interactive Systems Framework Using an Assets-Getting to Outcomes Intervention

American Journal of Community Psychology volume 50, pages 295–310 (2012)Cite this article

Abstract

Community practitioners can face difficulty in achieving outcomes demonstrated by prevention science. Building a community practitioner’s prevention capacity—the knowledge and skills needed to conduct critical prevention practices—could improve the quality of prevention and its outcomes. The purpose of this article is to: (1) describe how an intervention called Assets-Getting To Outcomes (AGTO) was used to establish the key functions of the ISF and present early lessons learned from that intervention’s first 6 months and (2) examine whether there is an empirical relationship between practitioner capacity at the individual level and the performance of prevention at the program level—a relationship predicted by the ISF but untested. The article describes an operationalization of the ISF in the context of a five-year randomized controlled efficacy trial that combines two complementary models designed to build capacity: Getting To Outcomes (GTO) and Developmental Assets. The trial compares programs and individual practitioners from six community-based coalitions using AGTO with programs and practitioners from six similar coalitions that are not. In this article, we primarily focus on what the ISF calls innovation specific capacity and discuss how the combined AGTO innovation structures and uses feedback about its capacity-building activities, which can serve as a model for implementing the ISF. Focus group discussions used to gather lessons learned from the first 6 months of the AGTO intervention suggest that while the ISF may have been conceptualized as three distinct systems, in practice they are less distinct. Findings from the baseline wave of data collection of individual capacity and program performance suggest that practitioner capacity predicts, in part, performance of prevention programs. Empirically linking practitioner capacity and performance of prevention provides empirical support for both the ISF and AGTO.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1

Notes

  1. US Census 2000.

  2. According to the 2006 Maine Youth Drug and Alcohol Use Survey (http://www.maine.gov/dhhs/osa/data/mydaus/mydaus2006.htm).

  3. This interview is described in more detail under Measures, Program Performance.

  4. Nine programs folded between the time the study was planned and begun, leaving only 51 programs.

References

  • Ajzen, I., & Fishbein, M. (1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84, 888–918.

    Article  Google Scholar 

  • Backer, T. E. (2001). Finding the balance: Program fidelity and adaptation in substance abuse prevention: A state-of-the-art review. Rockville, MD: Substance Abuse and Mental Health Administration.

    Google Scholar 

  • Bandura, A. (2004). Health promotion by social cognitive means. Health Education & Behavior, 31(2), 143–164.

    Article  Google Scholar 

  • Bartholomew, L. K., Parcel, G. S., Kok, G., & Gottleib, N. H. (2001). Changing behavior and environment: How to plan theory- and evidence-based disease management programs. In R. Patterson (Ed.), Changing patient behavior: Improving outcomes in health and disease management (pp. 73–112). San Francisco, CA: Joey-Bass.

    Google Scholar 

  • Battelle. (2008). Annual findings report: Drug-free communities support program national evaluation. Washington, DC: Executive Office of the President Office of Administration Office of National Drug Control Policy (unpublished manuscript).

  • Benson, P. L. (2002). Toward asset-building communities: How does change occur? In R. M. Lerner & P. L. Benson (Eds.), Developmental assets and asset-building communities: Implications for research policy and practice. Norwell, MA: Kluwer.

    Google Scholar 

  • Benson, P. L., & Scales, P. C. (in press). Developmental assets. In R. J. R. Levesque (Ed.), Encyclopedia of adolescence. New York, NY: Springer.

  • Benson, P. L., Scales, P. C., Leffert, N., & Roehlkepartain, E. R. (1999). A fragile foundation: The state of developmental assets among American youth. Minneapolis, MN: Search Institute.

    Google Scholar 

  • Benson, P. L., Scales, P. C., & Mannes, M. (2003). Developmental strengths and their sources: Implications for the study and practice of community building. In R. M. Lerner, F. Jacobs, & D. Wertlieb (Eds.), Handbook of applied developmental science: Vol. 1: Applying developmental science for youth and families (pp. 369–406). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Benson, P. L., Scales, P. C., & Syvertsen, A. K. (in press). The contribution of the developmental assets framework to positive youth development theory and practice. In R. M. Lerner, J. V. Lerner, & J. B. Benson (Eds.), Advances in child development and behavior: Positive youth development—research and applications for promoting thriving in adolescence. New York, NY: Elsevier.

  • Botvin, G. J., Baker, E., Dusenbury, L., Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. Journal of the American Medical Association, 273(14), 1106–1112.

    PubMed  Article  Google Scholar 

  • Butterfoss, F. D., Goodman, R. M., & Wandersman, A. (1993). Community coalitions for prevention and health promotion. Health Education Research, 8, 315–330.

    PubMed  Article  Google Scholar 

  • Chinman, M., Early, D., Ebener, P., Hunter, S., Imm, P., Jenkins, P., et al. (2004). Getting to outcomes: A community-based participatory approach to preventive interventions. Journal of Interprofessional Care, 18, 441–443.

    PubMed  Article  Google Scholar 

  • Chinman, M., Hannah, G., Wandersman, A., Ebener, P., Hunter, S., Imm, P., et al. (2005). Developing a community science research agenda for building community capacity for effective preventive interventions. American Journal of Community Psychology, 3(4), 143–157.

    Article  Google Scholar 

  • Chinman, M., Hunter, S., Ebener, P., Paddock, S., Stillman, L., Imm, P., et al. (2008). The Getting To Outcomes demonstration and evaluation: An illustration of the Prevention Support System. American Journal of Community Psychology, 41, 206–224.

    PubMed  Article  Google Scholar 

  • Chinman, M., Tremain, B., Imm, P., & Wandersman, A. (2009). Strengthening prevention performance using technology: A formative evaluation of interactive Getting To Outcomes. The American Journal of Orthopsychiatry, 79, 469–481.

    PubMed  Article  Google Scholar 

  • Donner, A., & Klar, N. (2004). Pitfalls of and controversies in cluster randomization trials. American Journal of Public Health, 94(3), 416–422.

    PubMed  Article  Google Scholar 

  • Eggert, L. L., Thompson, E. A., Herting, J. R., Nicholas, L. J., & Dicker, B. G. (1994). Preventing adolescent drug abuse and high school dropout through an intensive school-based social network development program. American Journal of Health Promotion, 8(3), 202–215.

    PubMed  Article  Google Scholar 

  • Fetterman, D. M., & Wandersman, A. (Eds.). (2005). Empowerment evaluation principles in practice. New York, NY: Guilford Press.

  • Fishbein, M., & Ajzen, I. (1974). Attitudes toward objects as predictive of single and multiple behavioral criteria. Psychological Review, 81, 59–74.

    Article  Google Scholar 

  • Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Fisher, D., Imm, P. S., Chinman, M., & Wandersman, A. (2006). Getting To Outcomes with developmental assets: Ten steps to measuring success in youth programs and communities. Minneapolis, MN: Search Institute.

    Google Scholar 

  • Glaser, B. G. (1965). The constant comparative method of qualitative analysis. Social Problems, 12(4), 436–445.

    Article  Google Scholar 

  • Green, L. (2001). From research to "best practices" in other settings and populations. American Journal of Health Behavior, 25(3), 165–178.

    PubMed  Article  Google Scholar 

  • Green, L. W., Kreuter, M. W., Deeds, S. G., & Partridge, K. B. (1980). Health education planning model (PRECEDE). In L. W. Green, et al. (Eds.), Health education planning. Palo Alto, CA: Mayfield Publishing Company.

    Google Scholar 

  • Hawkins, J. D., Catalano, R. F., & Miller, J. Y. (1992). Risk and protective factors for alcohol and other drug problems in adolescence and early adulthood: Implications for substance abuse prevention. Psychological Bulletin, 112, 64–105.

    PubMed  Article  Google Scholar 

  • Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of communities that care. Archives of Pediatric and Adolescent Medicine, 163(9), 789–798.

    Article  Google Scholar 

  • Hunter, S. B., Chinman, M., Ebener, P., Imm, P., Wandersman, A., & Ryan, G. (2009a). Technical assistance as a prevention capacity-building tool: A demonstration using the Getting To Outcomes framework. Health Education and Behavior, 36, 810–828.

    PubMed  Article  Google Scholar 

  • Hunter, S., Paddock, S., Ebener, P., Burkhart, Q., & Chinman, M. (2009b). Promoting evidence based practices: The adoption of a prevention support system in community settings. The Journal of Community Psychology, 37(5), 579–593.

    Article  Google Scholar 

  • Kegler, M. C., & Wyatt, V. H. (2003). A multiple case study of neighborhood partnerships for positive youth development. American Journal of Health Behaviour, 27(2), 156–169.

    Article  Google Scholar 

  • Kitson, A., Harvey, G., & McCormack, B. (1998). Enabling the implementation of evidence based practice: A conceptual framework. Quality in Health Care, 7, 149–158.

    PubMed  Article  Google Scholar 

  • Leffert, N., Benson, P. L., Scales, P. C., Sharma, A. R., Drake, D. R., & Blyth, D. A. (1998). Developmental assets: Measurement and prediction of risk behaviors among adolescents. Applied Developmental Science, 2, 209–230.

    Article  Google Scholar 

  • Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22(4), 197–209.

    PubMed  Article  Google Scholar 

  • Miller, T., & Hendrie, D. (2009). Substance abuse prevention dollars and cents: A cost-benefit analysis (DHHS Pub. No. (SMA) 07-4298). Rockville, MD: Center for Substance Abuse Prevention, Substance Abuse and Mental Health Services Administration.

  • Mitchell, R. E., Stone-Wiggins, B., Stevenson, J. F., & Florin, P. (2004). Cultivating capacity: Outcomes of a statewide support system for prevention coalitions. Journal of Prevention & Intervention in the Community, 27(2), 67–87.

    Article  Google Scholar 

  • National Prevention Council. (2011). National Prevention Strategy. Washington, DC: US Department of Health and Human Services, Office of the Surgeon General.

    Google Scholar 

  • O’Donnell, L., Scattergood, P., Adler, M., Doval, A. S., Barker, M., Kelly, J. A., et al. (2000). The role of technical assistance in the replication of effective HIV interventions. AIDS Education and Prevention, 12(5 Suppl), 99–111.

    PubMed  Google Scholar 

  • Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.

    Google Scholar 

  • Rosenheck, R. A. (2001). Organizational process: A missing link between research and practice. Psychiatric Services, 52, 1607–1612.

    PubMed  Article  Google Scholar 

  • Rubenstein, L. V., Mittman, B. S., Yano, E. M., & Mulrow, C. D. (2000). From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative. Medical Care, 38, 129–141.

    Article  Google Scholar 

  • Rycroft-Malone, J., Harvey, G., Seers, K., Kitson, A., McCormack, B., & Titchen, A. (2002). An exploration of the factors that influence the implementation of evidence into practice. Journal of Clinical Nursing, 13, 913–924.

    Article  Google Scholar 

  • Scales, P. C. (1999). Reducing risks and building developmental assets: Essential actions for promoting adolescent health. Journal of School Health, 69(3), 113–119.

    PubMed  Article  Google Scholar 

  • Scales, P. C. (in press). Youth developmental assets in global perspective: Results from international adaptations of the Developmental Assets Profile. Child Indicators Research.

  • Scales, P. C., Benson, P. L., Leffert, N., & Blyth, D. A. (2000). Contribution of developmental assets to the prediction of thriving among adolescents. Applied Developmental Science, 4(1), 27–46.

    Article  Google Scholar 

  • Somers, C. L., & Fahlman, M. M. (2001). Effectiveness of the “Baby Think it Over” teen pregnancy prevention program. Journal of School Health, 71(5), 188–195.

    PubMed  Article  Google Scholar 

  • Spoth, R., Redmond, C., Shin, C., Greenberg, M., Clair, S., & Feinberg, M. (2007). Substance-use outcomes at 18 months past baseline: The PROSPER Community-University partnership trial. American Journal of Preventive Medicine, 32(5), 395–402.

    PubMed  Article  Google Scholar 

  • Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., et al. (2006). Role of ‘external facilitation’ in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1, 23. doi:10.1186/1748-5908-1-23.

  • Stevenson, J. F., Florin, P., Mills, D. S., & Andrade, M. (2002). Building evaluation capacity in human service organizations: A case study. Evaluation and Program Planning, 25(3), 233–243.

    Article  Google Scholar 

  • Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention science and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181.

    PubMed  Article  Google Scholar 

  • Wandersman, A., & Florin, P. (2003). Community interventions and effective prevention: Bringing researchers/evaluators, funders and practitioners together for accountability. American Psychologist, 58(6/7), 441–448.

    PubMed  Article  Google Scholar 

  • Wandersman, A., Imm, P., Chinman, M., & Kaftarian, S. (2000). Getting to outcomes: A results-based approach to accountability. Evaluation and Program Planning, 23, 389–395.

    Article  Google Scholar 

  • Weiss, E., Miller-Anderson, R., & Lasker, R. (2002). Making the most of collaboration: Exploring the relationship between partnership synergy and partnership functioning. Health Education and Behavior, 29, 683–698.

    PubMed  Article  Google Scholar 

  • Wenger, E., McDermott, R., & Snyder, W. M. (2002). Cultivating communities of practice. Boston, MA: Harvard Business School Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. RAND Corporation, 4570 Fifth Avenue, Pittsburgh, PA, 15213, USA

    Matthew Chinman & Andrea Phillips

  2. RAND Corporation, 1200 South Hayes Street, Arlington, VA, 22202-5050, USA

    Joie Acosta

  3. RAND Corporation, 1776 Main Street, P.O. Box 2138, Santa Monica, CA, 90407-2138, USA

    Patricia Ebener,  Q Burkhart, Sarah Hunter & Susan Paddock

  4. 55 Victor Road, Portland, ME, 04103, USA

    Michael Clifford

  5. Department of Psychology, University of New England, Biddeford, ME, 04005, USA

    Maryann Corsello

  6. Vision Training Associates, Search Institute Training, P.O. Box 338, Gorham, ME, 04038-0338, USA

    Tim Duffey

  7. 43 West Old Orchard Ave., Old Orchard Beach, ME, 04064, USA

    Margaret Jones

  8. Edmund S. Muskie School of Public Service, University of Southern Maine, P.O. Box 9300, Portland, ME, 04104-9300, USA

    Michel Lahti

  9. Department of Psychology, University of South Carolina, Columbia, SC, 29208, USA

    Patrick S. Malone

  10. Spurwink Services, 899 Riverside St., Portland, ME, 04103, USA

    Susan Savell

  11. Office of the President, Search Institute, c/o 940 Chestnut Ridge Road, Manchester, MO, 63021, USA

    Peter C. Scales

  12. Search Institute, 615 First Avenue N.E., Minneapolis, MN, 55413-2254, USA

    Nancy Tellett-Royce

Authors
  1. Matthew Chinman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joie Acosta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patricia Ebener
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Q Burkhart
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michael Clifford
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Maryann Corsello
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Tim Duffey
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Sarah Hunter
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Margaret Jones
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Michel Lahti
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Patrick S. Malone
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Susan Paddock
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Andrea Phillips
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Susan Savell
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Peter C. Scales
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Nancy Tellett-Royce
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthew Chinman.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Chinman, M., Acosta, J., Ebener, P. et al. Establishing and Evaluating the Key Functions of an Interactive Systems Framework Using an Assets-Getting to Outcomes Intervention. Am J Community Psychol 50, 295–310 (2012). https://doi.org/10.1007/s10464-012-9504-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10464-012-9504-z

Keywords

  • Prevention
  • Implementation
  • Technical assistance