Advertisement

Methodological Practices in Research on Arts-Based Programs in International Development: A Systematic Review

  • Vicki-Ann Ware
  • Kim Dunphy
Original Article
  • 24 Downloads

Abstract

International development initiatives increasingly use programmes involving arts participation to facilitate desired outcomes, such as improved psycho-social wellbeing and conflict resolution. Research into the effectiveness of these interventions has increased commensurately. However, this research has not necessarily been of high quality. This article reports a systematic review of 67 studies of arts-based international development initiatives, to examine the research methods used and the quality of their application. Methodological strength and integrity were analysed against criteria important for research quality in this field, including use of participatory methods, clarity of research question, methodological rigour and system, supportable claims of causal links and supportable generalisations. The findings indicate that only one-third of studies employed robust methods. Challenges include inappropriate selection of research methods to match stated research questions, lack of adequate reporting of data to allow readers to assess the validity of claims, and overly strong claims made with insufficient support.

Keywords

International development Participatory arts Systematic review Research methods Arts-based international development 

Les initiatives du développement international font de plus en plus appel aux méthodes artistiques participatives dans leurs programmes pour apporter les résultats souhaités, tels que l’amélioration du bien-être psychosocial et la résolution des conflits. La recherche sur l’efficacité de ces interventions a augmenté de façon proportionnelle. Cependant, cette recherche n’est pas nécessairement de haute qualité. Cet article présente une revue systématique de 67 études d’initiatives de développement international axées sur les arts afin d’examiner les méthodes de recherche utilisées et la qualité de leur utilisation. La force et l’intégrité méthodologiques ont été analysées selon des critères importants pour la qualité de la recherche dans ce domaine. Ces critères comprennent: l’utilisation de méthodes participatives; la clarté de la question de recherche; système et rigueur méthodologiques; des revendications de liens de causalité ainsi que des généralisations défendables. Les résultats indiquent que seulement un tiers des études utilisaient des méthodes robustes. Les défis incluent : le choix inadéquat des méthodes de recherche par rapport aux questions de recherche énoncées, le manque de données rapportées pour permettre aux lecteurs d’évaluer la validité des affirmations, et des affirmations trop fortes avec preuves insuffisantes à l’appui.

Notes

Compliance with Ethical Standards

Conflict of Interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

References

N.B. Articles marked with an asterisk were included in the systematic review

  1. *Abah, O., J. Okwori, and O. Alubo. 2009. Participatory theatre and video: acting against violence in Northern Nigeria. IDS Bulletin 40 (3): 19–26.CrossRefGoogle Scholar
  2. *Al-Krenawi, A., and N. Slater. 2007. Bedouin-Arab children use visual art as a response to the destruction of their homes in unrecognized villages. Journal of Humanistic Psychology 47 (3): 288–305.CrossRefGoogle Scholar
  3. *Arts Access Australia. 2006. Hamutuk (Connections) East Timor-Australia arts and disability cultural exchange. Sydney: Arts Access Australia. www.ccd.net/projects/browse.html?projectID=1124346608. Accessed 30 Aug 2009.
  4. *Bagamoyo College of Arts, Tanzania Theatre Centre, R. Mabalac, and K.B. Allen. 2001. Participatory action research on HIV/AIDS through a popular theatre approach in Tanzania. Evaluation and Program Planning 2002 (1): 333–339.Google Scholar
  5. *Bergh, A. 2010. I’d like to teach the world to sing: Music and conflict transformation. PhD diss., University of Exeter, UK.Google Scholar
  6. *Betiang, L. 2010. Theatre of rural empowerment: The example of Living Earth Nigeria Foundation’s Community Theatre Initiative in Cross River State, Nigeria. Research in Drama Education: The Journal of Applied Theatre and Performance 15 (1): 59–78.CrossRefGoogle Scholar
  7. BetterEvaluation. 2016. Generalise findings. http://betterevaluation.org/plan/synthesize_value/generalize_findings. Accessed 10 May 2016.
  8. Blom, L., L. Judge, M. Whitley, L. Gerstein, A. Huffman, and S. Hillyer. 2015. Sport for development and peace: Experiences conducting U.S. and International Programs. Journal of Sport Psychology in Action 6 (1): 1–16.CrossRefGoogle Scholar
  9. *Braden, S., and M. Mayo. 1999. Culture, community development and representation. Community Development Journal 34 (3): 191–204.CrossRefGoogle Scholar
  10. *Boneh, G. 2013. This is my story: A model for creating performance engaging artists and people living with HIV/AIDS. Matatu: Journal for African Culture & Society 43: 187–202.CrossRefGoogle Scholar
  11. *Bryant, A. 2006. Summary report of results from HAI evaluation of Bibi Bulak Community Drama. Washington, DC: Health Alliance International.Google Scholar
  12. *Casale, M., and J. Hanass-Hancock. 2011. Of drama, dreams and desire: Creative approaches to applied sex education in southern Africa. Sex Education 11 (4): 353–368.CrossRefGoogle Scholar
  13. *Chamberlain, R., M. Chillery, L. Ogolla, and O. Wandera. 1995. Participatory education theatre for HIV/AIDs awareness in Kenya, 69–74. London: PLA Notes, IIED.Google Scholar
  14. *Chinyowa, K.C. 2011. Theatre as laboratory for HIV/AIDS education: the case of Amakhosi Theatre’s play, Vikele. In Acting on HIV: Using drama to create possibilities for change, ed. D.A. Francis, 67–77. Bloemfontain, SA: Sense.CrossRefGoogle Scholar
  15. *Chinyowa, K.C. 2007. By whom and for whom? An aesthetic appraisal of selected African popular theatre workshops. Studies in Theatre and Performance 28 (1): 13–24.CrossRefGoogle Scholar
  16. Chipatiso, R. 2013. Evaluation of applied drama and theatre in HIV/AIDS interventions: A case study of themba interactive. Matatu: Journal for African Culture & Society 43 (1): 251–267.CrossRefGoogle Scholar
  17. Cochrane Library. 2018. Cochrane Library. http://www.cochranelibrary.com/.
  18. Cooney, A. 2011. Rigour and grounded theory. Nurse Researcher 18 (4): 17–22.CrossRefGoogle Scholar
  19. *Cooper, T., S. Bahn, and M. Giles. 2012. Investigating the social welfare indicators of Aboriginal Regional Art Centres: A pilot study. Perth: Edith Cowan University.Google Scholar
  20. *Cornejo, X.Y. 2008. In the art of revolution: Integrating community arts into the existing development work of non-government organisations in Guatemala and El Salvador. MA diss., University of Southern California.Google Scholar
  21. Cultural Development Network. 2016. Cultural development planning framework, Melbourne: Cultural development network. www.culturaldevelopment.net.au/planning. Accessed 16 June 2016.
  22. *Dalrymple, L. 2006. Has it made a difference? Understanding and measuring the impact of applied theatre with young people in the South African context. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 201–218.CrossRefGoogle Scholar
  23. Davies, R., and Dart, J. 2005. The ‘Most significant change’ (MSC) technique. UK: Care International. www.mande.co.uk/docs/MSCGuide.pdf. Accessed 14 May 2011.
  24. *de Quadros, A., and P. Dorstewitz. 2011. Community, communication, social change: Music in dispossessed Indian communities. International Journal of Community Music 4 (1): 59–70.CrossRefGoogle Scholar
  25. DFAT. 2014. Office for Development Effectiveness. Canberra: Department of Foreign Affairs and Trade. http://www.ode.dfat.gov.au/. Accessed 29 Aug 2014.
  26. *Dunphy, K. 2011. Evaluating the Scared Cool project: Understanding peacemaking through creativity and personal development in Timor-Leste. UNESCO Observatory Refereed e-Journal 2 (2): 1–20.Google Scholar
  27. *Dunphy, K. 2013a. The role of participatory arts in social change in Timor-Leste. PhD diss. Deakin University. www.manyhands.org.au/resources.
  28. *Dunphy, K. 2013b. The contribution of creativity to human development in a new nation: a case study of Afalyca community art centre, Timor-Leste. Creativity and Human Development. Creativity eJournal. http://www.creativityjournal.net/index.php/contents/articles/item/153-the-contribution-of-creativity-to-human-development-in-a-new-nation-a-case-study-of-afal…#.VNnoeU0cQ5s. Accessed 10 Feb 2015.
  29. Dunphy, K. 2015. A holistic framework of evaluation for arts engagement. In Making culture count: The politics of cultural measurement, ed. L. Macdowall, M. Badham, E. Blomkamp, and K. Dunphy, 243–263. London: Palgrave.CrossRefGoogle Scholar
  30. Dunphy, K., and V. Ware. 2017. Evaluation practices in participatory arts in international development: Findings of a systematic literature review. In: Contemporary Perspectives in Art and International Development, eds. P. Stupples, and K. Teaiwa, pp. 221–237. London: Routledge. ISBN 9781138024700.Google Scholar
  31. *Durden, E. 2010. Staging empowerment? An investigation into participation and development in HIV and AIDS theatre projects. PhD diss., University of KwaZulu-Natal.Google Scholar
  32. *Etherton, M., and T. Prenkti. 2006. Drama for change? Prove it! Impact assessment in applied theatre. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 139–155.CrossRefGoogle Scholar
  33. Estrella, M.A. 2010. The vital importance of the arts in personal development. Museum International 62 (3): 26–30.CrossRefGoogle Scholar
  34. Evans, J.R., R. Wilson, B. Dalton, and S. Georgakis. 2015. Indigenous participation in Australian Sport: The perils of the ‘Panacea’ proposition. Cosmopolitan Civil Societies Journal 7 (1): 53–79.Google Scholar
  35. *Fontes, C., and R. Wilson-Grau. 2008. English-language summary of Evaluación del Programa Arte y Cultura de Hivos en Centro América Período 2002–2006. La Haya: Hivos.Google Scholar
  36. *Fontes, C., R. Wilson-Grau, and R. Davies. 2010. How do you DOEN? Stories of change from the culture sector in Africa. Amsterdam: DOEN Foundation.Google Scholar
  37. *Francis, D.A. 2010. ‘Sex is not something we talk about, it’s something we do’: Using drama to engage youth in sexuality, relationship and HIV education. Critical Arts: South-North Cultural and Media Studies 24 (2): 228–244.CrossRefGoogle Scholar
  38. *Ghosh, S., R. Patil, S. Tiwari, and A.P. Dash. 2006. A community-based health education programme for bio-environmental control of malaria through folk theatre (Kalajatha) in rural India. Malaria Journal 5: 123.CrossRefGoogle Scholar
  39. *Gray, A. 2008. Dancing in our blood: Dance/movement therapy with street children and victims of organized violence in Haiti. In Dance, human rights and social justice: Dignity in motion, ed. N. Jackson and T. Shapiro-Phim, 232–236. Maryland: Scarecrow.Google Scholar
  40. Grincheva, N. 2016. Sustainable development in cultural projects: Mistakes and challenges. Development in Practice 26 (2): 236–250.  https://doi.org/10.1080/09614524.2016.1135878.Google Scholar
  41. *Haaken, J., J. Wallin-Ruschman, and S. Patange. 2012. Global hip-hop identities: Black youth, psychoanalytic action research, and the moving to the beat project. Journal of Community & Applied Social Psychology 22 (1): 63–74.CrossRefGoogle Scholar
  42. *Hagen-Zanker, J., and R. Mallett. 2013. How to do a rigorous, evidence focused literature review in international development. Overseas Development Institute and the Secure Livelihoods Research Consortium (SLRC). http://www.odi.org/sites/odi.org.uk/files/odi-assets/publications-opinion-files/8572.pdf. Accessed 17 Apr 2016.
  43. *Harris, D.A. 2010. When child soldiers reconcile: Accountability, restorative justice, and the renewal of empathy. Journal of Human Rights Practice 2 (3): 334–354.CrossRefGoogle Scholar
  44. *Harvey, B., J. Stuart, and T. Swan. 2000. Evaluation of a drama-in-education programme to increase AIDS awareness in South African high schools: A randomised community intervention trial. International Journal of STD and AIDS 11 (2): 105–111.CrossRefGoogle Scholar
  45. *Impey, A. 2002. Culture, conservation and community reconstruction: Explorations in advocacy ethnomusicology and participatory action research in Northern KwaZulu Natal. Yearbook for Traditional Music 34: 9–24.CrossRefGoogle Scholar
  46. *Islam, K.S., S.A. Sachchu, R. Sandani, C. Bullough, N. Siraj, P. Dimrnock, and R.B. Johanson. 2001. Using village theatre to increase knowledge about eclampsia in Bangladesh. Journal of Obstetrics & Gynaecology Research 27 (4): 199–204.CrossRefGoogle Scholar
  47. *James, S. 2008. Human rights education and transformation through the arts. Human Rights Education in Schools: 93–102.Google Scholar
  48. *Johnston, E.A. 2007. Healing Maori through song and dance? Three case studies of recent New Zealand music theatre. MA diss., University of Canterbury.Google Scholar
  49. *Kalisa, C. 2006. Theatre and the Rwandan genocide. Peace Review: A Journal of Social Justice 18: 515–521.CrossRefGoogle Scholar
  50. *Katitjin, K. 2010. Evaluation of indigenous hip hop projects. Perth: Centre for Indigenous Australian Education and Research, Edith Cowan University.Google Scholar
  51. *Klotz, P. 2002. Edutainment for development and sexual health. Sexual Health Exchange 1: 1–2.Google Scholar
  52. *Ljubinkovic, A. 2010. Healing dimensions of Somali poetry in response to military humanitarian intervention. Journal of Poetry Therapy: The Interdisciplinary Journal of Practice, Theory, Research and Education 23 (3): 131–155.CrossRefGoogle Scholar
  53. *Mavrocordatos, A. 2004. Theatre for life: Health information, community mobilisation and child rights—a qualitative evaluation. Winchester, UK: University College Winchester.Google Scholar
  54. *McCoy, B.F. 2008. Holding men: Kanyirninpa and the health of Aboriginal men. Canberra: AIATSIS, Aboriginal Studies Press.Google Scholar
  55. *McNiff, S. 2007. Empathy with the shadow: Engaging and transforming difficulties through art. Journal of Humanistic Psychology 47 (3): 392–399.CrossRefGoogle Scholar
  56. Moher, D., A. Liberati, J. Tetzlaff, and D.G. Altman. 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 6 (7): e1000097.  https://doi.org/10.1371/journal.pmed1000097.Google Scholar
  57. Morra-Imas, L., and R. Rist. 2009. The road to results: Designing and conducting effective development evaluations. Washington: World Bank.CrossRefGoogle Scholar
  58. *Munier, A., and M. Etherton. 2006. Child rights theatre for development in rural Bangladesh: A case study. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 175–183.CrossRefGoogle Scholar
  59. *Mwansa, D., and P. Bergman. 2003. Drama in HIV/AIDS prevention: Some strengths and weaknesses: A study in Botswana, Tanzania, South Africa, Kenya, Ethiopia, and Uganda. Swedish International Development Cooperation Agency (Sida): Stockholm.Google Scholar
  60. *Niederstadt, L. 2009. Fighting HIV with juggling clubs: An introduction to Ethiopia’s circuses. African Arts Spring: 76–87.Google Scholar
  61. *Niner, S. 2006. The reassertion of customary practices in Timor-Leste and the implications for traditional handcrafts production. Exploring the tensions of nation building in Timor-Leste. SSEE Research Paper No. 1 / 2007, 41–47, Melbourne: University of Melbourne.Google Scholar
  62. *Niner, S. 2009. Women’s handcrafts and development in Timor- Leste: looking to the future. Dili, TL: Women for Peace.Google Scholar
  63. *Nogueira, M.P. 2006. Reflections on the impact of a long term theatre for community development project in Southern Brazil. Research in Drama Education: The Journal of Applied Theatre and Performance 11 (2): 219–234.CrossRefGoogle Scholar
  64. *Nwadigwe, C.E. 2007. ‘Meet us at the other side of the river’: Performance venue and community education among migrant fishermen in Nigeria. Research in Drama Education: The Journal of Applied Theatre and Performance 12 (1): 65–77.CrossRefGoogle Scholar
  65. *Oddie, D. 2007. The ARROW programme: Genesis, ideas, growth and aspiration. Caribbean Quarterly 53 (1/2): 168–180.CrossRefGoogle Scholar
  66. OECD. 2011. The Busan partnership for effective development co-operation. Paris: Organisation for Economic Co-operation and Development. www.oecd.org/dac/effectiveness/busanpartnership.htm. Accessed 29 Aug 2014.
  67. *Omar, W. 2008. From storytelling to community development. In Telling Stories to Change the World: Global voices on the power of narrative to build community and make social justice claims, ed. R. Solinger, M. Fox, and K. Irani, 193–200. New York, London: Routledge.Google Scholar
  68. *Onyeji, C. 2004. Igbo rural women in Africa as creative personalities: musical processing of socio-economic solidarity. Journal of the Musical Arts in Africa 1: 84–101.CrossRefGoogle Scholar
  69. *Palmer, D. 2010. Ngapartji Ngapartji: The consequences of kindness. Adelaide: Murdoch University and Big hART.Google Scholar
  70. *Pattman, R., A. Kezaabu, and Y. Sliep. 2011. Real men, sick wives and others: Dramatic explorations of men and their potential as caregivers in the context of HIV/AIDS in rural KwaZulu-Natal, South Africa. In Acting on HIV: Using drama to create possibilities for change, ed. D. Francis, 79–90. Bloemfontain, SA: Sense.CrossRefGoogle Scholar
  71. *Quan-Baffour, K.P. 2007. Using folk media in HIV/AIDS prevention in rural Ghana. Muziki: Journal of Music Research in Africa 4 (2): 209–223.CrossRefGoogle Scholar
  72. *Risi, L., J.P. Bindman, O.M.R. Campbell, J. Imrie, K. Everett, J. Bradley, and L. Denny. 2004. Media interventions to increase cervical screening uptake in South Africa: An evaluation study of effectiveness. Health Education Research 19 (4): 457–468.CrossRefGoogle Scholar
  73. *Seguin, A., and C. Rancourt. 1996. The theatre: An effective tool for health promotion. World Health Forum 17 (1): 64–69.Google Scholar
  74. Sen, A. 1999. Development as freedom. Westminster: Knopf.Google Scholar
  75. *Şişmanyazici-Navaie, N. n.d. Creative change worldwide. Art for Global Development.Google Scholar
  76. *Şişmanyazici-Navaie, N., and E. Etili-Serter. 2008. Making the ‘arts’ and ‘net’ work to help achieve MDGS: an art4development.net story. UNESCO Observatory refereed E-Journal, Multi-Disciplinary Research in the Arts 1(2): 149–160.Google Scholar
  77. *Skinner, D., and C.A. Metcalf. 1991. An evaluation of an education programme on HIV infection. AIDS Care 3 (3): 317–317.CrossRefGoogle Scholar
  78. *Sloman, A. 2011. Using participatory theatre in international community development. Community Development Journal 47 (1): 42–57.CrossRefGoogle Scholar
  79. Snilstveit, B., S. Oliver, and M. Vojtkova. 2012. Narrative approaches to systematic review and synthesis of evidence for international development policy and practice. Journal of Development Effectiveness 4 (3): 409–429.CrossRefGoogle Scholar
  80. *Stepakoff, S. 2007. The healing power of symbolization in the aftermath of massive war atrocities: Examples from Liberian and Sierra Leonean survivors. Journal of Humanistic Psychology 47 (3): 400–412.CrossRefGoogle Scholar
  81. *Stupples, P. 2011. Breaking the frame: arts in international development. PhD diss., Massey University.Google Scholar
  82. *Stupples, P. 2014. Creative contributions: The role of the arts and the cultural sector in development. Progress in Development Studies 14 (2): 115–130.CrossRefGoogle Scholar
  83. *Sutherland, A. 2013. Dramatic spaces in patriarchal contexts: Constructions and disruptions of gender in theatre interventions about HIV. Matatu: Journal for African Culture & Society Issue 43: 177–185.Google Scholar
  84. *Swain, D. 2009. Dancing for peace in Angola: Using movement based expressive arts therapy as a tool for social action. In Dance therapy collections 3, ed. K. Dunphy, J. Guthrie, and E. Loughlin, 165–171. Melbourne: Dance Therapy Association of Australia.Google Scholar
  85. UNDP. 2014. Human development report 2014: Sustaining human progress: Reducing vulnerabilities and building resilience. New York: United Nations Development Programme.CrossRefGoogle Scholar
  86. Vogel, I. 2012. Review of the use of ‘Theory of change’ in international development. London: UK Department of International Development, DFID.Google Scholar
  87. Waddington, H., H. White, B. Snilstveit, J.G. Hombrados, M. Vojtkova, P. Davies, et al. 2012. How to do a good systematic review of effects in international development: a tool kit. Journal of Development Effectiveness 4 (3): 359–387.CrossRefGoogle Scholar
  88. Ware, V., and Dunphy, K. Under review. How do arts programs contribute in international development? Findings of a systematic review of outcomes.Google Scholar
  89. *Wheeler, J. 2009. ‘The life that we don’t want’: Using participatory video in researching violence. IDS Bulletin 40 (3): 10–18.CrossRefGoogle Scholar

Copyright information

© European Association of Development Research and Training Institutes (EADI) 2018

Authors and Affiliations

  1. 1.Faculty of Arts and EducationDeakin University Melbourne-Burwood CampusBurwoodAustralia
  2. 2.Creative Arts Therapy Research Unit, Victorian College of the ArtsUniversity of MelbourneSouthbankAustralia

Personalised recommendations