Advertisement

A Holistic Framework for Evaluation of Arts Engagement

  • Kim Dunphy
Part of the New Directions in Cultural Policy Research book series (NDCPR)

Abstract

The emerging professional field of cultural development — that is, funded cultural activity led by individual artists, arts organisations and government — is increasingly undertaken to contribute to community wellbeing. Arts engagement, both receptive (in which participants receive the artistic process as audiences or consumers) and creative (in which participants actively make art), is a major aspect of this work. Host organisations and funders are progressively more concerned to understand the impact of this work they lead or support. Yet, arts leaders and those who manage their programmes experience a range of challenges in elucidating outcomes of this work comprehensively and with clarity. These challenges include the fact that outcomes are often categorised as either intrinsic or instrumental, with intrinsic outcomes frequently seen as problematic because they are considered immeasurable. Evaluation approaches largely focus on either social or economic outcomes (often identified as instrumental outcomes), rather than taking a more holistic perspective, in which all aspects of human experience and the natural world are considered equally important and inter-connected. Assessments of outcomes most often involve assumptions that activity is beneficial, with little regard given to the possibility of neutral or negative outcomes, or the proportion of benefit to costs. The perspectives of different stakeholders are frequently not reflected in the evaluation process.

Keywords

Civic Engagement Personal Wellbeing Community Wellbeing Cultural Domain Holistic Framework 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. ALGA (Australian Local Government Association (1993) A Guide to Integrated Planning (ACT: ALGA). Available from: http://alga.asn.au/site/misc/alga/downloads/publications/A_guide_to_intergrated_local_area_planning.pdf.Google Scholar
  2. Australia Council for the Arts (2014) Community Partnerships (Sydney: Australia Council for the Arts). Available at: http://www.australiacouncil.gov.au/.Google Scholar
  3. Barraket, Jo (2005) Putting people in the picture? The role of the arts in social inclusion. (Melbourne: Brotherhood of St Laurence). Retrieved from http://www.bsl.org.au/pdfs/barraket_arts_social_inclusion_1.pdf.Google Scholar
  4. Barraket, Jo and Kaiser, Alex (2007) Evaluating the Mental Health and Wellbeing Impacts of Community-based Festivals: Awakenings Festival and Braybrook’s Big Day Out. (Melbourne: VicHealth).Google Scholar
  5. Blomkamp, Emma (2014) ‘Meanings and Measures of Urban Cultural Policy: Local Government, Art and Community Wellbeing in Australia and New Zealand’, Unpublished PhD thesis (Auckland and Melbourne: University of Auckland and University of Melbourne).Google Scholar
  6. Blomkamp, Emma (2011) Comparing the Uncertain Terrain of Local Cultural Governance in Australia and New Zealand, Conference Paper, Australian Political Science Association Conference, Canberra, 28 September.Google Scholar
  7. Brown, Alan, and Rebecca Ratzkin (2012) Understanding the Intrinsic Impact of Live Theatre. Accessed 20 October, 2013. Available at: http://www.intrinsicimpact.org/resources.Google Scholar
  8. Carnwath, John, and Alan Brown (2014) Understanding the Value and Impacts of Cultural Experiences: A Literature Review (London: Arts Council England).Google Scholar
  9. CIV (Community Indicators Victoria) (2014) Community Indicators Victoria Data Framework. Accessed 16 October 2014. Available at: http://www.communityindicators.net.au/.Google Scholar
  10. Cooper, Trudi, Susanne Bahn and Margaret Giles (2012) Investigating the Social Welfare Indicators of Aboriginal Regional Art Centres: A Pilot Study (Joondalup: Edith Cowan University)Google Scholar
  11. CultureCounts (2014) CultureCounts. Accessed 14 August 2014. Available at: http://culturecounts.cc/.Google Scholar
  12. CMC-SWG (Cultural Ministers Council Statistics Working Group) (2010) Vital Signs: Cultural Indicators for Australia (Canberra: Cultural Ministers Council).Google Scholar
  13. Davies, Rick, and Jess Dart (2005) The ‘Most Significant Change’ (MSC) Technique (London: Care International).Google Scholar
  14. Deci, Edward, and Richard M. Ryan (2000) ‘The “what” and “why” of goal pursuits: human needs and the self-determination of behaviour’, Psychological Inquiry, 11, 227–268.CrossRefGoogle Scholar
  15. Dunphy, Kim (2015) Holistic Framework for Evaluation of Arts Engagement (Melbourne: Cultural Development Network). Available at: http://www.culturaldevelopment.net.au.Google Scholar
  16. Dunphy, Kim (2011) ‘Evaluating The Scared Cool project: Understanding peacemaking through creativity and personal development in Timor-Leste’, UNESCO Observatory Multi-Disciplinary Research in the Arts, 2(2).Google Scholar
  17. Dunphy, Kim, and Vicki-Ann Ware (forthcoming, 2015) ‘Evaluation practices in participatory arts in international development: findings of a systematic literature review’, in Polly Stupples and Katarina Teaiwa (eds) Contemporary Perspectives in Art and International Development (London: Routledge).Google Scholar
  18. Etherton, Michael and Tim Prentki (2006) ‘Drama for change? Prove it!’, Research in Drama Education, 11(2), 139–155.CrossRefGoogle Scholar
  19. Farris, Paul, Neil Bendle, Phillip Pfeifer and David Reibstein (2010) Marketing Metrics: The Definitive Guide to Measuring Marketing Performance. (New Jersey: Pearson).Google Scholar
  20. Galloway, Susan (2009) ‘Theory-based evaluation and the social impact of the arts’, Cultural Trends, 18(2), 125–148.CrossRefGoogle Scholar
  21. Giles, Margaret (2009) ‘Cost benefit analysis’, in Philip O’Hara (ed.) International Encyclopedia of Public Policy (Volume 2: Economic Policy) (Perth: GPERU), 113–124.Google Scholar
  22. GCCP (Global Compact Cities Program) (2013) Circles of Sustainability’ Urban Profile Process. Accessed 14 April 2014. Available at: http://citiesprogramme.com/.Google Scholar
  23. Groth-Marnat, Gary. (2009) Handbook of Psychological Assessment (5th ed.) (New Jersey: John Wiley & Sons.)Google Scholar
  24. Hamilton, C., Hinks, S., and Petticrew, M. (2003) ‘Arts for health: Still searching for the holy grail’, Journal of Epidemiology and Community Health, 57, 401–02.CrossRefGoogle Scholar
  25. Hawkes, Jon (2010) ‘Making sense together’, Keynote Address, My city’s still breathing: a symposium exploring the arts, artists and the city, Winnipeg Art Gallery, 4 November.Google Scholar
  26. Hawkes, Jon (2001) The Fourth Pillar of Sustainability: Culture’s Essential Role in Public Planning (Melbourne: Common Ground Publishing).Google Scholar
  27. Holden, John (2006) Cultural Value and the Crisis of Legitimacy: Why Culture Needs a Democratic Mandate (London: Demos).Google Scholar
  28. Ife, Jim (2002) Community Development: Community-based Alternatives in an Age of Globalisation, 2nd edn (Frenchs Forest: Pearson Education).Google Scholar
  29. Ixia (2014) Public Art: A Guide to Evaluation, 4th edn (Birmingham: ixia).Google Scholar
  30. Johnson, Victoria, and Janet Stanley (2007) ‘Capturing the contribution of community arts to health and wellbeing’, International Journal of Mental Health Promotion, 9(2), 28–35.CrossRefGoogle Scholar
  31. Jupp, Dee, Sohel Ali and Carlos Barahona (2010) Measuring Empowerment. Sida Studies in Evaluation (Stockholm: Sida)Google Scholar
  32. Kelaher, Margaret, Naomi Berman, Lindy Joubert, Steve Curry, Richard Jones, Janet Stanley and Victoria Johnson (2007) ‘Methodological approaches to evaluating the impact of community arts on health’, UNESCO Observatory e-Journal, 1(1), 1–20.Google Scholar
  33. Laidlaw Foundation (2010) Most Significant Change. Accessed 1 November 2012. Available at: http://www.laidlawfdn.org/most-significant-change.Google Scholar
  34. Matarasso, François (1996) Defining Values: Evaluating Arts Programs (London: Comedia).Google Scholar
  35. McCarthy, Kevin, Elizabeth Ondaatje, Laura Zakaras and Arthur Brooks (2004 ) Gifts of the Muse: Reframing the Debate about the Benefits of the Arts (Santa Monica: RAND Corporation).Google Scholar
  36. McGillivray, Mark (2009) The United Nations Development Programme (UNDP) Human Development Index and Measuring Wellbeing across Nations, lecture, Deakin University, 19 June.Google Scholar
  37. McQueen-Thomson, Douglas, Paul James and Chris Ziguras (2004) Promoting Mental Health and Wellbeing through Community and Cultural Development (Melbourne: VicHealth).Google Scholar
  38. McQueen-Thompson, Douglas, and Chris Ziguras (2002) Promoting Mental Health and Wellbeing through Community and Cultural Development: A Review of Literature Focusing on Community Arts Practice (Melbourne: Globalism Institute and VicHealth).Google Scholar
  39. Mills, Deborah, Paul Brown, and Australia Council (2004) Art and wellbeing (Surry Hills: Australia Council).Google Scholar
  40. Morra-Imas, Linda and Ray Rist (2009) The Road to Results: Designing and Conducting Effective Development Evaluations (Washington, DC: World Bank).CrossRefGoogle Scholar
  41. Mulligan, Martin, and Pia Smith (2010) Art, Governance and the Turn to Community (Melbourne: RMIT University).Google Scholar
  42. NEA (National Endowment for the Arts) (2014) Grants for Organizations. Accessed 16 October 2014. Available at: http://arts.gov/grants/.Google Scholar
  43. Nicholls, Jeremy, Ellis Lawlor, Eva Neitzert and Tim Goodspeed for the Scottish Office of the Third Sector (2009) A Guide to Social Return on Investment (United Kingdom: New Economics Foundation).Google Scholar
  44. O’Brien, Dave (2010) Measuring the Value of Culture: A Report to the Department for Culture, Media and Sport (London: Department for Culture, Media and Sport).Google Scholar
  45. O’Toole, Linda (2014) Learning for Well-being (Brussels: Learning for Wellbeing Foundation). Available at: http://www.learningforwellbeing.org/sites/default/files/L4WB_TheEssentials%20-%20Brochure.pdf.Google Scholar
  46. Pope, Jeanette (2011) Indicators of Community Strength in Victoria: Framework and Evidence. Why Social Capital can build More Resilient Families and Communities (Melbourne: Victorian Department of Planning and Community Development).Google Scholar
  47. Radbourne, Jennifer, Katya Johanson and Hilary Glow (2010) ‘Empowering audiences to measure quality’, Participations: Journal of Audience & Reception Studies, 7 ( 2), 360–379.Google Scholar
  48. Rosenberg, Michael (2008) ‘The evaluation game: determining the benefits of arts engagement on health’, in Andrea Lewis and David Doyle (eds) Proving the Practice: Evidencing the Effects of Community Arts Programs on Mental Health (Perth: DADAA Publishing), 122–131.Google Scholar
  49. Scott, Carol, and Barbara Soren (2009) ‘Introduction to the special issue — exploring the value of museums’, Museum Management and Curatorship, 24 (3), 189–193.CrossRefGoogle Scholar
  50. Seligman, Martin (2011) Flourish: A Visionary New Understanding of Happiness and Wellbeing (New York: Simon & Schuster)Google Scholar
  51. South, Jane (2004) Community-based Arts for Health (Leeds: Metropolitan University).Google Scholar
  52. Stern, Mark, and Susan Seifert (2009) Civic Engagement and the Arts: Issues of Conceptualization and Measurement. (Pennsylvania: Animating Democracy).Google Scholar
  53. Throsby, David (2001) Economics and Culture (Cambridge: Cambridge University Press).Google Scholar
  54. Treasure, Wilfred (2011) Diagnosis and risk management in primary care: words that count, numbers that speak (Oxford: Radcliffe).Google Scholar
  55. UCLG (United Cities and Local Governments) (2010) Culture: The Fourth Pillar of Sustainable Development (Barcelona: UCLG).Google Scholar
  56. UNESCO (2014) Culture for Development Indicators (Paris: UNESCO).Google Scholar
  57. UNESCO (2009) Framework for Cultural Statistics (Montreal: UNESCO).Google Scholar
  58. Ware, Colin (2012) Information Visualization: Perception for Design (Massachusetts: Elsevier).Google Scholar
  59. West, Sue, and Di Cox (2009) A Local Government Reporting Framework for the 21st Century (Melbourne: Community Indicators Victoria).Google Scholar
  60. WolfBrown (2014) Intrinsicimpact.org: measure what matters, website. Accessed 12 June 2014. Available at: https://dashboard.intrinsicimpact.org/demo.Google Scholar

Copyright information

© Kim Dunphy 2015

Authors and Affiliations

  • Kim Dunphy

There are no affiliations available

Personalised recommendations