advocacy evaluation

rationale

This action research project seeks to support progressive social change organisations to evaluate the impacts and outcomes of their efforts. By comparison to other sectors and types of organisation, NGOs working toward social and environmental justice commit fewer resources to evaluating their programs and campaigns. Research undertaken by Change Agency associates suggests that many progressive NGOs infrequently apply evaluation frameworks. The reasons for this include lack of time, limited access to appropriate tools and frameworks and the highly ambiguous and irrational nature of the policymaking process. In recent times a small but growing number of organisations, especially philanthropic bodies that fund advocacy work, have begun to explore frameworks for evaluating advocacy.

objectives

  • Collect and synthesise resources and literature on campaign evaluation including case studies
  • Identify evaluation frameworks that are simple, powerful and road-tested
  • Develop a suite of resources for participatory workshops that support activists to evaluate their own campaigns
  • Trial and revise resources
  • Identify opportunities for ongoing action research

project updates

Project update November 2007: evaluating advocacy campaigns – What is the link between our advocacy activities and policy outcomes? Is it possible to establish a causal relationship between a vote in Parliament and campaign tactics? In mid-2007, two of the Change Agency team initiated the advocacy evaluation project to:
project update August 2008: evaluating advocacy campaigns – Our advocacy evaluation action research project has been powering along this month. In the longer term, we plan to develop, adapt and share a range of resources to use in community campaigns. Campaign evaluation can turbo-charge how and how much we learn. It’s a wise investment of time and energy… not just at the end of a campaign, but at the beginning and at along the way.

During July, Justin completed a review of literature on advocacy evaluation which has been shared internationally and will soon be published as a Comm-org working paper. You can download it from our articles and papers page.

And we helped develop an evaluation framework for Climate Camp. The online questionnaire was completed by 90 activists who’d taken part in the week-long protest camp. The evaluation showed up some important outcomes including a strong match between hoped-for and actual outcomes, a significant increase in the likelihood that participants will participate in direct action as a result of their experiences in Newcastle and very strong support for another national climate change convergence.

During coming months we’ll be trialing a range of evaluation tools with campaigning organisations. If your organisation is developing and applying evaluation tools in your campaigns, we’d love to hear from you.

online evaluation resources

What are people saying about us?

Cate-Faehrmann

Cate Faehrmann, Director, Nature Conservation Council NSW, 2005

We did a two-day workshop with The Change Agency early this year which provided our organisation with some much-needed tools for strategic campaigning and planning. There was nothing but positive feedback from our staff and board members about what they gained from the two days spent with James and Sam. The power mapping exercise was particularly insightful for staff and board members alike and as a result our campaigns are more pro-active - we are seeing results!
2014-03-30T07:51:49+00:00
Cate-Faehrmann
We did a two-day workshop with The Change Agency early this year which provided our organisation with some much-needed tools for strategic campaigning and planning. There was nothing but positive feedback from our staff and board members about what they gained from the two days spent with James and Sam. The power mapping exercise was...
Peter Archer

Peter Archer, World Vision

I have shared with my friends and family that this workshop was the most valuable training I have done. It came at a time when I had become aware of my passion for grassroots activism. The follow-up support equipped me quickly and powerfully to put my learning into practice and age my confidence a huge boost.
2014-03-30T08:11:05+00:00
Peter Archer
I have shared with my friends and family that this workshop was the most valuable training I have done. It came at a time when I had become aware of my passion for grassroots activism. The follow-up support equipped me quickly and powerfully to put my learning into practice and age my confidence a huge...
dave & gemma

Dave Muhly, Sierra Club

What began at Pittwater as a collection of skilled campaigners became a cadre of skilled organizers by the final day at Baden Powell. On Sunday evening as we gathered, I overheard one participant chatting with another at a picnic table and heard, "challenge, choice, outcome" as part of her conversation. Another commented at the final circle at how what had seemed like such a large group at Pittwater now seemed like a much smaller group, reflective of how closely this group had bonded as a team despite their vast differences in geography or organizational size or style, but based on a common goal and identity. Concepts like "building teams" and "building relationships" were part of the normal parlance and just a cursory review of the evaluations to date show an increased appreciation for and attention to leadership development and strategic planning. A number of participants reminded me of my off-the-cuff set of definitions about the differences between mobilizing, campaigning and community organising (focusing on local power), and one told me she has it on the wall of her office to inspire her every day. This has been the successful launch of an ambitious and visionary program. Many thanks to James and Kate for their vision, wisdom, and care in developing and nurturing the curriculum and the cohort. Kudos!

2014-09-15T10:27:41+00:00
dave & gemma
What began at Pittwater as a collection of skilled campaigners became a cadre of skilled organizers by the final day at Baden Powell. On Sunday evening as we gathered, I overheard one participant chatting with another at a picnic table and heard, “challenge, choice, outcome” as part of her conversation. Another commented at the final...
thea

Thea Ormerod, Australian Religious Response to Climate Change

Whereas I had been working intuitively and reasonably well as a part of with a team of dedicated volunteers, the Community Organising Fellowship is providing a range of easy-to-understand useful tools which will help ARRCC to be much more effective. The training is carefully crafted to maximise skills development so we can use our limited resources in a way which will deliver results far more strategically. I already have quite a clear vision of how to successfully motivate our volunteers into participating more actively in the change effort.
2015-03-17T19:24:22+00:00
thea
Whereas I had been working intuitively and reasonably well as a part of with a team of dedicated volunteers, the Community Organising Fellowship is providing a range of easy-to-understand useful tools which will help ARRCC to be much more effective. The training is carefully crafted to maximise skills development so we can use our limited...
nka

Josey Sharrad, International Fund for Animal Welfare

The Change Agency facilitated our two day intensive strategy workshop to bring together animal welfare and rescue groups from across Australia to set up a National Koala Alliance. James and Taya's facilitation of the workshop was absolutely brilliant and everyone came away with renewed enthusiasm and determination. James' extensive campaigning experience and strategic thinking provided invaluable guidance to this newly- formed alliance and we will continue to tap into his wealth of strategic advice as we go forward to protect koalas. Thank you!

2014-08-18T14:37:24+00:00
nka
The Change Agency facilitated our two day intensive strategy workshop to bring together animal welfare and rescue groups from across Australia to set up a National Koala Alliance. James and Taya’s facilitation of the workshop was absolutely brilliant and everyone came away with renewed enthusiasm and determination. James’ extensive campaigning experience and strategic thinking provided invaluable...
Sophie Peer

Sophie Peer, ChilOut campaign director

The Change Agency is like a best friend in the drawer. As the only paid employee in a very small not for profit, it is fabulous to know there are trusted, well tested resources a click away. Whether it's workshop planning, strategic re-think, tactics - tCA is the chamomile tea to my campaigner-stress.
2014-05-16T14:31:59+00:00
Sophie Peer
The Change Agency is like a best friend in the drawer. As the only paid employee in a very small not for profit, it is fabulous to know there are trusted, well tested resources a click away. Whether it’s workshop planning, strategic re-think, tactics – tCA is the chamomile tea to my campaigner-stress.
Six Degrees

Sam Robb, Six Degrees

When I’m amongst passionate and talented people, I always feel like our movement can be powerful. But after the last 10 days, I not only feel we can be powerful, I know we can. I know how we can be and that is a unique and invaluable gift. The quality and consideration of the facilitation and subject matter was astonishing, and there was a group wide acknowledgement of both an immense privilege of being a part of the cohort and a resounding responsibility to use and share what we felt and learnt.
2014-05-23T17:11:47+00:00
Six Degrees
When I’m amongst passionate and talented people, I always feel like our movement can be powerful. But after the last 10 days, I not only feel we can be powerful, I know we can. I know how we can be and that is a unique and invaluable gift. The quality and consideration of the facilitation...
Shani Tager

Shani Tager, Friends of the Earth

The fellowship has been really useful in helping me become more disciplined in the strategic planning process and able to clearly communicate why we’re doing what we’re doing. The facilitation team have been fantastic and having theory drawn out from our own experiences and then immediately applied to our campaigns means I’ll be returning to my team with a solid analysis of how we can be more effective.
2014-05-10T21:52:42+00:00
Shani Tager
The fellowship has been really useful in helping me become more disciplined in the strategic planning process and able to clearly communicate why we’re doing what we’re doing. The facilitation team have been fantastic and having theory drawn out from our own experiences and then immediately applied to our campaigns means I’ll be returning to...
Stu Bowen

Stu Bowen, Environmental Manager (Australia & New Zealand) Patagonia International Inc.

James has helped me better appreciate my unique set of values and understand what inspires me to action, which is a great tool to recognise other stakeholder’s values and what motivates them to action. This growth allows me to communicate far more effectively with all my stakeholders, so we can all achieve greater positive environmental and social change.

 
2015-04-29T18:23:01+00:00
Stu Bowen
James has helped me better appreciate my unique set of values and understand what inspires me to action, which is a great tool to recognise other stakeholder’s values and what motivates them to action. This growth allows me to communicate far more effectively with all my stakeholders, so we can all achieve greater positive environmental...
Catherine Delahunty

Catherine Delahunty, Kotare Centre, Aotearoa

This was the most effective movement building workshop I have participated in. It focused the people on breaking the barriers to participation in social movements in a very practical way. They had some excellent participatory processes for defining mobilisation and also some great methods for getting diverse people working together.
2014-04-25T06:04:55+00:00
Catherine Delahunty
This was the most effective movement building workshop I have participated in. It focused the people on breaking the barriers to participation in social movements in a very practical way. They had some excellent participatory processes for defining mobilisation and also some great methods for getting diverse people working together.