advocacy evaluation

rationale

This action research project seeks to support progressive social change organisations to evaluate the impacts and outcomes of their efforts.

Compared to other sectors and types of organisation, NGOs working toward social and environmental justice commit fewer resources to evaluating their programs and campaigns. Our research and networking suggests that few progressive NGOs apply evaluation frameworks. Why? Lack of time, limited access to appropriate tools and frameworks and the highly ambiguous and irrational nature of the policy-making process.

In recent times a small but growing number of organisations, especially philanthropic bodies that fund advocacy work, have begun to explore frameworks for evaluating advocacy. So we kicked off an action research project to

  • Collect and synthesise resources and literature on campaign evaluation, including case studies
  • Identify evaluation frameworks that are simple, powerful and road-tested
  • Trial and revise resources
  • Develop and share a suite of resources for participatory workshops that support activists to evaluate their own campaigns

project updates

In mid-2007, two members of our team initiated the advocacy evaluation project. Justin completed a review of literature on advocacy evaluation which was shared internationally and published as a Comm-org working paper. [You’ll find it among resources tagged ‘advocacy evaluation’ in our Campaigners’ Toolkit.]

We helped develop an evaluation framework for Climate Camp 2008. The online questionnaire was completed by 90 activists who’d taken part in the week-long protest camp. The evaluation showed up some important outcomes including a strong match between hoped-for and actual outcomes, a significant increase in the likelihood that participants will participate in direct action as a result of their experiences in Newcastle and very strong support for another national climate change convergence.

More recently, we’ve trialled a range of evaluation tools with campaigning organisations. Several NGOs engaged tCA to either lead post-campaign evaluations or facilitate pre-campaign workshops to develop evaluation frameworks.

If your organisation is developing and applying evaluation tools in your campaigns, we’d love to hear from you.

online evaluation resources

What are people saying about us?

Peter Callender, Quit Coal



Like many campaigning groups, we are constantly grappling with capacity issues, a lack of funding/resources, burnout and how to best manage volunteers. While it's early days, the fellowship is already having significant flow on effects to the rest of the Quit Coal collective and the lessons we are learning are both effective and reinvigorating!


The Change Agency
2014-04-16T22:34:36+10:00
Like many campaigning groups, we are constantly grappling with capacity issues, a lack of funding/resources, burnout and how to best manage volunteers. While it's early days, the fellowship is already having significant flow on effects to the rest of the Quit Coal collective and the lessons we are learning are both effective and reinvigorating!
dave & gemma

Dave Muhly, Sierra Club

What began at Pittwater as a collection of skilled campaigners became a cadre of skilled organizers by the final day at Baden Powell. On Sunday evening as we gathered, I overheard one participant chatting with another at a picnic table and heard, "challenge, choice, outcome" as part of her conversation. Another commented at the final circle at how what had seemed like such a large group at Pittwater now seemed like a much smaller group, reflective of how closely this group had bonded as a team despite their vast differences in geography or organizational size or style, but based on a common goal and identity. Concepts like "building teams" and "building relationships" were part of the normal parlance and just a cursory review of the evaluations to date show an increased appreciation for and attention to leadership development and strategic planning. A number of participants reminded me of my off-the-cuff set of definitions about the differences between mobilizing, campaigning and community organising (focusing on local power), and one told me she has it on the wall of her office to inspire her every day. This has been the successful launch of an ambitious and visionary program. Many thanks to James and Kate for their vision, wisdom, and care in developing and nurturing the curriculum and the cohort. Kudos!

The Change Agency
2014-09-15T10:27:41+10:00
dave & gemma
What began at Pittwater as a collection of skilled campaigners became a cadre of skilled organizers by the final day at Baden Powell. On Sunday evening as we gathered, I overheard one participant chatting with another at a picnic table and heard, "challenge, choice, outcome" as part of her conversation. Another commented at the final circle at how what had seemed like such a large group at Pittwater now seemed like a much smaller group, reflective of how closely this group had bonded as a team despite their vast differences in geography or organizational size or style, but based on a common goal and identity. Concepts like "building teams" and "building relationships" were part of the normal parlance and just a cursory review of the evaluations to date show an increased appreciation for and attention to leadership development and strategic planning. A number of participants reminded me of my off-the-cuff set of definitions about the differences between mobilizing, campaigning and community organising (focusing on local power), and one told me she has it on the wall of her office to inspire her every day. This has been the successful launch of an ambitious and visionary program. Many thanks to James and Kate for their vision, wisdom, and care in developing and nurturing the curriculum and the cohort. Kudos!
Richard Yin

Dr Richard Yin, Doctors for the Environment Australia 2020

We had the privilege of working with James Whelan and The Change Agency over two days to clarify our understanding of campaigning and advocacy. With over 20 doctors and medical students from varied experiences in advocacy work present and a very complex and full agenda, the workshop was a huge success made possible through a very thoughtful and professional facilitation process from James. I can only commend the quality of his work and thank him once again for the weekend.
The Change Agency
2020-02-25T11:16:05+11:00
Richard Yin
We had the privilege of working with James Whelan and The Change Agency over two days to clarify our understanding of campaigning and advocacy. With over 20 doctors and medical students from varied experiences in advocacy work present and a very complex and full agenda, the workshop was a huge success made possible through a very thoughtful and professional facilitation process from James. I can only commend the quality of his work and thank him once again for the weekend.

Alana West, Quit Coal organiser

The fellowship has equipped me with a deeper understanding of what community organising is, and how it can best be applied. Through my learnings I have been challenged to move from tactics-based campaigning to more strategic, long-term campaigning. I understand better where my campaign and my community fit into the incredible tapestry that is the environment and climate movement in Australia.
The Change Agency
2015-03-17T21:00:54+11:00
The fellowship has equipped me with a deeper understanding of what community organising is, and how it can best be applied. Through my learnings I have been challenged to move from tactics-based campaigning to more strategic, long-term campaigning. I understand better where my campaign and my community fit into the incredible tapestry that is the environment and climate movement in Australia.

Anna Rose, ASEN Convenor and NUS National Environment Officer 2005

As a direct result of the training you ran at Melbourne Uni, they will be running a real campaign on public transport concessions next year and are even investing in properly researching so they can have a strategic, directed campaign.
The Change Agency
2014-03-30T07:48:37+11:00
As a direct result of the training you ran at Melbourne Uni, they will be running a real campaign on public transport concessions next year and are even investing in properly researching so they can have a strategic, directed campaign.

Jess Kirby, GetUp! organiser

The Change Agency fellowship has been a completely transformative experience for all of us. I’ve met 22 of the most diverse, interesting organisers and campaigners in the country, and been trained by more than a dozen experts on everything from critical pathways, to the history of the environment movement in Australia, to NationBuilder best practice. I can’t recommend this program highly enough.  
The Change Agency
2015-03-17T20:50:52+11:00
The Change Agency fellowship has been a completely transformative experience for all of us. I’ve met 22 of the most diverse, interesting organisers and campaigners in the country, and been trained by more than a dozen experts on everything from critical pathways, to the history of the environment movement in Australia, to NationBuilder best practice. I can’t recommend this program highly enough.  

Thea Ormerod, Australian Religious Response to Climate Change

Whereas I had been working intuitively and reasonably well as a part of with a team of dedicated volunteers, the Community Organising Fellowship is providing a range of easy-to-understand useful tools which will help ARRCC to be much more effective. The training is carefully crafted to maximise skills development so we can use our limited resources in a way which will deliver results far more strategically. I already have quite a clear vision of how to successfully motivate our volunteers into participating more actively in the change effort.
The Change Agency
2015-03-17T19:24:22+11:00
Whereas I had been working intuitively and reasonably well as a part of with a team of dedicated volunteers, the Community Organising Fellowship is providing a range of easy-to-understand useful tools which will help ARRCC to be much more effective. The training is carefully crafted to maximise skills development so we can use our limited resources in a way which will deliver results far more strategically. I already have quite a clear vision of how to successfully motivate our volunteers into participating more actively in the change effort.

Anna Rose, ASEN Convenor and NUS National Environment Officer 2005

The Change Agency has contributed enormously to strengthening the student environment movement in Australia and helping us shift to a culture of strategic thinking, planning and reflection on our activism. The training and advice provided by the Change agency over the last twelve months has been invaluable to tens of campus environment collectives and we are already seeing tangible results in real wins in our Campus Clean Energy Camp. Thank you Change Agency!
The Change Agency
2014-03-30T07:37:22+11:00
The Change Agency has contributed enormously to strengthening the student environment movement in Australia and helping us shift to a culture of strategic thinking, planning and reflection on our activism. The training and advice provided by the Change agency over the last twelve months has been invaluable to tens of campus environment collectives and we are already seeing tangible results in real wins in our Campus Clean Energy Camp. Thank you Change Agency!
Nick Aberle

Nick Aberle, Environment Victoria

Learning the theory and engaging with such practical implementation in such depth will definitely make me a more effective and successful campaigner and organiser. I’m looking forward to practicing my new skills in being more rigorous, thinking more strategically, and communicating more effectively. The strength of the bonds formed within the group has already strengthened the climate movement in Australia.
The Change Agency
2014-05-10T21:42:00+10:00
Nick Aberle
Learning the theory and engaging with such practical implementation in such depth will definitely make me a more effective and successful campaigner and organiser. I’m looking forward to practicing my new skills in being more rigorous, thinking more strategically, and communicating more effectively. The strength of the bonds formed within the group has already strengthened the climate movement in Australia.

Leigh Ewbank, Yes2Renewables coordinator

Usually, organisers learn in the heat of battle – through trial and error, stress, and necessity. The Community Organising Fellowship has provided a rare opportunity to step off the campaign trail, slow down, and do some deep learning. The suite of tools explored in the program will influence my practice for years to come.

 By creating a ‘community of practice’ of organisers, those behind the fellowship have shown strategic leadership. The relationships the program has cultivated (within the cohort and between alumni) will pay dividends. 
The Change Agency
2015-03-17T20:58:10+11:00
Usually, organisers learn in the heat of battle – through trial and error, stress, and necessity. The Community Organising Fellowship has provided a rare opportunity to step off the campaign trail, slow down, and do some deep learning. The suite of tools explored in the program will influence my practice for years to come.  By creating a ‘community of practice’ of organisers, those behind the fellowship have shown strategic leadership. The relationships the program has cultivated (within the cohort and between alumni) will pay dividends. 
0
0
The Change Agency