Useful impact assessments in a climate of donor driven demand
Download
1 / 31

Useful Impact Assessments in A Climate of Donor Driven Demand - PowerPoint PPT Presentation


  • 49 Views
  • Uploaded on

Useful Impact Assessments in A Climate of Donor Driven Demand. Maureen O’Flynn. IA the way I see it. Impact – So What?. Impact Assessment addresses the “So What” question... Thousands of “ successful ” projects and programmes make no lasting difference to people’s lives.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Useful Impact Assessments in A Climate of Donor Driven Demand' - dakota


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript


Impact so what
Impact – So What? Demand

Impact Assessment addresses the “So What” question...

Thousands of “successful” projects and programmes make no lasting difference to people’s lives


Make impact assessments more useful 4 key messages
Make Impact Assessments more Useful: 4 Key Messages Demand

  • Be honest

  • Be realistic

  • Be clear

  • Be practical


Be honest
Be Honest Demand

  • When was the last time you told a lie, or were economical with the truth?

  • Why did you do this?

  • So what’s this got to do with M&E and Assessing Impact?


Conditions needed to enable honest impact assessments
Conditions needed to enable honest impact assessments Demand

  • Trust

  • Understanding of what’s needed

  • Capacity and support

  • Time

  • Belief that the exercise will lead to positive results


Be realistic
Be Realistic Demand

  • Two parts:

  • In terms of understanding contributions

  • In terms of scale and reach..



Who might claim contribution to dan s quality of life are they conflicting what does dan think
Who might claim contribution to Dan’s quality of life? Are they conflicting? What does Dan think?


Transpose this thinking to tanzania and a 14 year old male student bahati
Transpose this thinking to Tanzania and a 14 year old male student, Bahati..

........................... And how realistic is attribution?




Assess impact for direct spheres of influence illustrate impact for indirect spheres
Assess people’s lives...impact for direct spheres of influence; illustrate impact for indirect spheres

Indirect

Direct


Be realistic in terms of reach
Be Realistic in Terms of Reach people’s lives...

  • Its no good claiming impressive scale and reach or

  • giving too many figures in an attempt to please.. or to be seen to contributing to MDGs....

  • Different orgs are using and therefore repeating nos ( e.g. HIV in Nepal)


Be clear
Be Clear: people’s lives...

  • Staff and partners need to understand difference and complementarities between M&E and impact

  • Linking reasons for Impact to approaches..

  • Plan for impact from the start of interventions


Linking reasons for impact to approaches
Linking reasons for Impact to approaches people’s lives...

What’s the main driver?

  • Demonstrate success?

  • Improve performance?

  • Be accountable to the people (stakeholders) for whom we are working?

  • Use the findings from impact assessments to advocate for changes in policy and legislation?


Three possibilities approach 1
Three Possibilities: Approach 1 people’s lives...

A retrospective study of a project which has, typically, been planned using a linear approach to change

The main purpose is to test or verify whether the logic of the project was correct: did it achieve the changes that it set out to?


Approach 2
Approach 2: people’s lives...

  • More process driven – and less judgemental – than the first.

  • Stakeholders are involved in all stages

  • Makes use of the concept of emerging change.

  • Purpose:

    • Work with stakeholders to visualise changes they want to see in their lives and support them to track progress

    • Empower stakeholders

    • Contribute to organisational learning.


Approach 3
Approach 3: people’s lives...

  • Similar to second but “turns the telescope round”. Takes place some years after the completion of the project or programme

  • Identifies changes that have taken place within the community, and then to consider to what extent they can have contributed to change in defined areas

  • Purpose

    • understand to what extent organisational efforts are making a difference to the lives of the people they claim to be working with and for.

      All organisations need to consider carrying out from time to time.


Develop a theory of change toc
Develop a Theory of Change (ToC) people’s lives...

What are they?

  • They differ from (but can complement) logical framework thinking in that they:

    • describe a causal pathway by specifying what is needed for goals to be achieved

    • require the articulation of underlying assumptions which can be tested and measured.

    • change the way of thinking about implementation strategies: the focus is not so much on what will be achieved, but rather what will change?.

  • They can be set at different levels - organisation, programme and/or project


Climate change and development knowledge network cdkn toc framework
Climate Change and Development Knowledge Network (CDKN) ToC Framework

1

2

3

4

5

6

7

8

Problems CDKN aims to address

Underlying causes of these problems

Vision

Principles of engagement

Who we work with

(target groups)

How we work with them (strategies)

To achieve (medium and long term outcomes)

CDKN Goal(s)


Dimensions of change
Dimensions of Change Framework

  • Organisational ToCs can be further developed by identifying “Dimensions of Change” (DoC) to which all of their efforts will contribute.

  • These DoC form the backbone of their impact assessment process.

    • They are inter-related: any one project or programme may be supporting changes in one or more of these dimensions.

    • All organisational interventions should be explicitly working towards changes in one or more of these dimensions.

    • They are usually designed to be interpreted according to regional and national contexts, but broad enough to be able to facilitate comparability across different regions and countries.

  • Progress against these dimensions is assessed through monitoring, evaluation and impact assessment processes.


Cdkn works in all of these areas in order to achieve
CDKN works in all of these areas Frameworkin order to achieve:


Be prepared
Be Prepared Framework

  • Plan for impact at the start of the project/programme

  • Be clear about who is responsible for what

  • Build IA processes into existing systems and structures

  • Use a few tried and tested tools over complex and clever ones

  • Use findings widely and creatively for increased impact of impact assessments


Plan impact from the start cdkn impact assessment plan
Plan Impact from the start: FrameworkCDKN Impact Assessment Plan

  • Four distinct but complementary strategies, based on DoC:

    • Ongoing monitoring of impact built into many of the M&E reporting formats, and impact data w gathered routinely alongside other M&E data.

    • Part of the mid-term review and evaluation process

    • Tracing study carried out over the life span of the project. This will focus on how identified sample groups are changing and developing as a result of on-going CDKN efforts, in relation to the dimensions of change.

    • Retrospective study will take place some time after the completion of the project. Will assess the changes relation to the dimensions of change, and to what extent CDKN was able to contribute to these changes.



Build ia processes into existing systems and structures
Build IA processes into existing systems and structures Illustration?

Add this set of questions:

  • In relation to Dimensions of Change:

    • What’s changing

    • For whom

    • How significant is it?

    • Will it last?


Tools
Tools Illustration?

Think time and capacity and resources:

  • Use a few tried and tested methods (which allow for triangulation) over complex or innovative and untested ones that are not clearly understood at field level.

  • Involve stakeholders in gathering information. Build their capacity to do this effectively

  • Remember:

    • MSC takes time and can be used very inefficiently

    • Old favourites are good (FGD, SSI, Interviews)

    • Appreciative enquiry is empowering

    • PRA tools are good


Use findings widely and creatively for improved impact of impact assessments
Use findings widely and creatively for improved impact of impact assessments!

  • For Planning ( based on findings) : scenario workshops, appreciative enquiry

  • For reporting/ advocacy: variety of media and other communication tools - youtube, video etc


Make impact assessments more useful 4 key messages1
Make Impact Assessments more Useful: 4 Key Messages impact assessments!

  • Be honest

  • Be realistic

  • Be clear

  • Be practical


Last tip don t give up or get cynical
Last Tip.. Don’t give up or get cynical! impact assessments!

  • Impact assessment can be rewarding and inspirational, especially when there is evidence that efforts have led to improved programmes and improved relationships with stakeholders.

  • Depending on the approach, it can either be complex and frustrating exercise, or an essential part of organisational planning and learning.

  • As development workers, we need to take the exploration of changes that we influence in people lives seriously.


ad