Applying Quality Standards in Impact Evaluation: Case of CARE Program Quality Framework and Evaluati...
Download
1 / 10

CARE International Program Quality Framework pqdlre - PowerPoint PPT Presentation


  • 112 Views
  • Uploaded on

Applying Quality Standards in Impact Evaluation: Case of CARE Program Quality Framework and Evaluation Policy.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'CARE International Program Quality Framework pqdlre' - aldis


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Care international program quality framework pqdlre

Applying Quality Standards in Impact Evaluation: Case of CARE Program Quality Framework and Evaluation Policy

Ahmed Ag Aboubacrine Josephine KainessieBockarie Sesay Dr. Moses LahaiPatrick RobinDME Unit – CARE Sierra Leone5th AFREA/NONIE/3IE Conference – Cairo -31st March – 2nd April 2009


Care international program quality framework http pqdl care org
CARE International Program Quality Framework CARE Program Quality Framework and Evaluation Policyhttp://pqdl.care.org


Evaluation policy
EVALUATION POLICY CARE Program Quality Framework and Evaluation Policy

DAC Principles

  • Purpose Of Evaluation

  • Impartiality & Independence

  • Credibility

  • Usefulness

  • Participation of Donors and Recipients

  • Donor Co-operation

  • Evaluation Programming

  • Design and Implementation of Evaluations

  • Reporting, Dissemination and Feedback

AFREA

Guidelines

  • Utility

  • Feasibility

  • Propriety

  • Accuracy

  • Evaluation Accountability

CARE International Principles

  • Relevance (focus on what is important)

  • Participation (of community representatives)

  • Focused on impact on the lives of people (significance)

  • Credibility (objective and reliable methods)

  • Integrity (ethical standards)

  • Transparency (willingness to share findings)

  • Independence (of evaluators)


Evaluation policy1
EVALUATION POLICY CARE Program Quality Framework and Evaluation Policy

DAC Standards

1. Rationale, purpose and objectives of an evaluation

2. Evaluation scope

3. Context

4. Evaluation methodology

5. Information sources

6. Independence

7. Evaluation ethics

8. Quality assurance

9. Relevance of the evaluation results

10. Completeness

And …?

Other Evaluation Standards & Guidelines (DFID, Sphere, etc.)

CARE Evaluation Policy Lines

1. Responsibility of COs

2. Consistent with CI Principles (3&6) and Standards (10)

3. Test the relationship with CI’s Vision and Mission and MDGs.

4. Analysis of the degree and consequences of implementation of the CI PQF (SP, UF)

5. Follow professional inter-agency standards (“speak a common language”)

6. Significant participation and high level of influence of participants and stakeholders

7. Evaluation Completeness

8. Conducted openly and in a transparent manner

9. Follow up and accountability

10. Evaluation is a priority  CB + Rigor + Use

11. Generating the resources required the EP


Lessons learnt in practice
Lessons Learnt in Practice CARE Program Quality Framework and Evaluation Policy

  • Policy Evaluation as the main guide while designing both the intervention and its evaluation (ToRs)

  • Operationalize the policy requirements in the evaluation design (in technical offer) – Use checklist

  • Stickiness to the standards (staff, consultants, donors)

  • Mix-Methods (no single method!) by separate experts working as a team (Quantitative Study followed by in-depth Qualitative Assessment)

  • Impact Measurement Vs Participation Principle

  • Evidence Vs Ownership / Sustainability

  • Seeking impact Vs Inventing impact

  • Independence (internal /external)?


Influencing factors
Influencing Factors CARE Program Quality Framework and Evaluation Policy

  • Capacity Constraints

  • Human Factor (agenda, skills, competencies, etc.)

  • Data Collection and Analysis Methods

    • Analysis of Priorities (felt / normative /relative needs)

    • Analysis of Impact (Measured Vs Perceived)

  • Ad-hoc external Vs Action Research through out the lifetime


Rethinking the standards
Rethinking the standards CARE Program Quality Framework and Evaluation Policy

New Challenges

  • Evolution of thinking (IE)

  • Strategic Impact Inquiries

  • Project to Program Shift (P2P)

  • Chose Appropriate Impact Measurement Methods

  • Review Of the Program Quality Framework?


Use of evaluation standards in post conflict context
Use of Evaluation standards in Post-Conflict Context CARE Program Quality Framework and Evaluation Policy

  • Opportunities

    • Alignment is still possible (Evaluation Policies, Paris Declaration, Accra Agenda for Aid Effectiveness).

    • Emerging trend of evaluation and accountability by aid agencies

  • Constraints

    • Contextual Limits to Evaluation Utilization of evaluation to influence decision makers

    • Capacity Development

    • Persistence of emergency culture (dependency)

    • No process oriented


Do and don t in using evaluation standards
“Do” and “Don’t” in using evaluation standards CARE Program Quality Framework and Evaluation Policy

DON’T

  • Think that every thing is feasible

  • Wait for the evaluator to apply the EP

  • Oh!... That’s the job of M&E Officer

  • Think that your evaluation should be always perfect (there are always limits!)

DO

  • Question your design with the lens of your EPs

  • Select what would be mandatory

  • Contextualize (set level of compliance for each principle / standard)

  • Promote attitudes (thinking evaluatively)

  • Work with qualified academic / research people and/or institutions

  • Allocate resources and time


Care international program quality framework pqdlre

For more resources, visit: CARE Program Quality Framework and Evaluation Policyhttp://pqdl.care.org

THANKS!

Question?