USAID’s Experience and Lessons Learned in Approaches used in Monitoring and Evaluating Capacity Bu...
Download
1 / 27

Duane Muller, USAID November 7, 2008 - PowerPoint PPT Presentation


  • 292 Views
  • Uploaded on

USAID’s Experience and Lessons Learned in Approaches used in Monitoring and Evaluating Capacity Building Activities. Duane Muller, USAID November 7, 2008 UNFCCC Meeting on Experiences with Performance Indicators for Monitoring and Evaluation of Capacity Building Rio De Janeiro, Brazil.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Duane Muller, USAID November 7, 2008' - fawzi


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

USAID’s Experience and Lessons Learned in Approaches used in Monitoring and Evaluating Capacity Building Activities

Duane Muller, USAID

November 7, 2008

UNFCCC Meeting on Experiences with Performance Indicators for

Monitoring and Evaluation of Capacity Building

Rio De Janeiro, Brazil


Usg commitment to capacity building
USG COMMITMENT TO CAPACITY BUILDING in Monitoring and Evaluating Capacity Building Activities

  • Integral to development programs

  • Country driven approach

  • Useful lessons at the project level


Managing for results usaid s experiences

Managing for Results in Monitoring and Evaluating Capacity Building Activities USAID’s Experiences


Performance management
PERFORMANCE MANAGEMENT in Monitoring and Evaluating Capacity Building Activities


Performance management1
PERFORMANCE MANAGEMENT in Monitoring and Evaluating Capacity Building Activities

The systematic process of:

  • Monitoring the results of activities

  • Collecting and analyzing performance information

  • Evaluating program performance

  • Using performance information

  • Communicating results


Steps in developing a performance management plan pmp
STEPS IN DEVELOPING A PERFORMANCE MANAGEMENT PLAN (PMP) in Monitoring and Evaluating Capacity Building Activities


Managing for results
MANAGING FOR RESULTS in Monitoring and Evaluating Capacity Building Activities

  • Performance Indicators

    • Scale or dimension

  • Standard Indicators

    • Combination of output and outcome indicators

    • Measure direct, intended results

  • Custom Indicators

    • Meaningful outcome measures


Characteristics of good indicators

Direct measures in Monitoring and Evaluating Capacity Building Activities

Objective

Plausible attribution

Practical

Disaggregated

Quantitative

CHARACTERISTICS OF GOOD INDICATORS


Monitoring evaluation

Monitoring & Evaluation in Monitoring and Evaluating Capacity Building Activities

Different but complementary roles at USAID


Monitoring and evaluation

MONITORING in Monitoring and Evaluating Capacity Building Activities

Clarify program objectives

Link project activities to their resources/objectives

Translate into measurable indicators/set targets

Collect data on indicators

Report on progress

EVALUATION

Analyzes why and how intended results were/were not achieved

Assesses contributions of activities to results

Examines results not easily measured

Explores unintended results

Provides lessons learned/recommendations

MONITORING AND EVALUATION


Experiences with monitoring

EXPERIENCES WITH MONITORING in Monitoring and Evaluating Capacity Building Activities

USAID’s lessons learned


8 step process to collect monitoring data
8 step process to collect monitoring data in Monitoring and Evaluating Capacity Building Activities

  • Indicators/Definitions

  • Data source

  • Method: data collection

  • Frequency: data collection

    5) Responsibilities: acquiring data

    6) Data analysis plans

    7) Plans for evaluations

    8) Plans for reporting/using performance information


Experiences with evaluation

EXPERIENCES WITH EVALUATION in Monitoring and Evaluating Capacity Building Activities

USAID’s Lessons Learned


Evaluation powerful learning tool
EVALUATION= POWERFUL LEARNING TOOL in Monitoring and Evaluating Capacity Building Activities

  • Identifies lessons learned

  • Improves quality of capacity building efforts

  • Critical to understanding performance

  • Retrospective


Analytical side of project management

Analyzes why and how intended results were/were not achieved in Monitoring and Evaluating Capacity Building Activities

Assesses contributions of activities to results

Examines results not easily measured

Explores unintended results

Provides lessons learned/recommendations

ANALYTICAL SIDE OF PROJECT MANAGEMENT


Types of evaluation used by usaid

TYPES OF EVALUATION USED BY USAID in Monitoring and Evaluating Capacity Building Activities


Traditional evaluation
TRADITIONAL EVALUATION in Monitoring and Evaluating Capacity Building Activities

  • Donor focused and ownership of evaluation

  • Stakeholders often don’t participate

  • Focus is on accountability

  • Predetermined design

  • Formal evaluation methods

  • Independent/third party evaluators


Participatory evaluation
PARTICIPATORY EVALUATION in Monitoring and Evaluating Capacity Building Activities

  • Participant focus and ownership

  • Broad range of stakeholders participate

  • Design is flexible

  • Focus on learning


Assessments
ASSESSMENTS in Monitoring and Evaluating Capacity Building Activities

  • Quick and flexible

  • Trends and dynamics

  • Broader than evaluations


Methodologies for evaluations
METHODOLOGIES FOR EVALUATIONS in Monitoring and Evaluating Capacity Building Activities

  • Scope of Work (SOW)

  • Interviews

  • Documentation Reviews

  • Field Visits

  • Key informant interviews

  • Focus group interviews

  • Community group interviews

  • Direct observation

  • Mini surveys

  • Case studies

  • Village imaging


Successful evaluations lessons learned
SUCCESSFUL EVALUATIONS= LESSONS LEARNED in Monitoring and Evaluating Capacity Building Activities

  • Making the decision to evaluate

  • Ensuring Scope of Work is well thought-out

  • Finding the appropriate team

  • Ensuring the results are used


Program assessment rating tool part

PROGRAM ASSESSMENT RATING TOOL (PART) in Monitoring and Evaluating Capacity Building Activities


Part goals procedures and results
PART: Goals, Procedures and Results in Monitoring and Evaluating Capacity Building Activities

  • Reviewing performance of US government programs

    • Program purpose and design

    • Strategic planning

    • Program management

    • Results

  • Standard questionnaire called PART

  • Results in an assessment and plan for improvement


Part ratings
PART RATINGS in Monitoring and Evaluating Capacity Building Activities

Performing

  • Effective

  • Moderately effective

  • Adequate

    Not Performing

  • Ineffective

  • results not demonstrated


Conclusions
Conclusions in Monitoring and Evaluating Capacity Building Activities

  • Lessons learned/best practices for M&E

  • Project Level experiences

    • Cost effective

    • Timely

    • Ensure data is used

  • National experience= PART

  • Country driven approach to capacity building

    • Paris Declaration on AID Effectiveness


Additional resources
ADDITIONAL RESOURCES in Monitoring and Evaluating Capacity Building Activities

Development Experience Clearinghouse

  • http://dec.usaid.gov

    Performance Management

  • A Guide to Developing and Implementing Performance Management Plans

    http://www.usaid.gov/policy/ads/200/200sbn.doc

    Evaluation Documents

  • Preparing an Evaluation Scope of Work

    http://www.usaid.gov/pubs/usaid_eval/pdf_docs/pnaby207.pdf

  • Conducting a Participatory Evaluation

    http://www.usaid.gov/pubs/usaid_eval/pdf_docs/pnabs539.pdf

  • Constructing an Evaluation Report

    http://pdf.usaid.gov/pdf_docs/PNADI500.pdf

  • Conducting Key Informant Interviews

    http://www.usaid.gov/pubs/usaid_eval/pdf_docs/pnabs541.pdf

    PART

    - http://www.whitehouse.gov/omb/part/

    - http://www.whitehouse.gov/omb/expectmore/


For further information
For further information: in Monitoring and Evaluating Capacity Building Activities

Duane Muller

USAID

EGAT/ESP/GCC

Tel 1-202-712-5304

Fax 1-202-216-3174

Email: [email protected]

Website: www.usaid.gov

Keyword: climate change


ad