Main results of toolbox matrix analysis May 2009 EuropeAid E5. Joint Monitoring Approaches. The toolbox matrix. Information on 13 agencies is available.
Information on 13 agencies is available.
7 agencies completed the Toolbox Matrix in Excel; information on the others was extracted from previous surveys (before the Seminar in June).
9 agencies use Results-oriented Monitoring (ROM) Systems.
4 agencies (SIDA, AECID, CMRS, LD) focus on activities, inputs and/or outputs.
All agencies (except BTC and AFD) use their “ROMS” for projects/programmes and also for sector support (EC is currently testing ROM for sector programmes).
3 donors state that their monitoring data can be compared and aggregated (EC, AFD, DFID).
5 agencies use internal staff to perform their monitoring activities, while other 5 use both internal and external experts and 2 use only external experts.
All (except WB) use the DAC evaluation criteria. AFD and NMFA leave out the efficiency criterion.
5 agencies use rating systems in their ROMS (such as grading (a-d), colors…)
AFD uses its ROM exclusively at the design phase of the project/programme cycle.
All other ROM intervene during the project implementation and in some cases also at/near completion (DFID, USAID, WB, BTC, GTZ) and after completion (EC, USAID, GTZ).
Monitoring jointly with PG?
Are results shared/published?
Monitoring is mainly used to provide feedback to project management (11) and to contribute to lessons learned (8).
Main users of results from monitoring are managers at projects level and country level and often senior management in HQ
Inexistence/ low quality of indicators; monitoring less precise and objective (EC, DFID UK, LD, NMFA).
Not all projects are covered / assessed (EC).
“Learning” captured by external monitors and not “in house” (EC).
Alignment with PG monitoring systems should be enhanced (LD).
Improving link between on-going implementation and design phase (AFD).
Result chains used not always detailed (NMFA).
Need of indicators for process-oriented interventions such as the policy dialogue or institutional strengthening.
Result-based monitoring of contributions to multilateral organizations, international agencies and civil society organizations remains difficult (NMFA).