70 likes | 195 Views
This presentation outlines how NZAID employs DAC Evaluation Quality Standards (EQS) to enhance evaluation quality and foster continuous improvement. It includes a case study on the annual analysis of NZAID evaluations, demonstrating the effectiveness of EQS in identifying areas for enhancement and setting benchmarks for evaluation practices. The conclusions highlight the usefulness, clarity, and flexibility of EQS, while also pinpointing opportunities for further improvement. The presentation concludes with future steps for promoting the application of EQS in NZAID's evaluation processes.
E N D
NZAID Experiences with DAC Evaluation Quality Standards (EQS)Andrew Kibblewhite & Miranda CahnNZAID Evaluation Advisors
Introduction Outline of presentation • How NZAID has been using the EQS • Case study: annual analysis of quality of NZAID evaluations • EQS: conclusions and opportunities • NZAID and EQS: where to from here?
Using the EQS in NZAID • Benchmark for standards of evaluations and reviews. • Developing NZAID evaluation guidelines • Advice to NZAID programme managers • Peer reviewing and appraising evaluations/reviews • Joint evaluations – sets common standards • Annual analysis of quality of NZAID-commissioned evaluations (case study follows)
Case study: Using EQS for analysis of quality of NZAID evaluations Annual review of quality of NZAID evaluations • For NZAID learning, and improvement • In 2008 - eighteen 2007 evaluations • EQS informed • ‘matrix’ of criteria against which reports assessed • standards expected • Aspects of evaluations and reviews needing improvement were identified
Case study: … continued Found: • Most NZAID evaluations could be improved • EQS useful in guiding the analysis • NZAID has additional specific evaluative criteria • EQS – allowed flexibility • Analysis grounded in international expectations However: • Some specific standards/content we required were not covered in the EQS • Aspects in the EQS could be more logically arranged • Evaluation/review methodology standards – developed our own criteria
EQS: conclusions and opportunities Conclusions: • Overall – EQS very useful • EQS language - clear for a broad audience • EQS - shared understanding of evaluation standards • EQS - allows for flexibility and innovation Opportunities: • Improve methodology section in EQS • Enhance and re-arrange the information about evidence • Include guidance on appropriate management structures • Arrange EQS document more logically • Clarify purpose and use of EQS • Increase awareness amongst stakeholders
NZAID – where to from here? • More awareness and promotion of use: • NZAID staff: • Guidelines • Advice • Contractors • Training • Specified in TOR. • Encourage the EQS to be applied more at the design stage, incl. informing M&E frameworks