Interim Evaluation of EU Pre-Accession Programmes in Turkey (Service Contract No. 2007/142-454)

1. Interim Evaluation of EU Pre-Accession Programmes in Turkey(Service Contract No. 2007/142-454) Kick-off for 2008 Monitoring and Evaluation 25 February 2008

2. IE Contract - The MWH Consortium 2

3. IE Turkey - Team and Contact Details 3

4. DG Enlargement - Unit E4 Task Manager – Jan Behrens Consultation System Feedback Follow-up of IE Recommendations Interim Evaluation Framework Contract Methodology Quality Control System Oversight Secretariat General for EU Affairs Delegation of the European Commission Planning Coordination Feedback MWH Consortium Interim Evaluation Team IE Conclusions & Recommendations Interim Evaluation Input Project Stakeholders 4

5. Interim Evaluation – What it is NOT • Interim Evaluation is not audit.... • Interim Evaluation is not control..... • Importantly, Interim Evaluation is not monitoring by the Commission services 5

6. Interim Evaluation – What it IS • Part of a general policy of evaluating all Community expenditure • Helps to improve relevance, effectiveness, impact and accountability of EU funds • Provides stakeholders with independent assessments of the state of implementation • Participative and capacity building exercise 6

7. Interim Evaluation – WHY we do it • To assess the state of implementation of the projects • To assess the state of implementation of initiatives in the sector • To provide information to improve implementation of ongoingprojects and sector performance • To provide lessons learned for future projects • To provide lessons learned in relation to the project cycle and its implementation 7

8. How do monitoring and evaluation differ? They are different, but interrelatedfunctions, as they both contribute knowledge as a basis for accountability and enhanced performance; • Monitoring: “Are we doing things right”? while • Evaluation, in addition, “Are we doing the right things?” and “Are there better ways of achieving the results?”

9. Definition of monitoring,evaluation and audit

10. The Process – The 5 Criteria 10

11. Different Kinds of Impact 11

12. Example of Impacts Example: Laboratory equipment for testing hazardous chemicals 12

13. Ratings – Six levels 13

14. Interim Evaluation – Rating Model 14

15. Interim Evaluation - Information Base • Documentation (Accession Partnership, Regular Reports, national strategies, policy documents, Monitoring Reports, project and programme level etc.) • Financial data (up-to-date status) • StructuredInterviews with stakeholders (policy makers, management, EUSG, ECD, CFCU, experts, contractors, Twinning Advisers, beneficiaries etc.) • Surveys/questionnaires: depending on project • Other analysis as required (e.g. databases) 15

16. Information Base – Documents Required • Monitoring Reports • Good quality Monitoring Reports (on time, completed correctly, accurate and up to date information) • Other documentation/Per Project • Project Fiche • Technical Assistance – ToR, Inception Report, Progress Reports, important output documents (TA reports etc.), Minutes of meetings etc. • Twinning – Contract, Quarterly Reports, output documents, Minutes of meetings etc. • Supplies/works – tender dossier, reports of evaluation committees etc. as required • Grant schemes – guidelines, list of applicants/grantees 16

17. IE Reporting Process – The Results • 1. Findings are presented in a draft Sectoral InterimEvaluationReport containing: • Conclusions and Recommendations of the independent Evaluators • Sectoral recommendations • Operational recommendations aimed at specific projects • ‘Early warnings’ • 2. The draft report is finalised taking into account the comments as and where Evaluators judge necessary • 3. The finalised report is debriefed where stakeholders discuss the recommendations and agree a plan of action 17

18. Interim Evaluation Reports 2007-2008 18