1 / 18

Ida Terluin and Petra Berkhout Agricultural Economics Research Institute LEI

Exploring the perspectives of a mixed case study approach for the evaluation of the EU Rural Development Policy 2007-2013. Ida Terluin and Petra Berkhout Agricultural Economics Research Institute LEI. 122 nd European Association of Agricultural Economists Seminar

nara
Download Presentation

Ida Terluin and Petra Berkhout Agricultural Economics Research Institute LEI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Exploring the perspectives of a mixed case study approach for the evaluation of the EU Rural Development Policy 2007-2013 Ida Terluin and Petra Berkhout Agricultural Economics Research Institute LEI 122nd European Association of Agricultural Economists Seminar Evidence-Based Agricultural and Rural Policy Making Methodological and Empirical Challenges of Policy Evaluation February 17th – 18th, 2011, Ancona (Italy) Centro Studi Sulle Politiche Economiche, Rurali e Ambientali associazioneAlessandroBartolastudi e ricerche di economia e di politica agraria Università Politecnica delle Marche

  2. Common Monitoring and Evaluation Framework (CMEF) • CMEF is designed by the EU Commission for the evaluation of the EU Rural Development Policy 2007-2013 • Comprehensive approach: about 160 indicators and 140 common evaluation questions

  3. Concerns on the CMEF • large number of indicators is experienced as a cumbersome requirement of Brussels; data are not always available • simplification of the CAP: wish to have a simpler and more popular kind of evaluation framework • evaluation questions are not always relevant in Member States/regions • emphasis on what has happened and not how or why it happened

  4. Aim of our paper • To explore whether there is an alternative approach to the CMEF for the evaluation of the EU Rural Development Policy 2007-2013 and to asssess the perspectives of this alternative for EU wide use

  5. Plan of this presentation • Comparative analysis of evaluation methods of rural development policy • Identification of an alternative approach for the CMEF • Testing of this alternative approach in the midterm evaluation of the RDP 2007-2013 in The Netherlands • Assessment of the perspectives of this alternative approach for EU wide use

  6. Comparative analysis of evaluation methods of rural development policy • Literaturestudy: 22 recent evaluationmethods • Classification of these methodsaccordingtoappliedmethodologyinto five goups: • the CMEF type approach: hierarchy of indicators combined with evaluation  questions • the tally approach: counting whether a quantified objective has been achieved • the econometric approach: use of econometric methods • the modelling approach: use of models • the mixed case study approach: use of quantitative and qualitative analyses, often in case studies

  7. Main properties of evaluation methods

  8. Identification of an alternative approach to the CMEF • Starting point for identification: different properties of the groups of evaluation methods • Given differences of CMEF and mixed case study approach, this last approach might be a promising alternative for the CMEF

  9. The mixed case study approach • analysis consists of different stages, in which different methods are applied • by combining evidence from these stages, it is tried to find exploring patterns • approach has been applied for the ex post evaluation of the EU Rural Development Policy 2000-2006 in Wales by Midmoreet al. (2008): • analysis of secondary data of the case study region • in-depth interviews with representatives of different interest groups

  10. Design of a protocol with instructions for the various steps in the evaluation • Analysis of the baseline situation in the case study region • Analysis of the objectives of the EU Rural Development Programme (RDP) 2007-2013 in the case study region • Analysis of the financial input and the output for each rural development measure • Questions for in-depth interviews with representatives of the different interest groups • A template for writing a report

  11. Testing alternative in midterm evaluation RDP in 2 Dutch provinces:(1) Zeeland and (2) Gelderland

  12. Experiences in case study in Zeeland (1) • Baseline situation in the case study region: easy to describe, as data and literature were readily available • Objectives of the RDP: difficult to assess, due to complex way the RDP is implemented in The Netherlands • there is one RDP for the whole country • national government is responsible for axes 1 and 2 • province is responsible for axes 3 and 4 and has integrated them with other rural policies

  13. Experiences in case study in Zeeland (2) • Data on financial input and output indicators for each rural development measure are collected by two institutes, which have different data systems • Data for input and output indicators for measures under axes 1 and 2 are only available at national level, and it is very time-consuming to extract regional data • Data on result and impact indicators in Zeeland are not collected

  14. Experiences in case study in Zeeland (3) Progress in the absorption of the EAFRD budget 2007-2009 in Zeeland: Group 3 focuses on tourism activities, basic services, village renewal and rural heritage, measures which fit rather well into the rural development needs in Zeeland

  15. Experiences in case study in Zeeland (4) According to the six interviewed persons: • the landscape and quality of life have been improved in qualitative terms by the RDP • these projects fit in the long tourist tradition in Zeeland as well as the need to maintain or improve the supply of basic services in rural areas • economic diversification has been boosted • they had no idea of the impact of the measures of axis 1 on the development of the agricultural sector

  16. Experiences in case study in Zeeland (5) • actors participate in the RDP measures as this generates funds for their projects • most of the projects would also have been conducted without EAFRD financing, but often at a smaller scale • the requirement of 50% national cofinancing for each project is not always feasible • interviewees appreciated the easy communication and the openness of the province of Zeeland, which stimulates the implementation of the measures of axes 3 and 4

  17. Concluding remarks (1) • Based on a comparative analysis of 22 evaluation methods of rural development policy, we have identified the mixed case study approach als an alternative to the CMEF • The results of testign this alternative in the province of Zeeland are promising: the analysis of inputs and outputs of the measures in combination with interviews provided sufficient information to get a good overview of the performance of the RDP

  18. Concluding remarks (2) • The interviews yielded useful insights into processes within the region • When experiences with the mixed case study approach in other regions are also satisfying, then it could be considered to use it EU wide as an alternative to the CMEF

More Related