Learnings from EU Pilot Evaluations: Enhancing Regional Policy Design
70 likes | 90 Views
Explore 2014+ pilot findings in Hungary, Italy, Poland, Spain, Sweden, France, Netherlands, Slovakia. Learn about new approaches, indicator efficacy, impact evaluation methods, and the evolution of performance assessment.
Learnings from EU Pilot Evaluations: Enhancing Regional Policy Design
E N D
Presentation Transcript
Results Indicators 2014+ Findings of the Pilots Veronica Gaffey Evaluation Unit, DG for Regional Policy
Location of Pilots • Hungary (Central) • Italy (Sardegna, Marche) • Poland (Pomorskie) • Spain (Galicia) • Sweden (South) • France (Aquitaine, Rhône-Alpes, Martinique) • Netherlands (West) • Slovakia (Regional OP and Competitiveness & Economic Growth)
Questions for the Pilots • What change to you wish to achieve with this priority? • What indicator can capture this change? • Do you know the baseline for 2007 or now? • Will your output indicators contribute to change in the result indicator? How? • Could you evaluate it? How?
Learning • New approach feasible, but not without significant change in mindsets & practice • No pilot region uses the new approach • Indicators mostly do not reflect the intended effects of the priorities • Results focus must be part of programme design • Concentration a pre-condition • Decisions on what to fund and what not to fund – political choice
Learning • With concentration – fewer indicators • Result indicators – close to policy • Statistics often will not be appropriate; explore administrative data, specific surveys, benchmarks; use ex ante evaluations • Baselines and Targets essential – they can be qualitative or quantitative • Reflect when change can be expected – intermediate results
Learning • Reflect on how to evaluate: counterfactual, theory based, before and after studies • Reflect on “other factors” contributing to results • A final point: Indicators do not tell us everything. Evolution of result indicator should prompt debate – not the last word on performance of the policy.