slide1 l.
Skip this Video
Download Presentation

Loading in 2 Seconds...

play fullscreen
1 / 18

EVALSED Guide - PowerPoint PPT Presentation

  • Uploaded on

Evaluating Socio-Economic Development - the ever- evolving EVALSED Guide Elliot Stern Presentation to Conference : Evaluating Public Interventions in Romania November 2nd 2006. EVALSED Guide. Evolution of the Guide The Means Collection 1999 developed by C3E Lyon

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'EVALSED Guide' - Pat_Xavi

Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Evaluating Socio-Economic Development- the ever-evolvingEVALSED Guidewww.evalsed.infoElliot SternPresentation to Conference:Evaluating Public Interventions in RomaniaNovember 2nd 2006

evalsed guide

Evolution of the Guide

  • The Means Collection 1999 developed by C3E Lyon
  • Guide to Socio Economic Development 2003 developed by Tavistock Institute, GHK Consulting and IRS (Instituto per la Ricerca Sociale) Milan
  • The Revised Guide focusing on evaluation capacity and an interactive ‘community of practice’ being developed by GHK & a network of experts
evalsed guide3

Philosophy of EVALSED:

  • Evaluation is an integral part of effective management and policy making – it is not a free standing activity nor is it just about accountability
  • Evaluation is not just about technique – it is also an institutionalised activity that needs to be integrated into the operations of all involved actors – which is why evaluation capacity is so important
  • The aim is effective socio-economic development not good evaluation on its own
evalsed guide4

Intended Users

  • Policy makers who have an interest in evaluation
  • Public sector managers and civil servants who commission evaluations
  • Programme managers who will wish to use evaluation in programmes management and planning
  • Programme partners involved as stakeholders
  • Evaluators wishing to broaden methods and strategies
evalsed guide5

The GUIDE is already being used widely:

  • The EVALSED site has over 5000 visits per month,
  • Each visitor clicks on about 10 pages and views about 5.5
  • Italy, UK and Poland largest users

Usage does not include translations:

  • Translations are now complete not only inRomaniabutalso in the Czech Republic, Italy and Poland
  • Others translations are planned
evalsed guide6
  • Currently consists of a GUIDE targeted at non-technical readers
  • ‘Sourcebooks’ that are more specialist covering:
  • Themes and Policy Areas;
  • Methods and Techniques;
  • Capacity Building
  • Glossary of evaluation terms
evalsed guide7
  • Section 1: Contribution of Evaluation to Socio-Economic Development
  • Section 2: Designing and Implementing Evaluation for Socio- Economic Development
  • Section 3: Developing Capacity for Socio-Economic Evaluation
  • Section 4: Choosing Methods & Techniques - Using Evidence
evalsed guide8
  • Section 1: The benefits of evaluation; rationales and purposes for evaluation; the nature of evaluation capacity; the theories that underpin interventions; the current policy context; a review of the main types and source ideas of evaluation; the role of evaluation in the policy cycle; and how evaluation strengthens socio-economic development
evalsed guide9
  • Section 2: The main processes for designing and implementing evaluations; involving stakeholders; defining evaluation questions and criteria; preparing terms of reference; managing evaluations; quality assurance and evaluation standards; and ensuring evaluations are useful and used.
evalsed guide10
  • Section 3:Evaluation capacity as part of institutional capacity; the role of civil society; how to develop capacity; the architecture of evaluationsystems - centralisedand decentralised models; strengthening evaluation demand andevaluation supply including the role of evaluation societies; institutionalisingevaluations
evalsed guide11
  • Section 4: Identifies the main factors that influence choices of methods and techniques - especially policy and stakeholder priorities and evaluation question being asked; discusses quantitative and qualitative approaches; methods for different types of programmes/ interventions; different programme stages; different evaluation stages - e.g. Scoping, obtaining information, drawing conclusions etc; how primary and secondary data is obtained; and how indicator systems are created
evalsed guide12

Sourcebook 1:Themesand Policies

Themes: Sustainable development; increasing institutional andadministrative capacity; equal opportunities;local and territorialdevelopment; social inclusion; information society

Policy areas: Agriculture; transport; employment; enterprise and innovation; justice; energy etc.

evalsed guide13

Sourcebook 2: Methods and Techniques

Organisedunder headings:

Planning and structuring, e.g. Formative evaluation, logic models, stakeholder consultation

Obtaining data, e.g. Surveys, observation, focus groups

Analysing data, e.g. Econometric models, expert panels, delphi techniques

Evaluative judgements, e.g. Cost benefit analysis, expert panels, gender impactanalysis

evalsed guide14

Sourcebook 3: CapacityDevelopment

National cases: Italy, Ireland, Netherlands - all nowupdated

  • Newcases (nearly complete):Spain, Czech RepublicandPoland
  • Plus a new cross cutting regional and cross border synthesis
evalsed guide15

Latestreview tasks

  • Finalise additional national cases
  • Review case examples – and we are accumulating practical examples of innovative evaluations, specific terms of reference, examples of evaluation use
  • Just finishedrevising capacity development guidance to reflect emerging experience in new member states
  • Introduce resources, interactivity, forum – an electronic ‘community of practice’
evalsed guide16


  • Overall purpose is to create a more dynamic interactive and useful site that will support a community of practice among those who evaluate socio-economic development
evalsed guide17
  • Specific interactive elements
  • A resource library that can accept documents, examples and methods that will be tagged or catalogued so that others can retrieve
  • An online ‘forum’ or bulletin board for exchange on specific topics
  • FAQs (Frequently Asked Questions) to accumulate forum know-how
  • Occasional asynchronous ‘conferences’ on selected topics – some suggestions: indicators and data sources, participative methods of evaluation, causality and explanation
evalsed guide18
  • The aim is to create a dynamic resource that will be an ‘evolving object’ rather than something always about to become obsolete and requiring revision!
  • To ensure that evaluation is both methodologically and even theoretically ‘fit for purpose’ whilst reinforcing management and policy-making systems so that they use evaluations well
  • But the overall aim is to support better socio-economic development that will contribute to the economic opportunities and quality of life of Europe’s citizens