doing impact evaluations in argentina and chile l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Doing Impact Evaluations in Argentina and Chile: PowerPoint Presentation
Download Presentation
Doing Impact Evaluations in Argentina and Chile:

Loading in 2 Seconds...

play fullscreen
1 / 12

Doing Impact Evaluations in Argentina and Chile: - PowerPoint PPT Presentation


  • 115 Views
  • Uploaded on

Doing Impact Evaluations in Argentina and Chile:. Pragmatism, Opportunities and Partnership. Country Context for Evaluation. Argentina Weaknesses in Survey Data Highly Politicized, Particularly Relations between Central and Lower Levels of Government Lack of openness on information

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Doing Impact Evaluations in Argentina and Chile:' - Jimmy


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
doing impact evaluations in argentina and chile

Doing Impact Evaluations in Argentina and Chile:

Pragmatism, Opportunities and Partnership

country context for evaluation
Country Context for Evaluation

Argentina

  • Weaknesses in Survey Data
  • Highly Politicized, Particularly Relations between Central and Lower Levels of Government
  • Lack of openness on information
  • Lack of institutional capacity in area

Chile

  • Evaluation Culture Led by Ministry of Economy
impact evaluations 1997 2006
Impact Evaluations 1997-2006

Argentina

  • Trabajar (workfare) Program
  • Workfare Participation and Exit
  • Private Employment Subsidy
  • Heads of Household Project
  • Grant-financed Productive Activities

Chile

  • Chile Solidario
motivations
Motivations
  • Serious link with possible follow-up operation (Trabajar) – role of Bank management
  • Risk mitigation measure (Heads of Household/grants for productive activities)
  • Government/Bank shared technical interest (private employment subsidy, study of workfare leavers, Chile Solidario)
pragmatic design
Pragmatic Design
  • Used existing surveys (Social Survey, Labor Force Survey, CASEN)
  • Partnered with local institutions (Ministry of Labor, SIEMPRO, INDEC, MIDEPLAN)
  • Partnered with DEC staff (Bank supervision budget and other resources)
  • Government financed out of loan funds
  • Cost-effective impact evaluations
pragmatic design continued
Pragmatic Design continued
  • Argentina productive projects: 3rd best design, rigorously implemented
  • Chile: Based on how program was implemented, recovery from last minute change on sample
  • Don’t give in on key items – sample size, innovation (psycho-social questions), quality of technical advice on evaluation
  • Random Assignment sometimes possible
timing critical
Timing Critical
  • Trabajar: Board approval (6/97)

Prel. Evaluation results (5/98)

  • HoH: Board approval (1/2003)

Prel. Evaluation results (7/2003)

Chile

Solidario: Information for New Government

devil is in the details
Devil is in the Details
  • Be ready for close supervision and lots of nitty-gritty work
  • Carefully monitor implementation (samples, field work, questionnaires) -even then things will go wrong
  • Be ready to explain design and methodology many times
  • Not a one-shot deal
pay off of sustained partnership
Pay-off of Sustained Partnership
  • Building of Relationships (INDEC, DIPRES- Budget Office in Chile)
  • Building of Relationships with Bank staff (DEC)
  • Building of Understanding of Methodologies (Ministry of Labor, DIPRES)
  • Aiming to make it “second nature”
link with operations of programs
Link with Operations of Programs
  • How is program being implemented?
  • What administrative data is available?
  • Knowledge/cooperation of operational staff
  • Important for following up on results
  • Add value to evaluation
  • Best partners for impact evaluation are program operators (Ministry of Labor, Chile Solidario/FOSIS- Social Fund and main operators of Program)
use of results
Use of Results
  • Trabajar – Justified follow-on operation
  • Head of Household – Program credibility,

provided information on implementation

  • Chile Solidario – too soon to tell
  • “Public goods” contribution
  • Spill-over effects (use of data by others)
but not a magic bullet
…but, Not a Magic Bullet
  • Decisions on programs based on many factors, not just their performance
  • Not everyone convinced by evidence-based data vs. anecdotes or ideology or initial views
  • Need for better dissemination, particularly in-country
  • Bank value-added, including for middle-income countries