The PNPM- Generasi Project One-Year Impact Evaluation Preliminary Findings Presented by: Susan Wong, EASER, The World Bank Ben Olken, M.I.T. Department of Economics. November 5, 2009. Structure of Today’s Presentation. Indonesian context Description of PNPM-Generasi project design
The PNPM-Generasi ProjectOne-Year Impact Evaluation Preliminary Findings Presented by:Susan Wong, EASER, The World BankBen Olken, M.I.T. Department of Economics
November 5, 2009
In 2007, GoI started two pilot projects:
Version A: 20% of year 2 allocation depends on previous year’s village performance
Version B: Village performance not linked to fund allocation. Otherwise identical to Version A.
Implemented through KDP/PNPM-Rural with:
Same management structures at the national, provincial, and district levels as PNPM-Rural
Facilitated by 2 subdistrict facilitators
12 indicators: communities are required to work on the same indicators as HH-CCT (Program Keluarga Harapan)
- Baseline/Wave I (2007): PNPM-Generasi & PKH (HH CCT)
Sample size per survey for PNPM-Generasi:
33,000 total respondents
- 12,000 households
Substantial improvements in health indicators
No impact on education indicators
Performance-based incentives lead to consistently better outcomes
Substantial regional heterogeneity with strongest improvements in Sulawesi
Provider effort, especially for midwives in incentivized locations, increased substantially.
Greater community engagement particularly through service provision at the village health posts.
Each bar represents the percentage
change in the indicator in Generasi
treatment areas compared to control
Key messages of the figure
Bars in solid
Zero percent is the control group average. Bars to the
right indicate increase while bars to the left indicate reduction.
Control avg. (although some small differences noted at baseline)
Negative impact on education largely seen in Sulawesi outcomes overall and in NTT
Improved health service coverage mainly through increased village health post (posyandu) participation
Reduced infant mortality, acute morbidity and malnutrition
Increased number of hours midwives spend on outreach and services in their public capacity
PNPM-Generasi has not yet improved formal education indicators
Community incentives ensures better outcomes with the same project funds and design
Certain heterogeneity in outcomes were observed:
Regional: Sulawesi strongest, positive in Java, small in NTT
Increased community participation and engagement, especially through service provision at village health posts.
Where/for whom PNPM-Generasi works best
Details of community incentives
Changes in prices
What communities spent their funds on
PNPM-Generasi will likely expand in 2010 to an additional 1-2 provinces.
Adjustment of some of the education indicators
Conduct wave III survey in 660 kecamatan jointly with HH CCT (Nov 2009– Jan 2010)
Finalize operations paper on lessons learned thus far