1 / 17

Gender and Impact Evaluation

Gender and Impact Evaluation. Urmy Shukla Capacity Building Manager CLEAR South Asia / J-PAL South Asia at IFMR. Overview. What is impact e valuation? What is a randomized evaluation? How can we use impact evaluation as a tool for gender policy and advocacy?

wynter-michael
Download Presentation

Gender and Impact Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Gender and Impact Evaluation Urmy Shukla Capacity Building Manager CLEAR South Asia / J-PAL South Asia at IFMR

  2. Overview • What is impact evaluation? What is a randomized evaluation? • How can we use impact evaluation as a tool for gender policy and advocacy? • How can gender be successfully integrated into impact evaluation? • Examples from J-PAL

  3. J-PAL’s Approach

  4. J-PAL is a Centre at MIT’s Department of Economics, with Regional Offices Worldwide

  5. How to Measure Impact? • Impact is defined as a comparison between: • The outcome some time after the program has been introduced • The outcome at that same point in time had the program not been introduced • This is know as the “Counterfactual”

  6. Impact: What is it? Intervention Primary Outcome Time

  7. Impact: What is it? Counterfactual Impact Intervention Primary Outcome Time

  8. Impact: What is it? Intervention Primary Outcome Impact Counterfactual Time

  9. Randomised Evaluations Individuals, villages, or districts are randomly selected to receive the treatment, while other villages serve as a comparison • Groups are Statistically Identical before the Program = Comparison Group Treatment Group Village 1 Village 2 • Any Difference at the Endline can be Attributed to the Program Two groups continue to be identical, except for treatment. Later, compare outcomes (health, test scores) between the two groups. Any differences between the groups can be attributed to the program.

  10. How can we use impact evaluation as a tool for gender policy and advocacy? • Surprisingly little hard evidence on what works, coupled with popular notions on how to combat gender issues: • Example: Toilets and gender-based violence • The growing role of impact evaluation in government and international development • Positive evidence encourages funding, advocacy, and programme expansion

  11. How can gender be successfully integrated into impact evaluation? • Interventions targeting women and girls with easily quantifiable outcomes (education levels, employment, fertility rates, etc.) • Gender-based or gender-defined outcomes • More difficult, but possible

  12. Examples of J-PAL Research: Targeted Interventions Effect of a merit-based girls' scholarship program on attendance and academic achievement in Kenya • Objective: Increase girls’ enrolment and reduce drop-out in middle school • Program: Girls’ Scholarship Program carried out in randomly selected schools. High ranking girls receive scholarship for school fees, grant to the family for school supplies, public recognition • Findings: Improvements in performance, attendance and parental involvement. Positive externalities also for girls with low chance of winning the award. High ranking girls won the scholarship, but effects were also seen in non-winners. • Program by International Child Support Africa.

  13. Examples of J-PAL Research: Targeted Interventions Menstruation and Education in Nepal • Objective: Increase girls’ enrolment and reduce drop-out in 7th and 8th standard. • Program: Girls’ randomly selected to receive menstrual products and instructions. • Findings: No impact on school attendance, no impact on test scores. Positive impact on time-saved (20 minutes/day). • Project Partner: Institute for Social and Environmental Research (ISER-Nepal)

  14. Example of J-PAL Research: Gender-based outcomes Empowerment of Adolescent Girls in Rural Bangladesh • Objective: Empowerment and holistic development of adolescent girls, increased age of marriage, changes in attitudes and aspirations • Program: • Literacy and numeracy training • Financial skills: entrepreneurship, budgeting, etc. • Food incentive to delay marriage • Outcomes of interest: education, health, nutrition, income generation, savings/investment, decision-making, attitudes, awareness, marital and reproductive outcomes.

  15. Empowerment of Adolescent Girls in Rural Bangladesh Evaluation Approach – How to measure empowerment? 1) In-depth situation analysis by Save the Children • A review of government policies • Qualitative assessment of adolescent girls: What is required for ‘empowerment’ • Participation in community & household decision-making • Mobility • Education • Skills for earning an income

  16. Empowerment of Adolescent Girls in Rural Bangladesh Evaluation Approach – How to measure empowerment? 2) Development of survey instruments by J-PAL affiliate and researchers • Comprehensive questions on decision making: • Ability to travel to local event • Medical decisions • Mental health indices • Aspirations • Etc.

  17. Gender and Impact Evaluation: Conclusions • Impact Evaluation can be a powerful tool for planning and advocacy • Impact Evaluation does not negate the need for more in-depth gender analyses • It is important to foster cross-disciplinary and interdisciplinary collaborations

More Related