Download
1 / 10
100 likes | 215 Views
Implementation Challenges. Accra, 10-14 May. Introduction. We will go through real challenges encountered in Gambia , Niger, Senegal; We will present situations experienced and try to classify them into attrition, partial compliance, selection bias, etc;
E N D
Implementation Challenges Accra, 10-14 May
Introduction • We will go through real challenges encountered in Gambia, Niger, Senegal; • We will present situations experienced and try to classify them into attrition, partial compliance, selection bias, etc; • Then we will propose possible solutions.
Gambia • Schools in the treatment group did not receive funding for certain reasons; • Teachers of schools in the treatment group were reassigned to some schools in the control group and vice versa.
Niger • Some schools in the control group received books; • Difficulties of access due to heavy rains and schools closed earlier than expected. The characteristics of the two groups are identical in spite of problems.
Senegal • Schools still closed when running the survey (1 month after academic year start). Security and geographic impediments prevent from reaching schools. Targeted grades not present in a few schools; • 2 schools out 211 moved from control group to the treatment one, receiving treatment (textbooks from a donor); • No school (among 11 recipients) in the treatment group of a region had received funding.
Other threats to internal validity (1) • Take pre-cautions prior to occurrence of threats; • Other threats of internal validity: • the quality of data collected; • delays in giving treatment to beneficiaries; • time lag between conducting baseline and follow-up; • rigid outcomes that do not change as a result of the intervention; • treatment given before baseline; • etc.
Other threats to internal validity (2) • Even if evaluation is well designed, monitoring well done, we may end up with misguided conclusions with wrong data, thus misleading decision makers; • Always recall : Garbage In Garbage Out.
Other threats to internal validity (3) • Serious problems in the case of Senegal: almost 3 checks out of 5 were wrong; • Need to start over the data entry which took 10 weeks.
Conclusion (1) • Given the costs of the evaluation, should avoid any second best solutions; the best remedy is prevention; • Monitor the roll-out carefully – demand high standards of compliance with the original design (small details make a difference) ; • Make adjustments immediately as needed.
