PERFORMANCE AUDIT FOR TRIGGERING IDA BUY-DOWN Dr.Mizan Siddiqi, Principal Investigator

1. NOW MORE THEN EVER: STOP POLIO FOREVER www.thephss.org PERFORMANCE AUDIT FOR TRIGGERING IDA BUY-DOWN Dr.Mizan Siddiqi, Principal Investigator PUBLIC HEALTH SERVICES AND SOLUTIONS (PHSS)

2. NOW MORE THEN EVER: STOP POLIO FOREVER BACKGROUND • PARTNERSHIP FOR POLIO ERADICATION PROJECT (PPEP) was funded by WB since 2003 through “IDA Buy-down mechanism” • The buy-down will be triggered based on the results of performance audit by an independent auditor • PHSS has been awarded to conduct the audit

3. NOW MORE THEN EVER: STOP POLIO FOREVER STAKEHOLDES MEETING: PURPOSE • Present objective, methodology, timeline and details of the plan • Agree on the plan, objective, methodology and timeline • Define Roles and Responsibilities of partners in the exercise • Provide feedback on the instruments, analysis and outcome of the exercise

4. NOW MORE THEN EVER: STOP POLIO FOREVER APPROACH • Participatory • Consultative • Objective: Evidence Based Both qualitative and qualitative information will be used to analyze performance and conclude findings

5. NOW MORE THAN EVER: STOP POLIO FOREVER OBJECTIVE • To determine if the IDA funds achieved intended results against agreed indicators. • The achievement will be measured by two indicators. These are:

6. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATORS • INDICATOR A: Timely arrival of OPV vaccine at national level (3 weeks before SIA) • INDICATOR B: OPV Immunization coverage of SIA (at least 80 percent in endemic states)

7. NOW MORE THAN EVER: STOP POLIO FOREVER METHODOLGY: INDICATOR A Timely arrival of OPV vaccine at national level (3 weeks before SIA) • Review of documents • Stake-holders’ Interview • Analysis of Vaccine Arrival Report (VAR)

8. LIST OF STAKEHOLDERS

9. NOW MORE THAN EVER: STOP POLIO FOREVER EXPECTED OUTPUT (INDICATOR A): VACCINE ARRIVAL TIME The analysis of Vaccine Arrival Time will be influenced by external and internal factors: The assessment will look into these factors of vaccine procurement to determine if the IDA funds achieved intended results against the Indicator A (Vaccine Arrival Time). External Factors will not be considered as a failure by GON for delay in vaccine arrival.

10. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B OPV Coverage of SIA (at least 80 percent in selected endemic states)

11. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: OBJECTIVE • To determine OPV coverage among 0-59 months old children in four high risk endemic states -Katsina, Zamfara, Kano and Borno (19th ERC)

12. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY • Four individual cluster surveys one for each state will be conducted during the week of October 29, 2010 (October 29-31) after the IPD is completed (Oct 23-28, 2010) • WHO 30-cluster coverage survey methodology will be used to select sample at the household level (WHO Immunization Coverage Cluster Survey- Reference Manual 2005)

13. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY SAMPLE SIZE

14. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY SELECTION OF CLUSTERS • 30 clusters will be selected using stratified cluster sampling method from three strata of wards i.e. VHR, HR and LR wards. • The number of clusters in each stratum (sample size of each stratum) will be allocated proportionally to size of the strata .

15. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY (contd.) SELECTION OF HOUSEHOLD • Households will be selected strictly randomly. • WHO-30 cluster methodology will be used to select starting and subsequent household.

16. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY (CONTD.) SELECTION OF RESPONDENT AND CHILD • One child under five years of age per household will be selected • The vaccination status of the child will be checked from the marking on the little finger of the child’s left • For all eligible children (one per household), the parent/caregiver will be interviewed of the selected child questions.

17. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY (CONTD.) SURVEY INSTRUMENT The questionnaire will be developed based on the recent LQAS and Outside monitoring survey. In addition to OPV status, few additional questions will be asked to find reasons for non-vaccination.

18. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B: METHODOLOGY (CONTD.) FIELD WORK Training • A one day training will be given to interviewers on sample selection and data collection instrument. • An operational manual will be developed to guide training and filed work. Data Collection Six teams (one interviewer and one recorder) will collect data in each state. They will be supervised by State Coordinator and Senatorial District Monitors.

19. NOW MORE THAN EVER: STOP POLIO FOREVER MONITORING PHSS Real Time Monitoring System using web/sms will be deployed Dashboard Sender SMS Sent to Web Data analysis SMS Receiver Modem www.thephss.org Public Health Services and Solutions (PHSS)

20. NOW MORE THAN EVER: STOP POLIO FOREVER FILED WORK (Contd.) Quality Control • The state monitor will conduct supervised interviews in his/her designated clusters with the teams on a daily basis • State coordinator will conduct random spot checks for all teams in the state.

21. NOW MORE THAN EVER: STOP POLIO FOREVER Data Management and Analysis • All data will be entered in a computerized data base and analyzed using Epi-Info software • Various tables and charts will be produced using MS Excel and MSWord • The analysis will be limited to key indicators and expected output

22. NOW MORE THAN EVER: STOP POLIO FOREVER INDICATOR B:Expected Output OPV Coverage in 4 Endemic States (Katsina, Zamfara, Kano and Borno)

23. Report Outline The report will have 4 chapters: • Chapter 1Background, objectives, design and implementation of the audit • Chapter 2Analysis of the findings of Indicator A including comments on results against target • Chapter 3Analysis of the findings of Indicator B received from cluster survey in four states including comments on results against target • Chapter 4Discussions and Conclusion

24. TEAM Principal InvestigatorDr.Mizan Siddiqi Co-Principal InvestigatorGarry Presthus Other Staffs: -M&E Specialist -Immunization Specialist -Biostatistician -Data Management Specialist -State Coordinators,State Monitors, Interviewers.

25. WORKPLAN

26. Assistance from Stakeholders NPHCDA • Leadership, Coordination and Facilitation of the study • Support at the State and LGA level WHO • Review of methodology, sampling frame and data collection instruments • Out side and inside monitoring data of OPV coverage (2007-2010 by SIA) four states • LQAS data of OPV coverage for four selected states (2009-2010 by SIA) • Support for survey at the State and LGA level • ERC Recommendations and SIA schedule (2007-2010) • Assign Technical Staff to support the team Unicef • VAR report (2007-2010) and information surrounding global vaccine market, availability and reasons for delay in arrival due to external factors • Stakeholder Interview • Documents related to vaccine procurement • Assign Technical Staff to support team World Bank • Project Documents • Coordination with stakeholders All partners 1. Stakeholder Interview 2. Review of draft report

27. NOW MORE THAN EVER: STOP POLIO FORVER • Please visit www.thephss.org/ppep • Register • Join the forum and post comments • If we can not meet you because of your busy schedule/travel etc. please fill up the online questionnaire and submit. • All materials related to the exercise are posted for your information and support. • For any question please send an e-mail to: mizansiddiqi@thephss.org or call 07067275270 YOUR COOPERATION IS MUCH APPRECIATED Thank You All