1 / 11

Good, Bad and Ugly: Examples from recent DQAs

Good, Bad and Ugly: Examples from recent DQAs. DQA Problem areas 1:. Reliance on faulty data from secondary source Incomplete reporting Data collection monitoring is out of IP control Data from Pilot program not systematically collected. DQA Problem areas 2:. The BAD. Timing

akasma
Download Presentation

Good, Bad and Ugly: Examples from recent DQAs

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Good, Bad and Ugly: Examples from recent DQAs

  2. DQA Problem areas 1: Reliance on faulty data from secondary source • Incomplete reporting • Data collection monitoring is out of IP control • Data from Pilot program not systematically collected

  3. DQA Problem areas 2: The BAD • Timing • IP is operating on the calendar year, while USAID requires FY data; • Program partner or sub-contractor is late submitting data to reporting IP, making end-of-year totals inaccurate. (eg: WHO data from NTBLCP)

  4. DQA Problem areas 3: Percentage Problems Errors occur when numerators and denominators are not properly defined. Example: Percentage of parents of adolescent girls (13-17) who are married • Numerator: Number of parents of adolescent girls (13-17) who are married • Incorrect Denominator: Total number of parents • Correct denominator: Total number of parents of adolescents girls (13-17) surveyed Important Note: If more than one IP contribute to a percentage type indicator, supply both numerator and denominator to enable average percentage calculation

  5. DQA Problem areas 4: Defining indicators outside of Donor specified range: Example 1: • Donor definition: Proportion of children aged 12-59 months who received a vitamin A supplement in the last 6 months of the total number of children aged 12-59 months surveyed • Partner’s definition: Percent of Children 6-59 months who received Vitamin A Supplement in past 6 months

  6. DQA Problem areas 5: Defining indicators outside of Donor specified range: Example 2: • Donor: the number of pregnant women who received at least 4 ante-natal care visits per pregnancy during a specified period over the total number of live births in the same period • Partner’s definition: Number of times ANC was given during the last pregnancy in the last five years over the number of women who had had a live birth in the last 5 years

  7. DQA Problem areas 6: Translation Translated questions should… • Mean the same thing • Measure the same thing • Meet reliability and validity requirements Example: Hausa Kina da tsapta? (are you clean?) English Are you sterilized? (tubal ligation)

  8. DQA Problem areas 7: Unclear Indicator definitions can produce incompatible data especially when multiple IPs are reporting on the same indicator Example: Number of people reached by ART

  9. Examples of Good data: 1 Buildings Rehabilitated: Classrooms, toilets, roofing, boreholes, teacher/pupils furniture, electrification, temporary shelter and libraries constructed/renovated. Proof: Certificates of Completion of Construction Worksand before and after photographs

  10. Examples of Good data: 2 Number of Insecticide Treated Nets (ITNs) sold: Proof: Field visit of IP and program sites revealed proper record keeping of sales data.

  11. Examples of Good data: 3 Condoms and other contraceptives sold Proof: Cross-checking procedures (waybills, shipping documents, bank receipts, product inventories and distribution documents) significantly reduced the chances of transcription error, thus improving data accuracy.

More Related