180 likes | 411 Views
QUALITY ASSURANCE AND EVALUATION. Part 2: Evaluating the census. QUALITY CONTROL. Census Evaluation Project Team (CEPT) Quality Control measures are part of every team’s output Assembled by CEPT Assessed by CEPT. CENSUS EVALUATION PROJECT TEAM.
E N D
QUALITY ASSURANCE AND EVALUATION Part 2: Evaluating the census
QUALITY CONTROL • Census Evaluation Project Team (CEPT) • Quality Control measures are part of every team’s output • Assembled by CEPT • Assessed by CEPT
CENSUS EVALUATION PROJECT TEAM • Establishes guidelines for quality control measurement and indicators • Evaluates the quality of each census process and procedure • Produces a report on the quality of the census
SURVEYS AND FOCUS GROUPS Where the process involves interaction, the CEPT should organize surveys or focus groups to evaluate the perceived quality of the interaction, e.g.: • User Consultation • Training • Dissemination
EVALUATING TIMELINESS • Original Target Milestones • Milestone Achievement Dates
POST ENUMERATION SURVEY • Provides estimates of coverage error • Provides estimates of content error by question • Provides estimates of processing error by question
POST ENUMERATION SURVEY • Independent • Stratified Random Sample • Able Supervisors and Enumerators • Carefully monitored
POST ENUMERATION SURVEY • Completed PES questionnaires are compared one-on-one with their census counterparts • for differences in individuals enumerated (+ and -) • for differences in response, question by question • for differences in coding of responses • This is done by direct comparison and again after data capture
TO PES OR NOT TO PES Many NSO do not conduct a PES Some start but do not complete a PES What does it say: • about the NSO • about the Census
REACTING TO PES RESULTS • Census modification? • Indicators • Warnings or Suppression
EVALUATING IMPACT OF PROCESS ERRORS Evaluation of Census Procedures - primarily geared to identify how the next census may be improved; - may be re-assessed after PES to see if procedural failures may have had an impact on observed quality lapses
EVALUATING THE IMPACT OF CONTENT ERRORS • Why, if so, some of the content was of limited value • Why, if so, some of the content needs to be suppressed, or severely restricted.
HUMAN RESOURCE DEVELOPMENT • Identify areas where experience and capability were not up to expectations • Develop a strategy to strengthen those skills
REVIEW OF EVALUATIONS • Evaluations are conducted to identify strengths and weaknesses • Need to build on strengths • Strengthen weaknesses
COMMUNICATIONS • Management to Staff • Staff to Management • skip-level interviews