1 / 42

Sample Issues and Field Work

Sample Issues and Field Work. Session V Lusaka, January 20, 2003 Juan Munoz and Francesca Recanatini www.worldbank.org/wbi/governance. Motivation. The team has defined: The purpose of the assessment The variables to study The empirical tool to use The process to employ

chapa
Download Presentation

Sample Issues and Field Work

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Sample Issues and Field Work Session V Lusaka, January 20, 2003 Juan Munoz and Francesca Recanatini www.worldbank.org/wbi/governance

  2. Motivation The team has defined: • The purpose of the assessment • The variables to study • The empirical tool to use • The process to employ But, who should be targeted?

  3. Basic Definitions • Sampling allows to measure characteristics of a population, when accessing the whole population is not possible because of economic, practical or physical considerations. • Sampling allows to select a subset of a population to study a specific issue in a meaningful way

  4. Basic Definitions • Population: the sum of all the observations within a specified set • Target population: all statistical units of interest for the purposes of analysis • Working population: all statistical units that can be surveyed

  5. Basic Sampling Techniques • The three basic techniques of probability sampling: • Simple Random Sampling • Multi-stage Sampling • Stratified Sampling • Most household and firm surveys use a combination of these three techniques.

  6. Assuring good field work

  7. What happens when fieldwork is poor? • A long and frustrating process of “data cleaning” becomes unavoidableThe data loose their policy-making relevance • Data quality is not guaranteedThe process converges (at best) to databases that are internally consistent • The process entails a myriad of decisions, generally undocumentedUsers mistrust the data

  8. Key factors • Manage the survey as an integrated project • Implement the team concept in the organization of field operations • Integrate computer-based quality controls to field operations • Establish strong supervision procedures • Ensure sufficient training • Work with a reduced staff over an extended period of data collection

  9. Management levels • Core staff • Survey manager • Field operations manager • Data manager • Tactical options for the organization of field teams • Mobile teams with fixed data entry • Mobile teams with integrated data entry • Sometime in the future: the paperless interview

  10. Mobile teams with fixed data entry • Cote d’Ivoire (1984) • Peru (1985) • Ghana • Pakistan • Guinea-Conakry • Mozambique

  11. Data entry operator Supervisor Interviewers Composition of a field team

  12. The team and its tools Antropo- metrist Data entry operator Supervisor Interviewers

  13. Two PSUs visited in a four-week period Bamako Alama Regional Office

  14. First week Alama Bamako Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  15. First week Alama Bamako Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  16. First week Bamako Alama Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  17. First week Bamako Alama Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  18. First week Bamako Alama Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  19. First week Alama Bamako Regional Office Operator remains in Regional Office They complete first half of questionnaires in all selected households Rest of the team travels to Alama

  20. First week Alama Bamako Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  21. First week Alama Bamako Regional Office Operator remains in Regional Office Rest of the team travels to Alama

  22. First week Bamako Alama Regional Office Operator remains in Regional Office Rest of the team travels to Alama and back

  23. First week Alama Bamako Regional Office Supervisor gives Alama questionnaires to DEO Rest of the team travels to Alama and back

  24. Second week Bamako Alama Regional Office Operator enters first week data from Alama Rest of the team travels to Bamako

  25. Second week Bamako Alama Regional Office Operator enters first week data from Alama Rest of the team travels to Bamako

  26. Second week Bamako Alama Regional Office Operator enters first week data from Alama They complete first half of questionnaires in all selected households Rest of the team travels to Bamako

  27. Second week Bamako Alama Regional Office Operator enters first week data from Alama Rest of the team travels to Bamako and back

  28. Second week Bamako Alama Regional Office Supervisor gives Bamako questionnaires to DEO. DEO gives back Alama questionnaires with flagged inconsistencies Rest of the team travels to Bamako and back

  29. Third week Bamako Alama Regional Office Operator enters first week data from Bamako Team completes second half of questionnaires. They correct inconsistencies from first half

  30. Fourth week Alama Bamako Regional Office Operator enters second week data from Alama. Corrects inconsistencies from first round Team completes second half of questionnaires. They correct inconsistencies from first half

  31. Fourth week The result is a clean data set on diskette, ready for analysis immediately after data collection Regional Office

  32. Mobile teams with integrated data entry • Nepal (1992) • Argentina • Paraguay • Bangladesh (2000)

  33. Mobile teams with integrated data entry Bamako Cocody Alama Team works with portable computers and printers Regional Office

  34. Mobile teams with integrated data entry Bamako Cocody Alama Operator travels with the rest of the field team Regional Office

  35. Mobile teams with integrated data entry Bamako Cocody Alama Data entry and validation almost immediate Regional Office

  36. Mobile teams with integrated data entry Bamako Cocody Alama Reduced trips to and from Regional Office to selected PSUs Regional Office

  37. Mobile teams with integrated data entry Bamako Cocody Alama Regional Office

  38. Benefits of integration • Provides reliable and timely databases • Provides immediate feedback on the performance of the field staff, allowing early detection of inadequate behaviors • Ensures that all field staff applies uniform criteria throughout the full period of data collection • Solves inconsistencies through direct verification of households reality, rather that through office guesswork • Is consistent with the total quality culture

  39. Supervision tasks • Verification of questionnaires for completeness • Random re-interviews of households • Observation of interviews

  40. Selecting and training field staff • Why is it important • How long does it take • How is it organized

  41. Example: Day 2 of interviewer training for household survey • Definition of household (and dwelling, family, etc.) • Pictorial of a sample household • Slide with an empty roster (explain case conventions, encoding, skip patterns, etc.)

  42. Example, cont. • Fill the roster for the sample household (need for legible handwriting, recording of ages, use of a calendar of events, etc.) • Role playing (trainer as a respondent, simulating borderline cases) • Role playing (trainees interview each other)

More Related