Download
1 / 43
430 likes | 562 Views
Uganda – October 2009. Census Data Collection & Processing John Gomersall. Agenda. Census data collection – Enumeration Processing – Data Capture phase Decisions on the methods for both. Chronologically, enumeration comes before data capture & we will consider them in that order.
E N D
Uganda – October 2009 Census Data Collection & Processing John Gomersall
Agenda • Census data collection – Enumeration • Processing – Data Capture phase Decisions on the methods for both
Chronologically, enumeration comes before data capture & we will consider them in that order. However, decisions on one will inevitably influence the other. Most obvious example of this is the design of the Questionnaire. What is possible & what is practical? - cost, infrastructure, skills
Choose a Method for enumeration 1ST decision made !!
Census Preparations Enumeration Including: Questionnaire Design Data capture Census Results CSPro
Data capture ? Not so good news …… No panacea ! Good news …… technology can help & the choices of technology – are relatively few. (Not to be confused with the potential number of suppliers of these technologies - which may be many !)
Choose a Method for enumeration Second decision ???
Keying or Scanning + Keying ? Considerations: • Timeframe for producing results • Anticipated condition of Questionnaires • Form preparation requirements • Accuracy ?? If Questionnaires are really bad, &/or sufficient low cost keying capacity is available and manageable to meet acceptable timescales……… keying may be the best method !
Choose a Method for Data Capture Decision made !!!
ICR OMR
OMR Quickest, simplest , most accurate data capture method for well completed forms Enumerator only needs to mark with HB Pencil + Eraser Appropriate level of technology for current IT resources Cost competitive solution – known / one time ICR Questionnaire design & Printing Potential for technology transfer Main Pro Characteristics: 5
In both cases, an image of the form will be captured, and the information which has been filled on the questionnaire will be automatically collected. using OMR (Optical Mark Reading) & / or ICR (Intelligent Character Recognition) in either case, this will be followed by: validation, and key correction of “irregularities”
So what is the worry ? The worries are that: having captured the images - there may be problems with extracting the data from those images, and following from this integrity of the data – is the form in the correct EA; is all data for a household together. So what are the considerations – how do we minimise the worry?
Priorities: • Identify an appropriate data capture solution – hardware + software.
Identify an appropriate data capture solution for you. That may be: • Procuring Tools – if you have experienced in-house software development expertise, or • Partnering with an experienced supplier with a customised, tested software product, with effective on-site / remote support. (Kenya – with USBC, Ethiopia, Sudan, Malawi – with DRS, Egypt, Morocco) Basically, • the software needs to work? • this means that in addition to OMR / ICR recognition – does it provide elements for batch control, logic validation, key correction, quality control? • Will the required support & guidance be available? There are partners out there who have the technology!
Priorites • Implement effective processes & logistics • Identify an appropriate data capture solution.
Implement effective processes & logistics: Enumerator Training & Job definition Supervisor Training & Job definition Questionnaire flow Checking & Batching – by EA Preparation for Scanning – Separation Define scanning checks In good time - process a comprehensive Pilot
Priorities • Make it easy for the enumerator to do a good job • Implement effective processes & logistics • Identify an appropriate data capture software product and supplier.
Make it easy for the enumerator to do a good job. Unfortunate realities ! • Scanning cannot make a “bad form” good • Bad forms will make any scanning technology look ineffective The message to remember ! The main concern should be the training of Enumerators and Supervisors to provide Questionnaires in good condition & which have been well completed --- then the scanning will take care of itself !
Data Capture Questionnaire Considerations: Paper – Environment Size Scanning Design Barcode/unique identifier Ease of completion The single most important factor for accurate data capture is to make sure ‘the forms are filled in correctly & are returned in good condition’
Data Capture Considerations – Data types Tick box data Unconstrained handwritten data Constrained handwritten data Barcode & Unique printed number
It is easier to train 30,000 enumerators to mark in pencil • than it is to train them to correctly write, & accurately position characters – in ink! 5
Priorities • Make it easy for the enumerator to do a good job • Implement effective processes & logistics • Identify an appropriate data capture software product and supplier.
Validation & Key Correction I The scanning process will capture what the enumerators have filled in on the Questionnaires – mistakes included! The purpose of running the validation is to identify where the enumerator has not completed the Questionnaire according to the rules set out in the Enumerator’s manual, and to flag those errors for potential key correction. These errors will include those questions that are: expected to have been filled in but are blank partially marked multi marked
& a key correction screen something like this Operator enters “2” as it can be clearly seen that the correct age is 27
Validation & Key Correction II • Following validation and verification/correction, all captured data will be exported to CSPro, or other processing software. The end of the beginning !
Data Capture Summary/Recommendations • Choose the method that best suits your organisation/infrastructure and is the best fit to your requirements • If choosing a new method plan well ahead, consult with others & test with a pilot • Plan for your staffing and logistics • If you wish to use your data spatially you will need to geo-reference your data • Choose a partner with experience and one that will support your process
