UNSD Census Workshop Day 2 - Session 9 Data Capture: Process Stages

1. UNSD Census Workshop Day 2 - Session 9 Data Capture: Process Stages Andy Tye – International Manager DRS are Worldwide specialists in data capture from paper

2. Data Capture Pre-Census Planning – Pre-Pilot Timeline (Census July 2010)

3. Data Capture Pre-Census Planning – Post-Pilot Timeline (Census July 2010)

4. Data Capture Pre-Census Planning – Forms Design - Sudan

5. Data Capture Pre-Census Planning – Enumerator Training Ethiopia

6. Data Capture Enumeration during the Census

7. Data Capture Census Processing Stages • Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality Process • Logistic issues • Time V Quality

8. Data Capture Census Processing Stages • Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality Process • Logistic issues • Time V Quality

9. Data Capture – Process Stages Forms Receiving • Batch processing • EA Control forms • Opening • Sifting • Cutting • Prepare to scan

10. Data Capture – Process Stages Forms Receiving • Batch processing • EA Control forms (Sudan Example) • Opening • Sifting • Cutting • Prepare to scan

11. Data Capture – Process Stages EA Control forms - Sudan • 2 Parts • Supervisor • Enumerator • Unique Barcode

12. Data Capture – Process Stages EA Control forms - Sudan

13. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process • Recognition Process • Verification Process • Quality Process • Logistic issues • Time V Quality

14. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process • Recognition Process • Verification Process • Quality Process • Logistic issues • Time V Quality

15. Data Capture – Process Stages Scanning Process • Speed • Form condition • Scanner condition • Size & Type of image • Real-time validation rules • Sorting • Doubles separation & detection • Operator training • Paper Crashes • Environment

16. Data Capture – Process Stages Scanning Process • Skew • Form condition • Scanner condition • Operator training • Cut of Form

17. Data Capture – Process Stages Scanning Process • Double Sheets • Sifting • Scanner separator condition • Operator training • Detection via scanners sensors • Ultra Sonic • Capacitive

18. Data Capture – Process Stages Scanning Process • Other • Duty Cycle • Servicing and Cleaning • Batch Control • Audit/Tracking Process • Physical space

19. Data Capture – Process Stages Scanning Process - Ethiopia

20. Data Capture – Process Stages Scanning Process Show Scanner Video

21. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process • Verification Process • Quality Process • Logistic issues • Time V Quality

22. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process • Verification Process • Quality Process • Logistic issues • Time V Quality

23. Data Capture – Process Stages Recognition Process – For Hand Written Characters • Feature recognition • Length • Nodes • Angles

24. Data Capture – Process Stages Recognition Process – For Hand Written Characters • Feature recognition • Length • Nodes • Angles • Neural Networks • Resize • Converted to Pixels • Template set comparatives

25. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process • Quality Process • Logistic issues • Time V Quality

26. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process • Quality Process • Logistic issues • Time V Quality

27. Data Capture – Process Stages Verification Process

28. Data Capture – Process Stages Verification Process

29. Data Capture – Process Stages Verification Process – Sudan & Malawi

30. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Managment Process • Logistic issues • Time V Quality

31. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Management Process • Logistic issues • Time V Quality

32. Data Capture – Process Stages Quality Process • Starts Pre-Census • Audit Trail • Unique Barcodes • System Reports • Defined Roles

33. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Management Process  • Logistic issues • Time V Quality

34. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Management Process  • Logistic issues • Time V Quality

35. Data Capture – Process Stages Logistic Issues • Distribution (EA Packs and Forms) • Space • Man power • Security • Loading and moving equipment • Receiving & Processing • Space • Storage • Processing • Security • Fire and emergency procedures

36. Logistic Issues - Tanzania Data Capture – Process Stages

37. Logistic Issues – 0.5 Million Forms Data Capture – Process Stages

38. Logistic Issues – 0.5 Million Forms Data Capture – Process Stages

39. Logistic Issues – Lifting equipment Data Capture – Process Stages

40. Logistic Issues – 10 Million Forms (6,000 Sqft) Data Capture – Process Stages

41. Logistic Issues – Forms Storage in Sudan Data Capture – Process Stages

42. Logistic Issues – Fire Risk Data Capture – Process Stages

43. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Management Process  • Logistic issues  • Time V Quality

44. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Management Process  • Logistic issues  • Time V Quality

45. Data Capture – Process Stages Time V Quality ‘From experience DRS has identified that the largest issue for Time and Quality is how well the Census forms are filled out by the Enumerators’

46. Data Capture Census Processing Stages • Forms Receiving  • Scanning Process  • Recognition Process  • Verification Process  • Quality/Management Process  • Logistic issues  • Time V Quality 

47. Data Capture – Process Stages Summary • Significant Pre-census Preparation (2 Years) • Forms design – Critical path • Staffing • Data Capture systems • used in a variety of business sectors • Verification of Data – Business rules • Security and Backup plans

48. Worldwide specialists in data capture from paper