Optical Data Capture: Optical Mark Recognition (OMR)

1. Optical Data Capture: Optical Mark Recognition (OMR) UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

2. Summary Concept/Definition Forms Design Scanners & Software Storage Accuracy OMR Advantages and Disadvantages Commercial Suppliers UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

3. Definition/Concept of OMR • A technology that allows an input device (e.g. imaging scanner) to read hand-drawn marks such as small circles or rectangles on specially designed paper. • Often used for test, survey, or questionnaire answer sheets. UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

4. Definition/Concept of OMR • The process of capturing data by contrasting reflectivity at predetermined positions on a page • Sometimes Referred to as Optical Mark Reader UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

5. OMR Forms • “Reads” mark information in the form of numbers or letters and put it into the computer. • The marks have to be precisely located UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

6. OMR Forms • An OMR works with a specialized document and contains timing tracks along one edge of the form to indicate scanner where to read for marks which look like black boxes on the top or bottom of a form. UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

7. OMR Forms • Timing tracks indicate where to read for marks and indicate where to clip images UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

8. OMR Scanners and Software • Have specifically placed LEDs (Light-emitting diodes) • LEDs sense marks in certain columns once a timing track is detected • Software interprets the output from the scan and translates it to the desired format (e.g. ASCII) UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

9. OMR Scanners and Software • Scanner Characteristics: • ~85 pages per minute (e.g Axiome AXM 980 or Kodak 3000 Series) • ~130 pages per minute(e.g. Kodak i 830) • Software Characteristics: • performing specific imaging functions such as: - image acquisition, - file conversion, - data extraction, and - file read/write commands (e.g. ISIS) UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

10. OMR Storage Characteristics • Storage • Barcodes: Identification of forms • OMR Marks and Barcodes are read and moved directly into a database management system (e.g. SQL) then to a census database • Images are notnormally scanned and stored • However, The capability of saving the scanned image is there! UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

11. OMR Storage Characteristics • Storage of Scanned Images (Recent Mainstream Capability) • Increasingly critical for validating results • Images can be used for correcting poorly filled out forms • Images can be used for validating results • Comprehensive image database of forms UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

12. OMR Accuracy • Accuracy • To achieve high accuracy, well structured design and good quality printing of these forms is critical. • If the timing track and the bubbles on the form are not in the exact columns where the LEDs in the read head can detect them (Skew), there is no way for the scanner to read the marks (Float) • This is referred to as skew and float UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

13. OMR Advantages • OMR is a data collection technology that does not require a recognition engine. Therefore: • It is fast, using minimum processing power to process forms • Costs are predictable and defined • OMR capture speeds range around 4000 forms per hr UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

14. OMR Disadvantages • Disadvantages • OMR cannot recognize hand-printed or machine-printed characters. • With OMR, images of forms are not captured by scanners so electronic retrieval is not possible. • Tick boxes may not be suitable for all types of questions UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

15. OMR Challenges/Issues • The entire process must be tested • Information Capture • Recognizing • Verifying Results • Questionnaire Design and Preparation is Critical • Forms must be readable to the scanner when collected • Field Operators must take particular care in filling out questionnaires • Completeness and consistency checks must be in place • Careful care must be taken for the condition of the Questionnaire (dust, humidity, transportation, etc) UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

16. Major Commercial Suppliers • Pearson NCS - UK Company with US manufacturing base (http://www.ncspearson.com) • Scantron - US Company with US manufacturing base (http://www.scantron.com) • Sekonic - Japanese Company with Japanese manufacturing base (http://www.sekonic.co.jp) • Axiome - Swiss Company with Swiss Manufacturing base (http://www.axiome.ch) UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008

17. THANK YOU! UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, 15-19 September 2008