Editing Challenges for New Data Collection Methods

1. Editing Challenges for New Data Collection Methods Claire Dobbins, Rachel Skentelbery Office for National Statistics, UK

2. Overview • ONS data collection vision • Data Editing Issues • Literature Review • Experimental Design

3. ONS Data Collection Vision • Current modes • Paper based surveys • Telephone Data Entry (TDE) • Secure Electronic File Transfer (SEFT) • CATI, CAPI • Current Editing Methods • Traditional edit rules • Selective editing • Automatic editing • Formatting edits

4. ONS Data Collection Vision • Electronic Data Collection Programme • Future Collection Modes • Development of secure electronic file transfer • eQuestionnaires • Administrative Data • Direct Data Feeds

5. Data Editing Issues • Administrative Data: • Large Datasets -> automatic corrections • Unable to call back respondents • Direct Data Feeds • Large Datasets • Should be able to recontact respondents • Data relatively precise?

6. Data Editing Issues • Online eQuestionnaire: • Fatal and/or query edits? • How many edits are too many? • Edits resolved before submission possible? • How should edits be presented for maximum effect?

7. Electronic Data Collection – literature review • Types of edits vary – need to test • Number of edits not important, likelihood of failure is • ‘Mission critical variables’ important • Presentation important – immediately after question better • Wording important – clear, precise and provide direction

8. Experimental Design • Edit set up 1: • Error messages alongside variable in red text • Groups of questions for edits appear on same page • Opportunity to add comments when no changes • Any unresolved presented again before submission • All query and fatal edits included • Edit set up 2: As 1, 2, 3 and 4 above but with only fatal edits flagged to respondents

9. Future Research • Initial test in March 2013 • Improved design for retest • Work on cleaning administrative data will continue • Standards and Guidance produced

10. Thank you Questions?