Rome, 6-7 June 2011

1. ESSnet “Preparation of standardisation” Analysis of methodological handbook: “Survey Methods and Practices” ISTAT Rome, 6-7 June 2011 Essnet STAND-PREP Rome, 6-7 June 2011

2. Analysis of methodological handbook “Survey Method and Practices” Essnet STAND-PREP Rome, 6-7 June 2011

3. Analysis of methodological handbook “Survey Method and Practices” Essnet STAND-PREP Rome, 6-7 June 2011

4. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 4. Data Collection Methods Summary Essnet STAND-PREP Rome, 6-7 June 2011

5. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter4. Data Collection Methods Provision Group 1 Essnet STAND-PREP Rome, 6-7 June 2011

6. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 4. Data Collection Methods – Pag.37 Data collection is the process of gathering the required information for each selected unit in the survey. During data collection, members of the population – be they individuals or organisations – are located and contacted and their participation in the survey is sought. A questionnaire is then administered and answers recorded. This process is expensive, time consuming, requires extensive resources and has a direct impact on data quality. Since it is the general public’s main contact with the statistical agency, it contributes to the image of the statistical agency and has a broad impact on the agency’s relevance and on the quality of its data. During the planning phase of a survey, many decisions must be made regarding the method of data collection. Should the questionnaire be administered by an interviewer? If yes, should the interview be conducted in person or over the telephone? Should a combination of methods be used – should respondents fill out the questionnaire themselves and nonrespondents be followed-up with a telephone interview? Should the questionnaire be paper or computer-based? Should administrative data be used to collect some of the survey data? Should data collection for several surveys be combined? The method of data collection should be chosen to achieve a high participation rate and collect data that are as complete and accurate as possible while minimising the burden to the respondent and satisfying the client’s budget and operational constraints. The method of data collection should be chosen to achieve a high participation rate and collect data that are as complete and accurate as possible while minimising the burden to the respondent and satisfying the client’s budget and operational constraints. The purpose of this chapter is to present the various methods of data collection – including selfenumeration, interviewer-assisted, computer-assisted, administrative data and others – and the criteria for deciding which method is most appropriate. Data collection operations in general (with an emphasis on interviewer-assisted methods), including how to locate the sampling units, elicit co-operation and capture responses are covered in Chapter 9 - Data Collection Operations. 4.1 Basic Data Collection Methods The basic methods of data collection are: i. Self-Enumeration- With self-enumeration, the respondent completes the questionnaire without the assistance of an interviewer. There are a variety of ways that the questionnaire can be delivered to and returned by the respondent: by post or facsimile, electronically (including the Internet) or by an enumerator. (If the questionnaire is returned by facsimile or electronically, then a secure line or encryption is needed to ensure the confidentiality of respondent data). When paper-based, this method is called Paper and Pencil Interviewing (PAPI), when computer-based it is called Computer-Assisted Self Interviewing (CASI). ii. Interviewer-assisted (Personal Interviews or Telephone Interviews) Essnet STAND-PREP Rome, 6-7 June 2011

7. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 4. Data Collection Methods Essnet STAND-PREP Rome, 6-7 June 2011

8. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 4. Data Collection Methods Essnet STAND-PREP Rome, 6-7 June 2011

9. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 4. Data Collection Methods Essnet STAND-PREP Rome, 6-7 June 2011

11. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 4. Data Collection Methods • In general: • ISTAT identified a small number of provisions each of them associated to methodologies • ONS identified more provisions, often corresponding to the methodologies defined by ISTAT. Essnet STAND-PREP Rome, 6-7 June 2011

12. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 5. Questionnaire design Summary Essnet STAND-PREP Rome, 6-7 June 2011

13. Analysis of methodological handbook “Survey Method and Practices” Comparative analysis of Chapter 5.Questionnaire design • In general: • Istat defined the procedure of designing questionnarie as a series of steps (groups of provisions) with a lot of associated provisions of different types (statements, instructions and recommendations) and only one methodology relating to questionnaire testing • ONS defined a single group of provisions with many associated provisions specified by the related methodologies Essnet STAND-PREP Rome, 6-7 June 2011

14. Analysis of methodological handbook “Survey Method and Practices” Example of analysis of Chapter 6. Sampling Designs Essnet STAND-PREP Rome, 6-7 June 2011