Hosting Flu shots

1. Hosting Flu shots

2. Week 2 (October 7): The Art of Formulating and Asking Survey Questions of Mexican Migrants

3. Principal Sources of Error in Survey Results Sampling error The sample of interviewees is not representative of the universe from which it is drawn; it is skewed in various ways. Respondent error Response is not appropriate/relevant to the question, due to misunderstanding (= poorly worded question) Response is deliberately misleading (= lying) Faulty recall (retrospective questions) Social desirability response set: Response is determined by what interviewee believes is socially acceptable behavior or attitude Acquiescence response set: Respondent agrees with whatever statement is presented to him/her, for fear of offending interviewer Interviewer error Question not asked (skipped), question was asked of inappropriate respondent, response categories were read (directing respondent), response was inaccurately recorded, etc. Data processing error “GIGO”: garbage in, garbage out. Errors in transferring data from questionnaire into data base.

4. From research objective to survey question: An example • Objective: Document and explain change in rate of settlement in U.S. (vs. circular migration). • Explanatory hypotheses: Such changes may be a function of:-- Continued tightening of border controls, increasing coyote fees, indebtedness, and physical risk-- Family reunification migration | (fewer relatives to maintain in hometown)-- Maturation of social networks-- Less seasonal work in U.S., more employment in “permanent” year-round jobs-- “Anchoring” investments in U.S. (home ownership, small businesses)-- Life events (marriage, children reaching school age, etc.)-- Changing gender roles in migrant families (greater female labor force participation, etc.)-- Decisions to naturalize • Empirical tests/indicators? • Survey questions?

5. Filter questions: Types of Survey Questions • ¿Es Ud. de Tlacuitapa? (si NO es de Tlacuitapa, agradecerle a la persona y busca otra persona) • ¿Cuántos años tiene Usted? (si tiene menos de 15 años o más de 65 años, pedir hablar con otra persona) The answers to these questions are not marked on the cuestionario.

6. Standardized Question, Closed Response

7. Non-standardized Questions, Closed Response

8. Standardized Question, Open Response(avoid) (Si no usó coyote:) ¿Cómo logró cruzar la frontera, sin usar coyote? (Anotar respuesta completa) ____________________________________________________________________ ____________________________________________________________________ ________________________________________________________________________________________________________________________________________

9. Open Question, Open Response • Ya no es encuesta. • Questions soliciting answers that will involve a lot of complexity, nuance, and detail should be in a semi-structured interview schedule. Qualitative interviews are also generally better for getting at emotion, meaning, and narrative. • E.g.: ¿Qué es los que más/menos le gusta de los EE.UU.?

10. Questions with a numeric response: Different Types of Closed Responses

11. A poorly constructed question: A better question with a simple numerical response: ¿Cuántas veces a la semana fuma Ud.? ________ (n.b. answer may be zero).

12. Questions with a dichotomous yes/no response:

13. Questions with scaled responses:

14. “Thermometer” scaled response (MOSTRAR TARJETA ) Le voy a preguntar su opinión acerca de algunas personas e instituciones. En una escala de 0 a 10, donde cero significa que su opinión es muy mala y el 10 que su opinión es muy buena, ¿cuál es su opinión acerca de….? (LEER) a. Vicente Fox b. Carlos Salinas de Gortari c. El Papa Benedicto Dieciséis d. Barack Obama, presidente de Estados Unidos e. Fidel Castro, presidente de Cuba f. Felipe Calderón g. Santiago Creel h. Andrés Manuel López Obrador

16. Dichotomous vs Scaled Responses: 55. Actualmente,si uno no tiene papeles, ¿es muy peligroso cruzar la frontera? Si 1 No 2 N/A 8888 NS/NQR 9999 Better: 55. Actualmente,¿qué tan peligroso es cruzar la frontera, sin papeles? Muy peligroso 1 Algo peligroso 2 Poco peligroso 3 Nada peligroso 4 N/A 8888 NS/NQR 9999

17. Questions with unscaledcategorical responses:

18. Comparative opinion question (paired alternatives): Algunas personas dicen que los sindicatos en los Estados Unidos protegen los derechos de los trabajadores y ayudan a mejorar su situación en el trabajo. Otras personas dicen que los sindicatos no protegen los intereses de los trabajadores. ¿Usted qué diría? 1 Protegen los trabajadores 2 No protegen los trabajadores 8888 N/A 9999 NS/NQR

19. Questions asking respondent for a rank ordering:

20. Other Issues in Survey Design

21. Questions only applicable to sub-populations:

22. Try to avoid questions that are only applicable to a very small part of the sample, like 132b

23. Define complex concepts precisely ¿Cuántosviajes a hecho a los EstadosUnidos, paratrabajar o vivir? Definición de ‘un viaje’: Un viajeesuna estancia en los EE.UU. quedurapor lo menos 1 mesy cuyomotivo principal estrabajar o vivir. Noincluyevacacionesniturismo. Si el entrevistadoregresa a Tunkáspormenos de 1 mes y luegoregresa a los EE.UU., consideramosqueesel mismoviajea los EE.UU.

24. “Proxy reporting” vs. “Self-reporting” En su último viaje a los EEUU, ¿se quedó más tiempo de lo que tenía planeado? 1 No, se quedó el tiempo planeado 2 No, se quedó menos tiempo 3 Sí, se quedó más tiempo 8888 N/A 9999 NS/NQR 25. ¿Conoce a alguien que se quedó en los EEUU en vez de regresar a Tunkás? Better: • En el último año, ¿alguno de sus familiares se ha quedado en los EEUU por miedo a no poder regresar a EEUU si viene a México? • 1 Sí • 2 No • 8888 N/A • 9999 NS/NQR

25. Always specify the time frame for reporting 21. En los últimos 5 años, ¿dónde ha pasado más tiempo, en Tlacotepec o en los EEUU? San Miguel Tlacotepec 1 Otra localidad en México 2 EEUU 3 N/A 8888 NS/NQR 9999 22. En los últimos 5 años, ¿cuántas veces regresó Ud. a Tlacotepec? Nº de veces: _________ N/A 8888 NS/NQR 9999

26. Avoid questions that don’t elicit sufficiently detailed responses 55. Actualmente,si uno no tiene papeles, ¿es muy peligroso cruzar la frontera? Si 1 No 2 N/A 8888 NS/NQR 9999 Better: 55. Actualmente,¿qué tan peligroso es cruzar la frontera, sin papeles? Muy peligroso 1 Algo peligroso 2 Poco peligroso 3 Nada peligroso 4 N/A 8888 NS/NQR 9999

27. Softening the question/reducing sensitivity Ahora quisiera preguntar sobre su PRIMER viaje a los Estados Unidos o su PRIMER intento de cruzar la frontera. 30. ¿Lo hizo con papeles, o tuvo que entrar sin papeles? Con papeles legales 1   Con papeles prestados 2 Con papeles falsos o chuecos 3 Sin papeles 4   N/A 8888 NS/NQR 9999

28. Organization of questionnaire/sequence of items Sensitivity of items 0 Time elapsed in interview

29. Survey Administration

30. Get your bearings

31. Build rapport with the entire community

32. Key issues/challenges Introducing yourselfHow to explain what you are doing to the potential interviewee. “How will I – or my community – benefit?”(Para que sirve todo esto?) Hints: • Have an honest “sales pitch.” • We are writing the “history” of the town and its migration. • Our UCSD group was here three years ago. • “Confident assertiveness” – Fowler • We’re not from the US or Mexican government. • Information is anonymous. • Participation is voluntary.

33. What are the benefits for Tlacotepec? • Don’t promise anything we can’t deliver. • Community leaders are interested in high-quality data about where migrants go, how much they remit, etc… • Our research findings can be used to educate U.S. public and “funcionarios” who make U.S. immigration policy – parapromover la reformamigratoria. • Passing out free books from previousstudies. Smaller expressions of gratitude. Map and satellite image of town, photos, etc… • Benefits tend to be at the community-level for the town & binational society rather than for specific individuals.

34. Managing social distance issues: You are an “elite” college student: perceived as upper-class, highly educated, culturally different. How to make yourself less threatening? • Hints: • Allow the interviewee to ask you questions about yourself, to reduce social distance and establish trust. • Trade on your student status. You are there to learn. • Emphasize our team’s previous experience in Tlacotepec and San Diego; common social ties. • We are an “equipobinacional.” • Draw on the gender/ ethnic/ national diversity of the team to manage difficult interview situations.

35. How to manage time during the interviewNeed to keep to a schedule, to complete interview in a reasonable amount of time, while maintaining the flexibility needed to build rapport and stimulate informative exchanges of information with interviewee.Hints: -- allow interviewee to tell you (some) of his/her own stories;-- use pauses, allowing enough time for a response (don’t interrupt silence); -- internalize the questionnaire (memorize it!) so you don’t waste time looking for the next relevant question)

36. Read the question the first time EXACTLY as it is written in the cuestionario. This is especially important for attitudinal questions. If the respondent doesn’t understand the question, you may explain it in your own words. Probing: How deep to probe, to get a response that’s more detailed, more complete, more reliable, more relevant to the question?Caution: Danger is that, with extensive probing, interviewee may “invent” an opinion that in reality he doesn’t have, to be courteous or to avoid the shame of not having an opinion.

37. Detecting and correcting errors of inconsistency in responses Hints: • “Active listening” is important. • Pay very close attention to responses. Think about the response content. • Repeat the respondent’s own words to signal your understanding of him, and to set up follow-up question to clarify a contradiction or inconsistency.

38. Reducing respondent error (“reporting error”) • Interviewee doesn’t understand question, gives inappropriate response. • Interviewee gives incomplete answers (not telling the whole truth) • Interviewee gives deliberately misleading answers (untruthful responses) • Interviewee has recall problems (poorly recalled facts, e.g., in response to retrospective questions about migration & employment history) Hint: Prompt respondent with questions about major life events like birth dates of kids, marriage, to help establish a timeline for other events

39. Other sources of respondent error • Social desirability response set: Interviewee tells you what he thinks YOU want him to say, or what is most socially acceptable in his community, in the U.S. • Absurdly high values: For example, 40-year-old man tells you that he has had 10 wives or has been to the U.S. 100+ times, to impress you, or to signal he’s not taking interview seriously. • Non-response: Interviewee refuses to answer certain questions at all (due to fear, shame, desire to conceal income, etc.)Hint: Try to convince respondent of the non-threatening nature of the study. Try to get answers for all questions, but if the respondent refuses, move on to other questions.

40. Still more challenges • How to record responses (note-taking) without interrupting flow of the interview? • How to assure confidentiality? • How to respond to interviewee requests, for money, transportation, introductions, information about “El Norte,” etc.? • What “body language” should you use to build rapport and elicit more useful responses?

41. Rules for Administering the Survey • Only choose one answer unless specified. • If a question does not apply to the entrevistado, circle NA. • Textual annotations won’t be recorded in the database unless there is a specific line asking for them. • Use pencil. Clean up the cuestionario afterwards. Write clearly! • Pay attention to units (months, pay periods, dollars, etc….) • If you have questions, ask early and often!!!