Question ordering effects on the reporting of fertility intentions and close social networks
Download
1 / 29

Understanding Society Conference 25 July 2013 - PowerPoint PPT Presentation


  • 92 Views
  • Uploaded on

Question ordering effects on the reporting of fertility intentions and close social networks. Understanding Society Conference 25 July 2013 Paul Mathews Knowledge , Analysis and Intelligence Directorate, HM Revenue and Customs Institute of Social and Economic Research, University of Essex.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Understanding Society Conference 25 July 2013' - kendra


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Question ordering effects on the reporting of fertility intentions and close social networks

Understanding Society Conference

25 July 2013

Paul MathewsKnowledge, Analysis and Intelligence Directorate, HM Revenue and Customs

Institute of Social and Economic Research, University of Essex


Question ordering context effects
Question ordering - Context intentions and close social networksEffects

  • Change in the answers to a survey questionnaire as a function of the previous items in the questionnaire’ Tourangeau et al, 2003

  • Examples

    • Context Effects

      • Vodka or beer questions influences rating to how ‘Germanic’ is wine drinking? (Schwarz, Munkel and Hippler, 1990)

      • Life Satisfaction preceding Marriage Satisfaction r = 0.32, Marriage satisfaction preceding Life Satisfaction r = 0.67 (Schwarz, Strack and Mai 1991)

  • Frequency of Context Effects

    • General Social Survey (US) batteries of questions rotated. Only 4% of questions effected by placement (Smith, 1988)

    • Needs to be a conceptual link


Question ordering context effects1
Question ordering - Context Effects intentions and close social networks

  • Question priming bias as domain sampling

  • Particularly in multipurpose longitudinal research (Time series - Change over time? Changes in preceding questions?)

  • Plausible risk


Why are fertility intentions important
Why are fertility intentions and close social networksintentions important?


  • “The intentions and close social networkschanging face of London: A baby boom is sending the city’s planners back to the drawing board”

  • The Economist 28th Jan 2012

“By 2015-16 greater London will need around 70,000 more school places”


Measurement problems
Measurement problems… intentions and close social networks

  • Uncertainty / ambivalence

  • Context dependent…

    • Preferences change over time

      • Age, ageing, life course, cohort, period

        • Is there a ‘correct’ age to measure FP?

      • Experience of children

      • Partnership and partner’s preferences

      • Competing preferences

        • economic, cultural, leisure etc…

  • Because fertility preferences are so context dependent, then will the context in the questionnaire matter i.e. preceding questions?


Millennium cohort study wave 1
Millennium Cohort Study – Wave 1 intentions and close social networks

“How long did the labour last?”

“Which, if any, of the following types of pain relief did you have at any time during labour?”

Before asking “Do you plan to have any more children?”


Social networks
Social networks intentions and close social networks

  • Numerous concepts and operationalisations

    • Flows through social networks

    • Social capital

    • Strength of weak ties

    • Relatedness

  • At risk of context effects? E.g. prime a domain such as ‘work’ or ‘family’… does this influence who is ‘in’ your social network


My empirical work
My empirical work intentions and close social networks


Mortality experiments
Mortality experiments intentions and close social networks

Randomised (systematically identical) groups.

  • Treatments: priming questions then fertility questions

  • Controls: fertility questions then priming questions

    Adult (own) mortality priming questions

    • 11 Questions

    • “What age do you expect to be when you die?”

  • Data collected 2006 and 2008-09

  • Published - Mathews and Sear 2008

  • Students internet experiment

  • Results: Significant increase in MALE ideal numbers of children. No effect for females


Why? intentions and close social networks

Not mutually exclusive…

  • Fatigue?

  • Negative mood?

  • Old age support (in adult prime)?

  • First item in battery of fertility preferences? (DHS ideal question)

  • Own mortality is a ‘shock’ to non-decision decision? (Competing preferences, cultural output and sociological modernity)

  • Social Psychological - Terror Management Theory (TMT) social immortality?

  • Evolutionary biology – Life History Theory (perceived risky environment should alter reproductive strategy)?

  • Sheer chance?!

  • Replication


Innovation panel experiment
Innovation Panel experiment intentions and close social networks

  • Waves 4 and 5 of Innovation Panel sub sample of 1,500 households - NOT STUDENTS!

  • Randomisation at household level

  • Controls

  • Wave 4: Experiment after mental wellbeing

    • “I've been able to make up my own mind about things”

    • 5 point scale: [All of the time – None of the time]

  • Wave 5: Experiment after GHQ

    • “Have you recently been feeling reasonably happy, all things considered?”

    • 4point scale 1 More so than usual 4 Much less than usual


Two question ordering treatments
Two question ordering ‘treatments’ intentions and close social networks

  • Fertility Intentions:

    • “Do you think you will have any (more) children?”

      • [1 Yes, 2 Self / partner currently pregnant, 3 No]

    • if the answer is yes “How many (more) children do you think you will have?”

  • Close social network (i.e. 3 closest friends)

    • ‘Please choose the three people you consider to be your closest friends... They should not include people who live with you but they can include relatives’

    • Sex, Age, relatedness, frequency of contact, how far away they live etc

    • ‘Is this friend a relative?’

      • [ 1 Yes, 2 No]


Descriptive statistics
Descriptive statistics intentions and close social networks

  • Observations 696

    • Wave 4 N=409, Wave 5 N=287

      • 223 individuals measured twice (27 changed their minds on wanting children)

    • Background demographics remain very similar across waves - Male 60%, Age mean 37.5 (SD 13.4) median 39 (split dummies in model), Parents 48%, Employed 72% (11% full time students), Married 45%, Lives with a parent 22%, sibling 14%.


Fertility intentions
Fertility intentions intentions and close social networks

27 close social

network

questions

(Nine questions

for three friends)

wave 4 ‘Make mind’ or wave 5 ‘happiness’

Fertility

intentions

questions

(No social network questions)


Social network
Social network intentions and close social networks

1 or 2 fertility

intentions

questions

Close social

network

questions

wave 4 ‘Make mind’ or wave 5 ‘happiness’

(No fertility intentions questions)


Results fertility intentions
Results – Fertility intentions intentions and close social networks


Results fertility intentions1
Results – Fertility intentions intentions and close social networks


Results fertility intentions2
Results – Fertility intentions intentions and close social networks


Results social network
Results – Social network intentions and close social networks


Conclusions
Conclusions intentions and close social networks

  • Fertility intentions at risk of preceding questions

    • Plausible risk...

  • Little evidence relatedness (or any other characteristics) of their close social network at risk of preceding questions

  • Important to construct and read questionnaires as a whole

  • Repeated measures: Replication, replication, replication


Acknowledgements
Acknowledgements intentions and close social networks

Participants in all studies

Maria Iacovou, University of Essex

Rebecca Sear, London School of Hygiene and Tropical Medicine

Ernestina Coast London School of Economics and Political Science

UK Economic and Research Council for funding

UKHLS Methodological Advisory Committee for accepting proposal

ISER and HMRC secondment


Advert hm revenue customs datalab
*Advert* - HM Revenue & Customs intentions and close social networksDatalab

  • Compliance

  • Corporation tax

  • Self assessment

  • Value added tax

  • Stamp duty land tax

  • Trade statistics

  • Tax credits

  • Tobacco

  • Variable names and descriptions are available on our website:

  • www.hmrc.gov.uk/datalab/data.htm


Conclusions1
Conclusions intentions and close social networks

  • Fertility intentions at risk of preceding questions

    • Plausible risk...

  • Little evidence relatedness (or any other characteristics) of their close social network at risk of preceding questions

  • Important to construct and read questionnaires as a whole

  • Repeated measures: Replication, replication, replication


ad