nlscy non response
Download
Skip this Video
Download Presentation
NLSCY – Non-response

Loading in 2 Seconds...

play fullscreen
1 / 20

NLSCY Non-response - PowerPoint PPT Presentation


  • 148 Views
  • Uploaded on

NLSCY – Non-response. NLSCY - National Longitudinal Survey of Children and Youth. Non-response. There are various reasons why there is non-response to a survey Some related to the survey process Timing Poor frame information Interviewer or field errors Some related to circumstances

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'NLSCY Non-response' - will


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
nlscy non response
NLSCY – Non-response

NLSCY - National Longitudinal Survey of Children and Youth

non response
Non-response
  • There are various reasons why there is non-response to a survey
    • Some related to the survey process
      • Timing
      • Poor frame information
      • Interviewer or field errors
    • Some related to circumstances
      • Weather
      • Language issues
      • Difficulty in tracing individuals
    • Others related to respondents
      • Unwillingness to participate
      • Unable to participate
variety of non reponse
Variety of non-reponse
  • Partial non-response (item)
    • Some individual questions were not answered
    • Some individual questions were not asked
  • Partial non-response (component)
    • The NLSCY is sectioned into different groups of questions related to various topics; an entire section may be missing.
variety of non reponse4
Variety of non-reponse
  • Total non-response
    • No information is collected or
    • Insufficient information is collected
  • Wave non-response
    • Where information about a respondent is available but not for every cycle of the survey due to total non-response in a given cycle
    • Follow-up strategy differs upon the cycle of introduction in the survey
dealing with total non response
Dealing with TOTAL non-response
  • Total non-response is measured and corrected in the NLSCY at Statistics Canada
    • Significant variables which affect total non-response are identified
    • All the weights are adjusted to correct for the total non-response
  • However, wave non-response is still present for longitudinal analysis
dealing with partial non response
Dealing with PARTIAL non-response
  • Missing data for variables related to income are imputed at Statistics Canada
  • Missing data for the other variables are identified as:
    • Refusal
    • Don’t know
    • Not stated
  • Note: These are different from:
    • Not Applicable.
dealing with partial non response issues
Dealing with partial non-response Issues
  • Either analyzing the entire dataset
    • Where a significant amount of information is missing about a variable of interest
    • Or where many variables of interest have missing data and only a minority of records have all the pieces of information
  • Limiting your analysis to a subset of the population where you have reported values
    • How do you make inferences to the larger population (question of what the weighted estimates refer to)
the partition family

The Partition Family

Missing an entire component

Missing partial information

Missing a cycle or wave of data

Dealing with non-response in partitioned datasets

how important is it
How important is it ?

Not !

  • Maybe non-response is random.
  • Maybe it\'s negligible
  • Maybe it can be explained away
  • Maybe I can get away with it

Hopefully

what are your options
What are your options
  • Report missing data as a value
  • Ignore missing data (limit your analysis to reported data only)
  • Correct for the missing data
    • By re-weighting
    • With imputation
    • model non-response information
get to know your non respondents
Get to know your non-respondents
  • When you have significant non-response
    • You need to assess non-response
    • It becomes your first variable of interest
      • It’s an analysis like any other analysis you will do
      • Otherwise it casts doubt over every finding

2X

Analysis

example of ignoring non respondents in your analysis

Example of ignoring non respondents in your analysis

Based on the whole population…

We know that the missing information relates to this sub population…

Based on those who reported, we find that ….

Inferences are now about a sub-population only.

Relies on a good description of non-respondents | respondents

example of imputing for non respondents in your analysis

Example of imputing for non respondents in your analysis

Based on the whole population…

We know that the missing information relates to this sub population…

We compensated for this non-response by doing the following, and based on this process, we find that ….

Inferences are now about the population.

Relies on a good description of your imputation methodology

reweighting to compensate for non response
Reweighting to compensate for non-response
  • Same principle as imputation
    • Works when doing a whole components of missing values
    • Very messy in the Swiss-cheese type of non-response
  • Composite methodology of imputation to adjust for local areas of non-response and re-weighting for broad areas where many variables (entire component) are missing.
impact of non response on variance
Impact of non-response on variance
  • Total non-response:
    • Variance will increase
impact of non response on variance19
Impact of non-response on variance
  • Partial non-response:
  • When imputing for non-response:
    • Treating imputed values for reported values may lead to an underestimation of the real variance (mean imputation is probably the worst case).
  • When re-weighting:
    • How to use the Bootstrap weights?
conclusion
Conclusion
  • Make sure you always assess the impact of non-response when doing analysis
ad