measurement error
Download
Skip this Video
Download Presentation
Measurement Error

Loading in 2 Seconds...

play fullscreen
1 / 18

Measurement Error - PowerPoint PPT Presentation


  • 71 Views
  • Uploaded on

Measurement Error. e. M. Measurement Error. Survey record differs from its true value Sampling error: arise from the random sampling variation when n of units measured instead of N units. Measurement error (Systematic error, nonsampling error).

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Measurement Error' - jabari


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
measurement error1

e

M

Measurement Error
  • Survey record differs from its true value
    • Sampling error: arise from the random sampling variation when n of units measured instead of N units.
    • Measurement error

(Systematic error, nonsampling error)

slide3
Not decrease with the overall sample size.
  • Decrease with the repeated measurement.
  • Possible sources of measurement error in survey data
    • Interviewer
    • Coder
simplified model
Simplified Model

Normal Dist’n

effect
Effect
  • In presence of measurement error with mean zero, the estimator of mean and total remain unbiased or consistent.
  • For more complex parameters, the nice feature may not hold.
  • Fuller (1995) points out that the usual estimators for dist’n func., quantiles, regression coef. are biased.
slide6
Assuming non-zero constant measurement error mean, the usual estimators of mean, total, proportion are also biased.
  • Furthermore, assuming correlated errors between individuals with the same interviewer, the usual estimator of standard errors are also biased.
slide7
If estimates of the measurement error variances are available, it is possible to obtain bias-adjusted estimators.
  • Repeated measurement of sub-samples
    • Allocate resources at design stage to make repeated observations on a sub-sample.
    • Hartley and Rao (1978) and Hartley and Biemer (1978) provided interview and coder assignment conditions that permit the estimation of sampling and measurement error.
  • Measurement error variance model.
interviewer effect
Interviewer Effect
  • Earliest examination of measurement error in the survey focuses on evaluating the impact of interviewers on the data.
  • There is correlation among measured values collected by the same interviewer.
  • Hansen, Hurwitz and Bershad model shows
slide9
ANOVA model can be specified to estimate interviewer variability.
  • Model is appropriate for continuous responses.
  • For binary response, the result underestimate the intra-interview variability.
references
References
  • Full, W.A. Estimation in the presence of measurement error.
  • Scott, A. and Davis, P.. Estimating interviewer effects fro survey responses.
  • Hartley, H.O. and Biemer, P.. The estimation of nonsampling variances in current surveys.
  • Hartley, H.O. and Rao, J.N.K. The estimation of nonsampling variance components in sample surveys.
  • Measurement errors in surveys. Paul Biermer, et al.
medical questionnaires
Medical Questionnaires
  • Often use binary variables
  • Interested in proportion parameters
  • Very specialized studies
    • Few reviewers (highly skilled)
    • Very expensive to train
    • Large case loads
  • Interviewer variability is usually ignored because it affects binary data less than continuous data
new zealand quality of health care study
New Zealand Quality of Health Care Study
  • Studying ‘adverse events’ in New Zealand hospitals
  • 2-stage design
    • PPS sample of hospitals
    • Systematic sample of 575 medical records drawn from each hospital for 1998 admissions
  • Average case load per reviewer is 300 (problem!)
  • Typical of such studies
  • Interest in proportion of hospital admissions associated with an adverse event
model
Model
  • Random Effects Model
  • Hospital Effect
  • Interviewer Effect
  • Respondent Effect
  • Assume an underlying continuous variable initially and then extend to the binary case
assumptions
Assumptions
  • : Normally Distributed
  • : Normally Distributed
  • : Logisticly Distributed
  • All these effects are assumed to be uncorrelated with all other effects
design effect
Design Effect
  • Represents the inflation in variance due to the interviewer and cluster effects (i.e. inflation when there are not independent observations)
  • This is assuming small interviewer and PSU effects
results
Results
  • = 0.04
  • = 0.002
  • = 687
  • Design Effect = 29.0
  • So the variability is increased by a multiplicative factor of 29!
conclusions
Conclusions
  • With high case loads, even small interviewer variability can have high impact on estimates of population means and proportions
  • Binary data poses special challenges and more research needs to be done when the PSU and interviewer correlations are not small
ad