Loading in 5 sec....

Multiple Imputation : Handling InteractionsPowerPoint Presentation

Multiple Imputation : Handling Interactions

- 336 Views
- Updated On :

Download Presentation
## PowerPoint Slideshow about '' - hollie

**An Image/Link below is provided (as is) to download presentation**

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

### Multiple Imputation : Handling Interactions

Michael Spratt

Introduction

- Missing data is considerable problem
- Complete case analysis will generally lead to systematic bias
- Have to make some assumption
- Most commonly used is Missing at Random (MAR)
- MNAR uses different assumptions

- In this talk we are discussing analysis when MAR assumption is made

Introduction : MAR

- In MAR, the probability of being missing does not depend on the missing data itself, given the observed data and the model parameters
- Unlike MNAR analysis, we do not have to explicitly the model missingness mechanism

Introduction : MAR and multiple imputation

- Most common approach : perform imputation of missing data and save multiple imputed datasets
- Each imputed dataset differs (slightly) due to stochastic nature of imputation

- Then carry out substantive analysis on each of the imputed datasets
- Then combine the individual results (using Rubin’s Rules) to obtain combined imputation estimates and standard errors

MICE/ICE for imputation assuming MAR

- MICE : Multiple Imputation using Chained Equations has been widely used for imputation
- Sometimes called FCS (fully conditional specification)
- For general missingness patterns (does not not have to assume monotone missingness)

- Implemented in
- MICE package in R (van Buuren et. al.)
- ICE command in Stata (Royston)
- IVEWARE (Raghunathan et. al.)
- Potentially task-specific versions be written in other programs e.g. WinBUGS

- Ref : Multiple imputation of missing blood pressure covariates in survival analysis. Van Buuren, Boshuizen, Knook. Statistics in Medicine1999; 18(6): 681–94.

MICE/ICE for imputation assuming MAR

- X1, X2, X3 …Xn partially observed
- Zobs represents set of fully observed variables
Chained equations are :

- X1 ~ f(X2, X3 , X4 … Xn, Zobs)
- X2 ~ f(X1, X3 , X4 … Xn, Zobs)
- X3 ~ f(X1, X2 , X4 … Xn, Zobs)
etc.

- Comparable to Gibbs Sampler
- Much shorter chains which on termination produce an imputed dataset

Interactions in the Analysis Model The imputation model should be at least as rich as the substantive model

- A useful practical guide to using imputation to perform analysis in the presence of missing data are
- Multiple imputation: current perspectives (Kenward and Carpenter Statistical Methods in Medical Rearch16: 199–218)
- Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls (Sterne, White, Carpenter et. al. BMJ 2009;338:b2393) also contains useful guidance

- The imputation model should preserve the structure of the data

MICE/ICE for imputation

- For most datasets where distributional assumptions are met, MICE/ICE has been shown in practice to work well for MAR data
- More care is needed when models contain structures such as interactions, multi-level, non-linearity etc. In particular the structure of the substantive model should be reflected in the imputation model
- This talk focuses on interactions

Why omitting interactions in the imputation may cause problems We initially have a full [X,Y,Z] dataset, but it then becomes subject to missingness (MAR mechanisms) We would like the parameter estimates after MAR followed by imputation occurs to be the same as the full data estimates

- Take as an example 3 binary variables X, Y, Z
- We are interested in a substantive analysis in the presence of missing data of the logistic regression of Y on X and Z with an interaction
- logit(P(Y=1| X, Z)) = b0+ bxx + bzz + bxzx.z

Why omitting interactions in the imputation may cause problems

- The coefficients are the same as the coefficients of the corresponding log-linear model
- logistic :
- logit(Y) = b0+ bxx + bzz + bxzx.z

- log-linear
- log(mxyz) = m0+ mxx + myy + mzz +
mxyx.y + mxzx.z + myzy.z + mxyzx.y.z

- log(mxyz) = m0+ mxx + myy + mzz +
- Examining the bias of bx is equivalent to examining the bias of mxy; same for bz and myz; and for bxz and mxyz

- logistic :

Why omitting interactions in the imputation may cause problems

- Omitting interactions terms in the full conditional models will lead to interactions in the log-linear model being underestimated and hence P(X, Y, Z) being incorrectly estimated
- This can also be seen by looking at the number of parameter estimates needed
- If just X is subject to missingness, we need to be able to estimate P(X | Y,Z) P(Y, Z)
- 4 parameter estimates needed for P(X | Y, Z)
- This cannot be done with chained equation without interaction X = a+ by Y + bz z as there are only 3 free parameters

- If X and Y are subject to missingess, we need to be able to estimate P(X, Y | Z) P(Z)
- 8 parameter estimates in general needed for P(X, Y | Z)
- This cannot be done with chained equations without interaction x = ax+ bxy y + bxz z and y = ay + byx x + byz z as there are only 6 free parameters

- If just X is subject to missingness, we need to be able to estimate P(X | Y,Z) P(Y, Z)

Passive Imputation problems

- Imputation interactions are needed. Both the Stata program ICE (and also the R MICE package) support passive imputation
- The interaction term is recalculated from the main effects after every mice cycle and can then be made use of in the subsequent chained equations in the cycle for the imputation of other variable(s)
- Other possible approaches :
- Von Hippel “How to impute interactions, squares and other transformed variables”, Sociological Methodology 39:265-291 2009 is a less established alternative to passive imputation
- It is also worth noting that where a categorical variable is fully observed an alternative method of imputation is to split it by values of the fully observed variable and separately impute subsets of data

- Other possible approaches :

Simulation Structure problems

- We created a [X,Z] dataset
- We created Y stochastically given X and Z
- We stochastically created missingness (MAR) in 1, 2 or 3 variables
- Using a number of imputation models we did the imputation and performed the substantive analysis
Steps 2-4 were repeated 100 times and parameter estimates and standard errors were recorded

We tabulated the median of the parameter estimates, the median of the confidence intervals and the coverage of the original data generation parameter within the parameter estimate’s confidence intervals

Simulations problems

- We examined the effect of interactions on analysis of imputed data in a series of simulation scenarios involving 3 variables;
- Regression with outcome Y and covariates X and Z

- The simulation scenarios ranged through all 3 variables being binary; 2 variables binary and one variable normal; one variable binary and 2 normal variables; to 3 normal variables
- In each case varying combinations of outcomes and covariates complete/incomplete

- We present a subset of the simulation scenarios

All variables binary; X and Z incomplete problems

- Dataset : 20,000 observations, Y generated stochastically
logit(Y) = 0.5 × X + 0.5 × Z + 0.6 × X × Z

- Data divided into 2 sections with Bernoulli distribution (p = 0.5) [splitting allows missingness to be MAR]
- Two stratified MAR patterns :
- logit(Z is missing) = -2 + X + Y (In one section of data)
- logit(X is missing) = -2 + 1.3 × Z + 0.8 × Y (Other section of data)

- Imputation then substantive analysis performed
- In a second simulation scenario there were 3 stratified MAR patterns :
- P(Z missing | X, Y) (In section 1 of data)
- P(X missing | Y, Z) (In section 2 of data)
- P(X and Z jointly missing | Y) (In section 3 of data)

All variables binary; X, Z and Y incomplete problems

- Data generated stochastically
logit(Y) = 0.5 × X + 0.5 × Z + 0.6 × X × Z

- Data divided randomly into 3 sections with equal probability
- 3 stochastic stratified MAR patterns :
- logit(Z is missing) = -2 + X + Y (In section 1 of data)
- logit(X is missing) = -2 + 1.3 × Z + 0.8 × Y (In section 2 of data)
- logit(Y is missing) = -1.5 + 1.9 × Z + 0.6 × X (In section 3 of data) data)

- In a second simulation scenario there were 6 stratified MAR patterns :
- P(Z missing | X, Y) (In section 1 of data)
- P(X missing | Y, Z) (In section 2 of data)
- P(Y missing | X, Z) (In section 3 of data)
- P(X and Y jointly missing | Z) (In section 4 of data)
- P(X and Z jointly missing | Y) (In section 5 of data)
- P(Y and Z jointly missing | X) (In section 6 of data)

Y continuous, X and Z binary; X, Z and Y incomplete problems

- Data generated stochastically, this time Y is continuous
Y ~ 0.45 × X + 0.55 × Z + 0.6 × X × Z + N(0, 1)

- Data divided randomly into 3 sections with equal probability
- 3 stochastic stratified MAR patterns :
logit(Z is missing) = -2.5 + 1.5 × X + Y (In section 1 of data)

logit(X is missing) = -3 + 2.5 × Z + 0.8 × Y (In section 2 of data)

logit(Y is missing) = -4 + 2.5 × Z + 2.0 × X (In section 3 of data)

Further simulations problems

- In further simulations similar results were obtained, where the distributional assumptions of the imputations models were adhered to
- In each case omitting an interaction in a chained equation produced biased results. All 2-way interactions had to be included
- Starting with a tri-variate normal distribution and introducing a slight interaction (slight non-normality results) also gave imputed estimates closest to the full data estimates when the full interactions were introduced into the imputation model

Conclusions problems

- In general the imputation models should reflect the structure of the substantive analysis, and should be at least as rich as the analysis model
- In order to reflect the structure of the substantive model, the imputation model should not exclude its interactions, and should also include any corresponding interactions involving the outcome variable

Acknowledgements problems

- This work was done in collaboration with Jonathan Sterne, Kate Tilling and James Carpenter
- Helpful comments and suggestions from Paul Clarke are gratefully acknowledged

Download Presentation

Connecting to Server..