methodological workshop 3 fixed effects models and multi level models n.
Skip this Video
Loading SlideShow in 5 Seconds..
Methodological Workshop 3: Fixed Effects Models and Multi-Level Models PowerPoint Presentation
Download Presentation
Methodological Workshop 3: Fixed Effects Models and Multi-Level Models

Loading in 2 Seconds...

play fullscreen
1 / 29

Methodological Workshop 3: Fixed Effects Models and Multi-Level Models - PowerPoint PPT Presentation

  • Uploaded on

Methodological Workshop 3: Fixed Effects Models and Multi-Level Models. Yu Xie University of Michigan. What’s Common?. Both the fixed effects model and the multi-level model utilize clustered data.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

Methodological Workshop 3: Fixed Effects Models and Multi-Level Models

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
methodological workshop 3 fixed effects models and multi level models

Methodological Workshop 3:Fixed Effects Models and Multi-Level Models

Yu XieUniversity of Michigan

what s common
What’s Common?
  • Both the fixed effects model and the multi-level model utilize clustered data.
  • Both the fixed effects model and the multi-level model are designed to handle cross-context heterogeneity.
different objectives
Different Objectives
  • Fixed effects model and multi-level model are very different research designs:
    • Fixed effects model controls for (or absorbs) pre-treatment heterogeneity (type I heterogeneity)
    • Multi-level model models both forms of heterogeneity across contexts.
application of different principles
Application of Different Principles
  • The fixed effects model is essentially an application of the social grouping principle (with a group being a cluster)
  • The multi-level model is essentially an application of the social context principle.
using different assumptions
Using Different Assumptions
  • The fixed effects model assumes no type II heterogeneity bias (often constant effects model), or additive effects of heterogeneity across contexts (i.e., clusters).
  • The multi-level model relaxes homogeneity assumption at the individual level but assumes that both forms of heterogeneity are at the context level and can be modeled adequately with contextual covariates.
a general lesson tradeoff between data and assumption
A General Lesson: Tradeoff between Data and Assumption
  • “When observed data are thin, it takes strong assumptions to yield sharp results. There is no free information in statistics. Either you collect it, or you assume it.”

(Xie 1996, AJS).

fixed effects model
Fixed effects model
  • Sibling model as an example
    • Family SES, environment are shared
      • Yi1 =b0 + b1Xi1 + ai + ei1
      • Yi2 =b0 + b1Xi2 + ai + ei2
    • a andXmay be correlated.
    • Take difference between the two eq.
      • Yi2 -Yi1=b1 (Xi2 -Xi1)+ (ei2- ei1)
      • Resulting in a more robust equation
    • Properties of the fixed effects approach:
      • All fixed-characteristics are controlled
      • It consumes a lot of information
      • Unobserved heterogeneity (Type I) is controlled for at the group level (fixed effects)
example critique of zhou and hou 1999 positive benefits of send down
Example: Critique of Zhou and Hou (1999): Positive Benefits of Send-Down?
  • “More interestingly, our findings also reveal some positive consequences of the send-down experience. For instance, when compared with urban youth, a noticeably higher proportion of the send-down youth attained a college education after 1977. Partly as a result of their educational attainment, these sent-down youth, especially those with shorter rural durations, were equally likely to enter favorable employment (type of occupation and work organizations) in the urban labor force, despite their relatively short urban labor force experience.” (Zhou and Hou 1999: 32)
speculated reason for the beneficial effects
Speculated Reason for the Beneficial Effects
  • The unusual hardship faced by sent-down youth forced them to be more adaptive and thus acquire skills to survive.
in our recent study xie yang and greenman 2008
In Our Recent Study (Xie, Yang, and Greenman 2008)
  • We analyze data from the survey of Family Life in Urban China that we conducted in three large cities (Shanghai, Wuhan, and Xi’an) in 1999.
  • We use some items designed for this study.
statistical analyses
Statistical Analyses
  • (1) We present the differences in six socioeconomic indicators between respondents who experienced send-down with those who did not experience send-down.
  • (2) We present results from a fixed-effects model capitalizing on the sibling structure in our data.
  • (3) We examine educational attainment closely as a time-varying covariate and its endogenous role in affecting early returns of sent-down youth.
Table 1: Descriptive Differences between Respondents with Send-Down Experience and Respondents without Send-Down Experience

Notes: *p<.1, **p<.05, ***p<.01

after we control for covariates table 2
After We Control for Covariates (Table 2)
  • There are no differences in salary or income.
  • Short-term sent-down youth still have higher levels of education than the other two groups (non-sent-down and long-term sent-down).
potential sources of bias
Potential Sources of Bias
  • Some sent-down youth did not return to cities or did not return to the same cities.
  • There can be unobserved family-level characteristics associated with both send-down and outcomes.
  • We use a fixed effects model based on sibling pairs to address both problems.
table 3 unadjusted differences by send down experience using sibling pairs
Table 3 : Unadjusted Differences by Send-Down Experience Using Sibling Pairs

Notes: *p<.1, **p<.05, ***p<.01

what s going on
What’s Going On?
  • If there are no effects of send-down (from the fixed effects model), why do we observe differences in education between short-term sent-down youth and long-term sent-down youth?
  • The answer largely lies in “pre-treatment” differences.
table 4 unadjusted differences by duration
Table 4: Unadjusted Differences by Duration

Duration <6

Duration > 6

Notes: *p<.1, **p<.05, ***p<.01

  • Did send-down experience benefit youth? -- No.
  • Our analyses of the new data show that the send-down experience did not benefit the youth who were affected.
  • Differences in social outcomes between those who experienced send-down and those who did not are either non-existent or spurious due to other social processes.
accounting for heterogeneous responses with social context principle
Accounting for Heterogeneous Responses with Social Context Principle
  • Possible with nested data, assuming that patterns of relationships are homogeneous (or following a distribution) within social contexts (by time or space).
  • dk is allowed to vary across k (k=1,…K), social context, but is homogeneous within k, conditional on X.
multi level model mlm
Multi-level Model (MLM)
  • Yik = ak + dkDik + b’Xik + eikak = l+fzk+mk dk = g+szk+nk
  • Other names: hierarchical linear models, random-coefficient models, growth-curve models, and mixed models.
  • Units of analysis at a lower level are nested within higher-level units of analysis
  • Examples:
    • Students within schools
    • Observations over time within persons (growth curve)
problems without mlm
Problems without MLM
  • If we ignore higher-level units of analysis => we cannot account for context (individualistic approach)
  • If we ignore individual-level observation and rely on higher-level units of analysis, we may commit ecological fallacy (aggregated data approach)
  • Without explicit modeling, sampling errors at second level may be large =>unreliable slopes
  • Homoscedasticity and no serial correlation assumptions of OLS are violated (an efficiency problem).
  • No distinction between parameter variability and sampling variability.
advantages of mlm
Advantages of MLM
  • Cross-level comparisons
  • Controls for differences across higher levels
example xie and hannum 1996
Example: Xie and Hannum (1996)
  • (1) Where
    • Y = earnings,
    • X1 = years of schooling,
    • X2 = years of work experience,
    • X4 = a dummy variable denoting membership in the Communist Party of China (1 = party member),
    • X5 a dummy variable denoting gender (1 = female).
  • Note two interactions.
consider regional heterogeneity
Consider regional heterogeneity
  • For the ith person in kth city:
  • Instead of using fixed effects for the intercept b0k, and full interactions for slope parameters, Xie and Hannum modeled these parameters in a multilevel model.
  • Let z be a city-level covariate that measures the degree of economic reform. Let us assume that individual-level parameters depend on z in the following linear regressions:
combining the two levels
Combining the two levels =>

We can see that the city-level covariate z interacts with most of the individual-level predictors.

special cases
Special Cases
  • Special case 1: If all the coefficients of the city-level covariate (z) are zero, we have what is called “random coefficient model”
  • Special case 2: If all the coefficients of the city-level covariate (z) are zero and there are no random coefficients in all slope coefficients (except the intercept), we have what is called “variance component model”. [See Table 3.]
summary four ways to conceptualize variability in parameters
Summary: Four ways to conceptualize variability in parameters

where Pk is the number of predictors at the 2nd level, and K is the number of units at the second level.

  • Xie, Yu. 1996. “Review of Identification Problems in the Social Sciences by Charles Manski.” American Journal of Sociology 101:1131-1133.
  • Xie, Yu and Emily Hannum. 1996. “Regional Variation in Earnings Inequality in Reform-Era Urban China.” American Journal of Sociology 101:950-992.
  • Xie, Yu, Yang Jiang, and Emily, Greenman. 2008. “Did Send-Down Experience Benefit Youth? A Reevaluation of the Social Consequences of Forced Urban-Rural Migration during China’s Cultural Revolution.” Social Science Research 37: 686-700.