Controlling for Common Method Variance in PLS Analysis:
This presentation is the property of its rightful owner.
Sponsored Links
1 / 33

Wynne W. Chin Jason Bennett Thatcher Ryan T. Wright Douglas J. Steel PowerPoint PPT Presentation


  • 87 Views
  • Uploaded on
  • Presentation posted in: General

Controlling for Common Method Variance in PLS Analysis: T he Measured Latent Marker Variable Approach. Wynne W. Chin Jason Bennett Thatcher Ryan T. Wright Douglas J. Steel . Outline. Common Method Bias Study 1: Evaluating Unmeasured Latent Marker Variable Approach

Download Presentation

Wynne W. Chin Jason Bennett Thatcher Ryan T. Wright Douglas J. Steel

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Wynne w chin jason bennett thatcher ryan t wright douglas j steel

Controlling for Common Method Variance in PLS Analysis: The Measured Latent Marker Variable Approach

Wynne W. Chin

Jason Bennett Thatcher

Ryan T. Wright

Douglas J. Steel


Outline

Outline

  • Common Method Bias

  • Study 1: Evaluating Unmeasured Latent Marker Variable Approach

  • Study 2: A Measured Latent Marker Variable Approach

  • Conclusions


Common method bias

Common Method Bias

  • Several authors have attempted to create approaches for addressing common method bias in SEM which have been applied to PLS

  • Williams et al (1989)

  • Podsakoff et al (2003)


Study one evaluating umlc approach in pls

Study One: Evaluating UMLC Approach in PLS

  • Liang et al (2007) created a PLS Unmeasured Latent Marker Construct (UMLC) approach to control for common method variance.

  • Constructing a Model

    • Take all the indicators for each construct and reusing them to create single indicator constructs.

    • Link the original constructs to their respective single indicator constructs.

    • The method construct consisting of all indicators used in the study is linked to all the single indicator constructs


Liang ulmc approach in pls

Liang ULMC Approach in PLS

  • Evaluating Common Method Variance

    • Estimate a model using bootstrapping

    • Compare the statistical significance of loadings on the method factor

    • Examine variance explained in loadings and constructs

      • Squared variance of the method loadings was interpreted as variance explained by common method

    • Lack of significant loadings & smaller method variances viewed as indicators of absence of CMB


Problem ulmc not vetted

Problem: ULMC Not vetted

  • Issues with Liang et al

    • No proofs

    • No simulations

    • No evidence that it worked

  • Issues with UMLC

    • Richardson et al (2009) demonstrated through a series of simulations that it rarely worked in ML SEM.


Evaluating the ulmc method

Evaluating the ULMC Method


Evaluating the ulmc method1

Evaluating the ULMC Method

  • Monte Carlo simulations

    • 500 datasets of 5,000 in prelis

  • Method bias of different forms and at different levels

    • Congeneric

    • Non-Congeneric

  • Estimated models using PLSGraph 3.0


Conclusions of part one

Conclusions of Part One

  • Where Richardson et al (2009) found that a UMLC approach had limited utility for detecting CMB using ML SEM, the same technique applied to PLS had no ability to detect and control for CMB.


Part two measured latent marker variable approach

Part Two: Measured Latent Marker Variable Approach

  • A measured latent marker variable approach uses a set of unrelated items to each other or to the constructs of interest.

  • By doing so, we capture the just the variance attributable to method, not just to covariance among theoretically connected latent constructs.

  • Can perform construct or item level corrections.

  • Illustrate using simulation with the same parameters as Study 1.


Creating indicators for mlmv

Creating Indicators for MLMV

  • Each indicator must not be in the same domain as constructs found in the research model.

  • Each indicator must be drawn from different unit of analysis than that investigated in the research model.  

  • Rather than reliability, ensure all unique and error variances are independent among the set of measures chosen

  • The MLMV must include a minimum of 4 items.

  • Awell-designed survey should include these indicators at the end of the instrument.


Construct level corrections

Construct Level Corrections

  • Create as many CMV control constructs as there are constructs in the model.

  • Each CMV control uses the same entire set of MLMV items.

  • CMV construct is modeled as impacting each model construct.

  • The residuals obtained now represent the model constructs with the CMV effects removed.


Pls estimates using cmv of 36

PLS Estimates Using CMV of .36


Construct level correlations

Construct Level Correlations

  • Enter the 12 MLMV as controls by creating a CLC construct for the two model constructs

  • Results in reducing the inflated path of 0.741 to more closely match the population parameter with an estimate of 0.606

  • This represents the impact of construct XX on construct YY holding CLC constant.

  • CLC scores are then used partial out the CMV from both constructs to obtain the partial correlation between XX and YY.


First step in clc

First Step in CLC

PLS Estimates using items with 0.36


Assessment of construct level correlations

Assessment of Construct Level Correlations

While a 12-item CLC effectively captured the simulated CMV, our simulation illustrates that one can use a four item LMV to remove 72 percent variance due to CMV.

Given that researchers tend to have limited space on survey instruments to include additional items, these results illustrate that our MLMV approach is flexible enough to be included in surveys of varying lengths.


Item level corrections

Item Level Corrections

  • Use the MLMV items to partial out the CMV effects at the measurement item level.

  • Each item measure is regressed on the entire set of MLMV items.

  • The residuals for each item now represent the construct items with the CMV effects removed.


Item level corrections1

Item Level Corrections

  • The CMV should be replaced with an equivalent amount of random error to be equivalent to the variance of the original measures sans bias.

  • Must obtain an assessment of reliability of the original items by assessing the reliability of original items

    • R-square obtained from each item to MLMV regression is used.

    • Specifically, the square root of the R-square multiplied with a number drawn from a normal distribution of mean 0 and standard deviation of 1 is added to each item residual.

    • This represents the final ILC items used in a PLS analyses.


Item level correlations

Item Level Correlations

  • Results in item loadings that are more consistent with a PLS analyses without CMV effects.

  • The estimated loadings varying from 0.76 to 0.789 are consistent with the tendency of PLS to overestimate the loadings by approximately 10 percent.

  • The estimated structural path of 0.552 is consistent with an approximate 10 percent underestimation of the population parameter of 0.60.

  • To correct this, you need to add noise back into the model.


Results of ilc approach

Results of ILC Approach


Clc and ilc results

CLC and ILC Results

  • Overall, both approaches seem to converge to the same results.

  • With CLC, we obtain an accurate estimate of the path estimate at the expense of the loadings.

  • With ILC, we obtain more accurate item loading estimates at the expense of the structural path.

    • But, the path estimates can be obtained if we compensate for the CMV partialedout.


Results of ilc with error compensation

Results of ILC with Error Compensation


Varying level and form of error

Varying Level and Form of Error

  • Introduced different levels and forms of error into the simulations.

  • Two items for each construct had true score and method loadings of 0.8 and 0.2.

  • Two items were set at 0.7 and 0.4

  • Two items were set at 0.6 and 0.6 (i.e., equal amounts of true and method effects).


Results with varying level of trait and method

Results with Varying Level of Trait and Method


Results of clc with different trait and method impact

Results of CLC with Different Trait and Method Impact


Results of ilc with different trait and method no error compensation

Results of ILC with Different Trait and Method (No Error Compensation)


Results of ilc different trait and method with error compensation

Results of ILC Different Trait and Method with Error Compensation


Comparing approaches

Comparing Approaches


Conclusion

Conclusion

  • We have presented initial evidence of two methods for correcting for common method bias in PLS Path Modelling.

  • CLC is more easily implemented.

  • ILC yields more insight into CMB influence in the measurement model.

  • Approach must be tailored to each study.


  • Login