1 / 84

Continuous Outcomes Investigating Relationships

Continuous Outcomes Investigating Relationships. Chapter 3. Outline. Describing: Numerical summaries Graphical summaries Simple linear regression: Model Inferences Diagnostics Multiple linear regression: Linear regression ANCOVA. Continuous Outcomes. No gaps:

ailani
Download Presentation

Continuous Outcomes Investigating Relationships

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Continuous Outcomes Investigating Relationships Chapter 3

  2. Outline • Describing: Numerical summaries Graphical summaries • Simple linear regression: Model Inferences Diagnostics • Multiple linear regression: Linear regression ANCOVA

  3. Continuous Outcomes • No gaps: All values are possible. Level of detail is limited only by measurement tool. • Examples: Blood pressure Weight Hemoglobin Concentrations Gene expression levels

  4. Learning Objectives • How do I describe relationships between continuous variables? • How do I compare groups while adjusting for confounders (continuous and categorical)? • How do I investigate the association of risk factors (continuous and categorical) with the outcome? • How do I plan for a study when the research question involves two continuous variables?

  5. Public Health Application The US EPA estimates that 76 – 85 million pounds of atrazine (6-chloro-N2-ethyl-N4-isopropyl-1,3,4-triazine-2,4-diamine),a triazineherbicide, is produced annually with approximately 76.5 million pounds applied within the United States. Atrazine’smain use is to control broadleaf and grassy weeds with the most common sites of application being corn, sugarcane, and sorghum. Once introduced into the environment, atrazine is not easily broken down and has been shown to persist for long periods. This persistence provides ample opportunity for water system contamination (Agency for Toxic Substances and Disease Registry 2003). Current research shows that atrazine exposure may pose a significant threat to human health with drinking water providing the most widespread route of water.

  6. Data Description • Longitudinal study conducted to investigate the effects of drinking water exposed to herbicides and maternal health outcomes: 979 pregnant women with data at week 9 • 270 drank only tap-water during pregnancy. • 315 drank only bottle/filtered water during pregnancy. • 394 drank a combination of tap and bottle/filtered water. Demographic variables collected at week 9 Hemoglobin measured throughout pregnancy For those drinking tap water, the tap water consumption was measured (L).

  7. Research Question Does exposure to herbicides in drinking water impact changes in hemoglobin?

  8. DESCRIBING THE DATA

  9. Most Important Step in Data Analysis • Describe the data: Before making conclusions or inferences, an investigator needs to fully understand what the data looks like. • Numerical and graphical summaries cannot be skipped! Need this information to choose the most appropriate statistical method Need this information for valid statistical inferences

  10. Describing the Data • Numerical summaries: Common measures of center and spread • Graphical summaries: Histograms Box-and-whisker plots Mean plots (with error bars) • Same as Chapter 2, but these do not describe relationships

  11. Scatterplots • Plot two-variable relationships. • A point represents a value for each variable. • Points can be described: Direction (positive or negative) Linear Strength

  12. Scatterplots Insert Figure 3-1

  13. Association and Correlation • Tap water consumption and hemoglobin change demonstrate a positive linear relationship. • Association: Positive Negative • Correlation quantifies the linear relationship between two variables.

  14. Correlation Correlation ranges between 1 and 1.  1—strongest negative linear relationship +1—strongest positive linear relationship 0—no linear relationship

  15. Correlation *p-Value < 0.05.

  16. Simple linear regression

  17. What is a Linear Relationship? Insert Figure 3-4

  18. Statistical Models • Help us understand relationships in the data and how the data could have been produced. • Relate a response to an explanatory variable. • Define how changes in the response variable can be explained by the explanatory variable. • Provide a mechanism for understanding the random variation that may occur in the relationship between the response and the explanatory variables.

  19. Statistical Model The scatter plots indicate that there might be a linear relationship between tap water consumption and hemoglobin change. This suggests that a line would do a good job of describing the relationship.

  20. Random Variation Insert Figure 3-5 We would not expect data to line up perfectly.

  21. Simple Linear Regression Model Response =  + (explanatory variable) +   • Identically and Independently distributed as normals • Mean of 0 • Constant variance

  22. Least Squares Insert Figure 3-7 How do you choose the line? Minimize the errors.

  23. ANOVA Table

  24. Explaining Variability Insert Figure 3-8 R2 is the proportion of variability explained by the regression model (x).

  25. ANOVA Table Note: The F test tests H0: 1=0. H1:  1≠0.

  26. Inference Change =  + (water) + , N~(0,2) Research hypothesis: Tap water consumption and hemoglobin change are linearly related:  ≠ 0. Null hypothesis: Tap water consumption and hemoglobin change are not linearly related:  = 0.

  27. Regression Results

  28. Prediction Equation The prediction equation is the estimated line. Can be used to predict responses, Note: No error term – this is not a “model;” this is an actual line.

  29. Diagnostics • Linear regression assumptions: The mean of the errors is 0. The errors have constant variance. The errors are identically and independently distributed as normals. • Checking the assumptions: Plots Residuals Outliers and influence points

  30. Properties of Residuals In any regression model, the set of sample residuals is

  31. Types of Residuals • Raw residuals: The difference between actual and predicted Y • Studentized residuals (STUDENT): Raw residuals that have been “standardized” • Jackknife residuals (RSTUDENT): Raw residuals that have been “standardized” Denominator use in “standardizing” does not involve ith observation.

  32. Residual Plots • The plot of the residuals vseach of the regressorvariables: Should be random . Scattergramsshould occur at the horizontal line 0. • Nonrandom scatter on residual plots indicates violations of model assumptions.

  33. Residual Plots: Potential violations • Studentized residuals vs predicted can indicate an outlier. • Studentized residuals vs predicted can indicate nonconstantvariance (V-shaped plot). • Studentized residuals vsgiven predictor can indicate need for higher order terms (curvilinear plot). • Studentized residuals vs time can indicate correlation among residuals (sine curve plot). (really not an issue with cross-sectional data)

  34. Insert Figure 3-12 Residual vsx: If all assumptions are met, your plot might look like this.

  35. Insert Figure 3-13 A violation has occurred...how can you tell?

  36. Insert Figure 3-14c A violation has occurred...how can you tell?

  37. Probability (Q-Q) Plots Insert Figures 3-17a,b,c

  38. Insert Figure 3-18b A violation has occurred...how can you tell?

  39. Polynomial Regression • When a curve is leftover in the residuals, you might need to add a polynomial term. For example, remember the formula for a parabola quadratic regression (includes a squared term): Usually happens with variables like age

  40. Planning R2 Number of regressors Power Significance level

  41. Multiple linear regression

  42. Two regressors

  43. Statistical Models You are already familiar with a statistical model that describes the linear relationship between X and Y. Y = +  X+ ε, εN(0,2) Simple linear regression

  44. Multiple Linear Regression • Public health involves complex research problems; so, it is not often that there is only one explanatory variable or one regressor (x). • When there are multiple regressors, we have multiple linear regression: y =  + 1x1 + 2x2 + … + KxK +  • For the purposes of illustration, let us start with two regressors x1 and x2.

  45. Two Regressors

  46. 3-D scatterplot

  47. Two-Regressor Model • The model: yi= α +1x1i + 2x2i + i, i= 1,..., n • Model assumptions: 1, 2,…, n represents a random sample of unobservable error terms from a population of residuals characterized by • Mean (i) = 0 for all the i’s • Var (i) = 2 for all the i’s(homoscedasticity) • Cov (i, j) = 0 for all the i’s ≠ j’s(another way of saying independent)

  48. 3-D Scatterplot

  49. Obtaining Estimates (Two Regressors) • To obtain estimates for , 1, 2, and 2, use the same principle of least squares as you did in simple linear regression. Minimize the SSE!

  50. Adjusted ss and partial correlations

More Related