Bivariate regression. The slope, explained variance, residuals. What is the formula for a slope?. A. e = mc 2 B. Y i = a + bx i + e i C. ŷ = a + bx D. y ≥ x ≥ a. What information does the slope provide?. A. whether the relationship is statistically significant
An Image/Link below is provided (as is) to download presentation
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.Content is provided to you AS IS for your information and personal use only.Download presentation by click this link.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.During download, if you can't get a presentation, the file might be deleted by the publisher.
What information does the slope provide? • A. whether the relationship is statistically significant • B. whether a case is a severe outlier, like Buchanan’s share of the vote • C. on average, what is the predicted value of y, given various values of x • D. which baseball batter is likely to hit best in the next game
What is a? • A. the y intercept • B. the value of y when x = 0 • C. where the slope crosses the y a axis • D. all of the above
Review: Covariance • When it tends to be the case that x is greater than the mean when y is greater than the mean AND x is lower than the mean when y is lower than the mean, then there is a positive covariation
Expected value • But we may want to know more specific knowledge than that – we may want to know the expected value of y for each increased value of x • I may know the mean of everyone’s height in class • But if I know gender, then I can generate two expected values • If you remember, we are always trying to do better than the mean
Substantive effect • For every 10K dollars given in humanitarian aid, there is an increase in 3K spent on weapons • For every 10K dollars given in humanitarian aid, there is a .5K increase spent on weapons • For every 10K dollars given in humanitarian aid, there is a 8K increase spent on weapons • Unit of analysis?
Regression equation • y = a + bx + e • ŷ = a + bx • ŷ is also known as yhat • y is the dependent variable value • yhat is the predicted value • a is the intercept
ŷ= a + bx • b is slope – rise over run • a is the y intercept; constant • Standard error is the average error from the actual points to the slope • T is the ratio of the slope divided by the standard error • Beta = Pearson r in bivariate analysis
Extending Interval Correlations • Regression and correlation are intimately related concepts. • You’ve probably all tried to map lines in Cartesian spaces before…
Thinking about two points. • The regression line connects two points: • The joint mean of X & Y • The point when the line crosses the Y axis, known as the intercept. • These two points can be used in any Rise-Run formula to compute the slope. • BUT… we really don’t calculate the regression slope this way. In fact, we calculate the slope first and then knowing it runs through the joint mean of X & Y we then compute the intercept.
In other words… • We start at the joint mean of X and Y. • We compute the slope (“b”) at that point. • We follow the line until it intercepts the Y axis.
Of course that’s the computational formula for the slope of a line and then there’s the simple alternative. There’s an approach to computing the slope of a regression line that is much closer to the way in which we computed Pearson’s r correlation coefficient. That is, … b = CovXY/VarX
If it’s so easy… • The regression line is “anchored” by the point at which it crosses the Y axis when X is 0. • Different notation systems will designate the intercept as “a” or “b0”. • Computationally,… a = MeanY – bYX*MeanX
What do we get out of a regression slope coefficient that we didn’t get out of a correlation coefficient? • Correlations are “standardized” • Slope coefficients are reported in the original metric of the dependent variable. “b” is read as “a b unit change in the dependent variable if the independent variable changes by 1 unit”.
So what do the Erikson data tell us? • Correlation “As the number of votes gained by the Democrats increase, the number of seats they win increases.” • Regression “For every 1 unit increase in the number of votes (X), the Democrats gain 2.5% more seats in the U. S. House of Representatives.”
B vs. b • There are actually two “b’s” in regression. A standardized B and an unstandardized b. • B is simply r. It’s perhaps fundamentally uninteresting in the bivariate situation. When we move to multivariate regression (regression with more than one IV) B will come to represent the effect of each variable controlling for all other IVs and will no longer equal r.