Chapter 3: Diagnostics and Remedial Measures
Download
1 / 47

Validity of a regression model - PowerPoint PPT Presentation


  • 889 Views
  • Updated On :

Chapter 3: Diagnostics and Remedial Measures. Ayona Chatterjee Spring 2008 Math 4813/5813. Validity of a regression model. Any one of the following features may not be appropriate. Linearity Normality of error terms. Important to examine the aptness of a model before making inferences.

Related searches for Validity of a regression model

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Validity of a regression model' - Jeffrey


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Slide1 l.jpg

Chapter 3: Diagnostics and Remedial Measures

Ayona Chatterjee

Spring 2008

Math 4813/5813


Validity of a regression model l.jpg
Validity of a regression model

  • Any one of the following features may not be appropriate.

    • Linearity

    • Normality of error terms.

  • Important to examine the aptness of a model before making inferences.

  • Consider diagnostic tools to justify the appropriateness of a mode.

  • Suggest remedial techniques to fix deviations.


Lets recall a dot plot l.jpg
Lets recall: A Dot Plot

  • A dotplot displays a dot for each observation along a number line. If there are multiple occurrences of an observation, or if observations are too close together, then dots will be stacked vertically. If there are too many points to fit vertically in the graph, then each dot may represent more than one point.


Stem and leaf diagram l.jpg
Stem and Leaf Diagram

  • In a stem-and-leaf plot each data value is split into a "stem" and a "leaf".  The "leaf" is usually the last digit of the number and the other digits to the left of the "leaf" form the "stem". 


Box plot l.jpg
Box Plot

  • Uses the max, minimum and the quartiles to plot the data.

  • Can draw conclusions about symmetry and outliers.


Time series plot l.jpg
Time Series Plot

  • Also called sequence plot.

  • Used when data are collected in series over time.

  • Used to draw inference about patterns with time.

  • Seasonal or weekly effects.


Diagnostics for predictor variable l.jpg
Diagnostics for Predictor Variable

  • Let us look at the Toluca Company example given in chapter 1.

  • The predictor variable X was the lot size.

  • A dot plot, time series plot, stem and leaf plot and box pot for the data were obtained.


Slide8 l.jpg

1 2 0

4 3 000

6 4 05

8 5 00

11 6 000

(3) 7 555

10 8 00005

5 9

5 10 00

3 11 00

1 12 5


Residuals l.jpg
Residuals

  • Residuals are the difference between the observed and predicted responses (Y).

  • For the normal error regression model, we assume that the error term is normally distributed.

  • If the model is appropriate for the data, this should be reflected in the residuals.


Departures from model to be studied by residuals l.jpg
Departures from Model to be Studied by Residuals

  • The regression function is not linear.

  • The error terms do not have constant variance.

  • The error terms are not independent.

  • The model fits all but one or few outliers,

  • The error terms are not normally distributed.

  • One or several important predictor(s) have been omitted from the model.


Diagnostics for residuals l.jpg
Diagnostics for Residuals

  • Six diagnostic plots to judge departure from the simple linear regression model.

    • Plot of residuals against predictor variable.

      • The plot should have a random scatter of plots.

    • Plot of absolute or squared residuals against X.

    • Plot of residuals against the fitted values.


Diagnostics for residuals12 l.jpg
Diagnostics for Residuals

  • Plot of residuals against time or other sequence.

    • Should not display any trends.

  • Plots of residuals against omitted predictor variables.

  • Box plot of residuals.

  • Normal probability plot of residuals.

    • Should lie along a straight line.



Nonlinearity of regression function l.jpg

A example to study the relation between maps distributed and bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

Nonlinearity of Regression Function

X Y

80 0.60

220 6.70

140 5.30

120 4.00

180 6.55

100 2.15

200 6.60

160 5.75


Plots l.jpg
Plots bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Here a linear function appears to give a decent fit to the data set introduced in the previous slide. The regression equation obtained is

  • Y = -1.82 + 0.0435 X


Residual plot l.jpg
Residual Plot bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Here the departure from linearity if more visible as the residuals depart from 0 in a systematic manner.

  • The residual against the predictor is the preferred plot to judge linearity.


Nonconstancy or error variance l.jpg
Nonconstancy or error variance bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Here we have a residual plot against age for a study of the relation between blood pressure of adult women and their age, as age increases the residuals increase. In many business, social science and biological science, departure from constancy of error variance tends to be of the “megaphone” effect.


Nonconstancy of error variance l.jpg
Nonconstancy of error variance bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • The two other types of departure from constant error variance are when we have a curvilinear regression function or the error variance increases over time.


Presence of outliers l.jpg
Presence of outliers bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Outliers are extreme observations and can be identified from box plot or dot plots.

  • Another option is to have a scatter plot of the semi-studentized residual

  • A rough rule of thumb in case of a large number of observations is to consider semi-studentized residuals with absolute value of 4 or more as outliers.


Example l.jpg
Example bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

Here we can see that the scatter plot appears to have one outlier and this is pulling the regression line upwards. Thus in the residual plot we have so many observations in the lower half of the plot.

Removing the outlier leads to a more uniformly linear scatter plot and better regression estimates.


Nonindependence of error terms l.jpg
Nonindependence of Error Terms bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • For time series data it is advised to plot residuals against time order.

  • This is to check if consecutive observations are independent of each other or not


Nonnormality of error terms l.jpg
Nonnormality of error terms bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Large departures from normality is of concern.

  • A normal probability plot for the residuals in one way to judge normality.


Omission of important predictor variables l.jpg
Omission of Important Predictor Variables bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Residuals should be plotted against variables omitted from the model that may have important effects on the response.

  • Example studies output Y and age of workers X.


Example24 l.jpg
Example bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Lets work on the GPA data set.

    • Plot a box plot for the ACT scores, are there any noteworthy features in the plot?

    • Prepare a dot plot of the residuals. What information does this plot provide?

    • Plot the residuals against the fitted value. What departure from the regression model can be studied from this plot? What are your findings?

    • Prepare a normality plot of the residuals and comment on it.


Overview of remedial measures l.jpg
Overview of Remedial Measures bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • If the linear regression model is not appropriate for your data set:

    • Abandon regression model and develop a new model.

    • Employ some transformation on the data so that the regression model is appropriate for the transformed data.


Nonlinearity of regression function26 l.jpg
Nonlinearity of Regression Function bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • If the relation between X and Y is not linear, the following relations can be investigated:

    • Quadratic regression function.

    • Exponential regression function.


Transformations for nonlinear relation l.jpg
Transformations for Nonlinear Relation bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • To achieve linearity one can transform X or Y or both.

  • When the errors terms are normally distributed, we will transform X.

  • The following slide has some suggested transformations.


Slide28 l.jpg

Prototype bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

Transformation of X


Example29 l.jpg
Example bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

0.5 42.5

0.5 50.6

1 68.5

1 80.7

1.5 89.0

1.5 99.6

2 105.3

2 111.8

2.5 112.3

2.5 125.7

  • Data from an experiment on the effect of number of days of training received X and performance Y in a battery of simulated sales situation are presented.


Need to transform the data l.jpg
Need to transform the data bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.


Square root transformed x l.jpg
Square root transformed X bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours. `


Results l.jpg
Results bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.


Transformation for non normality and unequal error variances l.jpg
Transformation for Non-normality and Unequal Error variances bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Unequal error variances and non-normality often occurs together.

  • To fix this we shall transform Y, since we need to change the shape and spread of the distribution for Y.

  • A simultaneous transformation on X may also be needed.


Prototype regression patterns l.jpg
Prototype regression patterns bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

Transformations on Y


Example plasma levels l.jpg
Example: Plasma Levels bus rider ship in eight cities. Here X is the # of bus transit maps distributed for free to residents at the beginning of the test period and Y is the increase during the test period in average daily busy rider ship during non peak hours.

  • Using the data on plasma levels,

    • Draw a scatter plot of Age against plasma levels, comment on it.

    • Suggest a Suggest a suitable transformation.

    • Verify the validity of the transformation.


Slide39 l.jpg

These plots supports the appropriateness of the linear regression model to the transformed data.


Box cox transformation l.jpg
Box-Cox transformation regression model to the transformed data.

  • The Box-Cox procedure automatically identifies a transformation from the family of power transformations on Y.

  • The family of power transformations is of the form:

    • Here λ is a parameter to be determined from the data.


The new regression model l.jpg
The new regression model regression model to the transformed data.

  • The normal error regression model with the response variable a member of the family of power transformations described in the previous slide is:

  • Along with the regression coefficients we now need to estimate λ. Most cases the maximum likelihood estimator of λ is obtained by conduction a numerical search in a potential range for λ.


Calculations for l.jpg
Calculations for λ. regression model to the transformed data.

  • We standardize the responses so that the error magnitude does not depend on λ.

  • Once the standardized observations Wi have been obtained for a given λ value, they are regressed on the predictor variable X.


Example sales growth l.jpg
Example: Sales growth regression model to the transformed data.

  • A marketing researcher studied annual sales of a product that had been introduced 10 years ago. The data are as follows, where X is the year (coded) and Y is sales in thousands of units. Answer the following questions.


Slide44 l.jpg


Slide45 l.jpg

X Y appear adequate?

0 98

1 135

2 162

3 178

4 221

5 232

6 283

7 300

8 374

9 395


Box cox calculations l.jpg
Box Cox calculations appear adequate?



ad