Introduction to hypothesis testing
Download
1 / 49

Introduction to Hypothesis Testing - PowerPoint PPT Presentation


  • 191 Views
  • Uploaded on

Introduction to Hypothesis Testing. Chapter 11. 11.1 Introduction . The purpose of hypothesis testing is to determine whether there is enough statistical evidence in favor of a certain belief about a parameter. Examples

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Introduction to Hypothesis Testing' - beau-blevins


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

11 1 introduction
11.1 Introduction

  • The purpose of hypothesis testing is to determine whether there is enough statistical evidence in favor of a certain belief about a parameter.

  • Examples

    • Is there statistical evidence in a random sample of potential customers, that support the hypothesis that more than 10% of the potential customers will purchase a new products?

    • Is a new drug effective in curing a certain disease? A sample of patients is randomly selected. Half of them are given the drug while the other half are given a placebo. The improvement in the patients conditions is then measured and compared.


11 2 concepts of hypothesis testing
11.2 Concepts of Hypothesis Testing

  • The critical concepts of hypothesis testing.

    • Example:

      • An operation manager needs to determine if the mean demand during lead time is greater than 350.

      • If so, changes in the ordering policy are needed.

    • There are two hypotheses about a population mean:

      • H0: The null hypothesis m = 350

      • H1: The alternative hypothesis m > 350

This is what you want to prove


11 2 concepts of hypothesis testing1
11.2 Concepts of Hypothesis Testing

  • Assume the null hypothesis is true (m= 350).

m = 350

  • Sample from the demand population, and build a statistic related to the parameter hypothesized (the sample mean).

  • Pose the question: How probable is it to obtain a sample mean at least as extreme as the one observed from the sample, if H0 is correct?


11 2 concepts of hypothesis testing2

11.2 Concepts of Hypothesis Testing

  • Assume the null hypothesis is true (m= 350).

m = 350

  • In this case the mean m is not likely to be greater than 350. Do not reject the null hypothesis.


Types of errors
Types of Errors

  • Two types of errors may occur when deciding whether to reject H0 based on the statistic value.

    • Type I error: Reject H0 when it is true.

    • Type II error: Do not reject H0 when it is false.

  • Example continued

    • Type I error: Reject H0 (m = 350) in favor of H1 (m > 350) when the real value of m is 350.

    • Type II error: Believe that H0 is correct (m = 350) when the real value of m is greater than 350.


Controlling the probability of conducting a type i error

Critical value

m = 350

Controlling the probability of conducting a type I error

  • Recall:

    • H0: m = 350 and H1: m > 350.

    • H0 is rejected if is sufficiently large

  • Thus, a type I error is made if when m = 350.

  • By properly selecting the critical value we can limit the probability of conducting a type I error to an acceptable level.


11 3 testing the population mean when the population standard deviation is known
11.3 Testing the Population Mean When the Population Standard Deviation is Known

  • Example 11.1

    • A new billing system for a department store will be cost- effective only if the mean monthly account is more than $170.

    • A sample of 400 accounts has a mean of $178.

    • If accounts are approximately normally distributed with s = $65, can we conclude that the new system will be cost effective?


Testing the population mean s is known
Testing the Population Mean ( Standard Deviation is Knowns is Known)

  • Example 11.1 – Solution

    • The population of interest is the credit accounts at the store.

    • We want to know whether the mean account for all customers is greater than $170.

H1 : m > 170

  • The null hypothesis must specify a single value of the parameter m,

H0 : m = 170


Approaches to testing
Approaches to Testing Standard Deviation is Known

  • There are two approaches to test whether the sample mean supports the alternative hypothesis (H1)

    • The rejection region method is mandatory for manual testing (but can be used when testing is supported by a statistical software)

    • The p-value method which is mostly used when a statistical software is available.


The rejection region method
The Rejection Region Method Standard Deviation is Known

The rejection region is a range of values such that if the test statistic falls into that range, the null hypothesis is rejected in favor of the alternative hypothesis.


The rejection region method for a right tail test
The Rejection Region Method – Standard Deviation is Knownfor a Right - Tail Test

  • Example 11.1 – solution continued

  • Recall: H0: m = 170 H1: m > 170 therefore,

  • It seems reasonable to reject the null hypothesis and believe that m > 170 if the sample mean is sufficiently large.

Reject H0 here

Critical value of the

sample mean


The rejection region method for a right tail test1

The Rejection Region Method for a Right - Tail Test

  • Example 11.1 – solution continued

  • Define a critical value for that is just large enough to reject the null hypothesis.


Determining the critical value for the rejection region
Determining the Critical Value for the Rejection Region Standard Deviation is Known

  • Allow the probability of committing a Type I error be a (also called the significance level).

  • Find the value of the sample mean that is just large enough so that the actual probability of committing a Type I error does not exceed a. Watch…


Determining the critical value for a right tail test

a Standard Deviation is Known

= P( given that H0 is true)

we have:

Determining the Critical Value – for a Right – Tail Test

Example 11.1 – solution continued

P(commit a Type I error) = P(reject H0 given that H0 is true)

… is allowed to be a.


Determining the critical value for a right tail test1
Determining the Critical Value – Standard Deviation is Known for a Right – Tail Test

Example 11.1 – solution continued

a

= 0.05


Determining the critical value for a right tail test2
Determining the Critical value Standard Deviation is Knownfor a Right - Tail Test

Conclusion

Since the sample mean (178) is greater than the critical value of 175.34, there is sufficient evidence to infer that the mean monthly balance is greater than $170 at the 5% significance level.


The standardized test statistic
The standardized test statistic Standard Deviation is Known

  • Instead of using the statistic , we can use the standardized value z.

  • Then, the rejection region becomes

One tail test


The standardized test statistic1
The standardized test statistic Standard Deviation is Known

  • Example 11.1 - continued

    • We redo this example using the standardized test statistic.

      Recall: H0: m = 170

      H1: m > 170

    • Test statistic:

    • Rejection region: z > z.05 = 1.645.


The standardized test statistic2
The standardized test statistic Standard Deviation is Known

  • Example 11.1 - continued

  • Conclusion

    • Since Z = 2.46 > 1.645, reject the null hypothesis in favor of the alternative hypothesis.


P value method

P-value Method

  • The p-value provides information about the amount of statistical evidence that supports the alternative hypothesis.


P value method1
P-value Method Standard Deviation is Known

The probability of observing a test statistic at least as extreme as 178,

given that m = 170 is…

The p-value


Interpreting the p value

Note how the event Standard Deviation is Known

is rare under H0

when but...

…it becomes more

probable under H1,

when

Interpreting the p-value

Because the probability that the sample mean will assume a value of more than 178 when m = 170 is so small (.0069), there are reasons to believe that m > 170.


Interpreting the p value1
Interpreting the p-value Standard Deviation is Known

We can conclude that the smaller the p-value

the more statistical evidence exists to support the alternative hypothesis.


Interpreting the p value2
Interpreting the p-value Standard Deviation is Known

  • Describing the p-value

    • If the p-value is less than 1%, there is overwhelming evidence that supports the alternative hypothesis.

  • If the p-value is between 1% and 5%, there is a strong evidence that supports the alternative hypothesis.

  • If the p-value is between 5% and 10% there is a weak evidence that supports the alternative hypothesis.

  • If the p-value exceeds 10%, there is no evidence that supports the alternative hypothesis.


The p value and the rejection region methods

The p-value Standard Deviation is Known

a

= 0.05

The p-value and the Rejection Region Methods

  • The p-value can be used when making decisions based on rejection region methods as follows:

    • Define the hypotheses to test, and the required significance level a.

    • Perform the sampling procedure, calculate the test statistic and the p-value associated with it.

    • Compare the p-value to a. Reject the null hypothesis only if p-value <a; otherwise, do not reject the null hypothesis.


Conclusions of a test of hypothesis
Conclusions of a Test of Hypothesis Standard Deviation is Known

  • If we reject the null hypothesis, we conclude that there is enough evidence to infer that the alternative hypothesis is true.

  • If we do not reject the null hypothesis, we conclude that there is not enough statistical evidence to infer that the alternative hypothesis is true.

The alternative hypothesis

is the more important

one. It represents what

we are investigating.


A left tail test
A Left - Tail Test Standard Deviation is Known

  • The SSA Envelop Example.

    • The chief financial officer in FedEx believes that including a stamped self-addressed (SSA) envelop in the monthly invoice sent to customers will decrease the amount of time it take for customers to pay their monthly bills.

    • Currently, customers return their payments in 24 days on the average, with a standard deviation of 6 days.


A left tail test1
A Left - Tail Test Standard Deviation is Known

  • The SSA envelop example – continued

    • It was calculated that an improvement of two days on the average will cover the costs of the envelops (checks can be deposited earlier).

    • A random sample of 220 customers was selected and SSA envelops were included with their invoice packs.

    • The times customers’ payments were received were recorded (SSA.xls)

    • Can the CFO conclude that the plan will be profitable at 10% significance level? 


A left tail test2
A Left - Tail Test Standard Deviation is Known

  • The SSA envelop example – Solution

    • The parameter tested is the population mean payment period (m).

    • The hypotheses are:H0: m = 22H1: m < 22(The CFO wants to know whether the plan will be profitable)


A left tail test3
A Left - Tail Test Standard Deviation is Known

  • The SSA envelop example – Solution continued

    • The rejection region: It makes sense to believe that m < 22 if the sample mean is sufficiently smaller than 22.

    • Reject the null hypothesis if


A left tail test4

Left-tail test Standard Deviation is Known

A Left -Tail Test

  • The SSA envelop example – Solution continued

    • The standardized one tail left hand test is:

Define the rejection region

  • Since -.91 > –1.28 do not reject the null hypothesis.

  • The p value = P(Z<-.91) = .1814Since .1814 > .10, do not reject the null hypothesis


A two tail test
A Two - Tail Test Standard Deviation is Known

  • Example 11.2

    • AT&T has been challenged by competitors who argued that their rates resulted in lower bills.

    • A statistics practitioner determines that the mean and standard deviation of monthly long-distance bills for all AT&T residential customers are $17.09 and $3.87 respectively.


A two tail test1
A Two - Tail Test Standard Deviation is Known

  • Example 11.2 - continued

    • A random sample of 100 customers is selected and customers’ bills recalculated using a leading competitor’s rates (see Xm11-02).

    • Assuming the standard deviation is the same (3.87), can we infer that there is a difference between AT&T’s bills and the competitor’s bills (on the average)?


A two tail test2
A Two - Tail Test Standard Deviation is Known

  • Solution

    • Is the mean different from 17.09?

H0: m = 17.09

  • Define the rejection region


A two tail test3

a/ Standard Deviation is Known2 = 0.025

a/2 = 0.025

If H0 is true (m =17.09), can still fall far above or far below 17.09, in which case we erroneously reject H0 in favor of H1

A Two – Tail Test

Solution - continued

17.09

We want this erroneous rejection of H0 to be a rare event, say 5% chance.


A two tail test4

a/ Standard Deviation is Known2 = 0.025

a/2 = 0.025

17.55

a/2 = 0.025

a/2 = 0.025

From the sample we have:

0

za/2= 1.96

-za/2= -1.96

Rejection region

A Two – Tail Test

Solution - continued

17.09


A two tail test5

0 Standard Deviation is Known

za/2= 1.96

-za/2= -1.96

Two-tail test

A Two – Tail Test

There is insufficient evidence to infer that there is a difference between the bills of AT&T and the competitor.

Also, by the p value approach:

The p-value = P(Z< -1.19)+P(Z >1.19)

= 2(.1173) = .2346 > .05

a/2 = 0.025

a/2 = 0.025

-1.19

1.19


11 4 calculating the probability of a type ii error
11.4 Calculating the Probability of a Type II Error Standard Deviation is Known

  • To properly interpret the results of a test of hypothesis, we need to

    • specify an appropriate significance level or judge the p-value of a test;

    • understand the relationship between Type I and Type II errors.

    • How do we compute a type II error?


Calculation of the probability of a type ii error
Calculation of the Probability Standard Deviation is Knownof a Type II Error

  • To calculate Type II error we need to…

    • express the rejection region directly, in terms of the parameter hypothesized (not standardized).

    • specify the alternative value under H1.

  • Let us revisit Example 11.1


Calculation of the probability of a type ii error1

a=.05

H0: m = 170

H1: m = 180

m= 170

m=180

Calculation of the Probability of a Type II Error

Express the rejection region directly, not in standardized terms

  • Let the alternative value be m = 180 (rather than just m>170)

Specify the alternative value under H1.

Do not reject H0


Calculation of the probability of a type ii error2

a Standard Deviation is Known=.05

H0: m = 170

H1: m = 180

m= 170

m=180

Calculation of the Probability of a Type II Error

  • A Type II error occurs when a false H0 is not rejected.

A false H0…

…is not rejected


Calculation of the probability of a type ii error3

H Standard Deviation is Known0: m = 170

H1: m = 180

m=180

Calculation of the Probability of a Type II Error

m= 170


Effects on b of changing a

a Standard Deviation is Known2 >

b2 <

Effects on b of changing a

  • Decreasing the significance level a, increases the value of b, and vice versa.

a1

b1

m= 170

m=180


Judging the test
Judging the Test Standard Deviation is Known

  • A hypothesis test is effectively defined by the significance level a and by the sample size n.

  • If the probability of a Type II error b is judged to be too large, we can reduce it by

    • increasing a, and/or

    • increasing the sample size.


Judging the test1

By increasing the sample size the standard deviation of the sampling distribution of the mean decreases. Thus, decreases.

Judging the Test

  • Increasing the sample size reduces b


Judging the test2

m sampling distribution of the mean decreases. = 170

m=180

Judging the Test

  • Increasing the sample size reduces b

Note what happens when n increases:

a does not change,

but b becomes smaller


Judging the test3
Judging the Test sampling distribution of the mean decreases.

  • Increasing the sample size reduces b

  • In Example 11.1, suppose n increases from 400 to 1000.

  • a remains 5%, but the probability of a Type II drops dramatically.


Judging the test4
Judging the Test sampling distribution of the mean decreases.

  • Power of a test

    • The power of a test is defined as 1 - b.

    • It represents the probability of rejecting the null hypothesis when it is false.


ad