- 60 Views
- Uploaded on
- Presentation posted in: General

Probability (Part 2)

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

5

Chapter

Probability (Part 2)

Contingency Tables

Tree Diagrams

Bayes’s Theorem (optional)

Counting Rules (optional)

Variable 1

Col 1 Col 2 Col 3

Row 1

Row 2

Row 3

Row 4

Variable 2

Contingency Tables

- What is a Contingency Table?

- A contingency table is a cross-tabulation of frequencies into rows and columns.

Cell

- A contingency table is like a frequency distribution for two variables.

Contingency Tables

- Example: Salary Gains and MBA Tuition

- Consider the following cross-tabulation table for n = 67 top-tier MBA programs:

- The frequencies indicate that MBA graduates of high-tuition schools do tend to have large salary gains.

Contingency Tables

- Example: Salary Gains and MBA Tuition

- Are large salary gains more likely to accrue to graduates of high-tuition MBA programs?

- Also, most of the top-tier schools charge high tuition.

- More precise interpretations of this data can be made using the concepts of probability.

- For example, find the marginal probability of a medium salary gain (P(S2)).

Contingency Tables

- Marginal Probabilities

- The marginal probability of a single event is found by dividing a row or column total by the total sample size.

P(S2) =

33/67 =

.4925

- Conclude that about 49% of salary gains at the top-tier schools were between $50,000 and $100,000 (medium gain).

Contingency Tables

- Marginal Probabilities

- Find the marginal probability of a low tuition P(T1).

.2388

16/67 =

P(T1) =

- There is a 24% chance that a top-tier school’s MBA tuition is under $40.000.

Contingency Tables

- Joint Probabilities

- A joint probability represents the intersection of two events in a cross-tabulation table.

- Consider the joint event that the school has low tuition and large salary gains (denoted as P(T1S3)).

Contingency Tables

- Joint Probabilities

- So, using the cross-tabulation table,

P(T1S3) =

1/67 =

.0149

- There is less than a 2% chance that a top-tier school has both low tuition and large salary gains.

Contingency Tables

- Conditional Probabilities

- Found by restricting ourselves to a single row or column (the condition).

- For example, knowing that a school’s MBA tuition is high (T3), we would restrict ourselves to the third row of the table.

Contingency Tables

- Conditional Probabilities

- Find the probability that the salary gains are small (S1) given that the MBA tuition is large (T3).

.1563

5/32 =

P(T1|S3) =

- What does this mean?

Contingency Tables

- Independence

- To check for independent events in a contingency table, compare the conditional to the marginal probabilities.

- For example, if large salary gains (S3) were independent of low tuition (T1), then P(S3 | T1) = P(S3).

- What do you conclude about events S3 and T1?

Contingency Tables

- Relative Frequencies

- Calculate the relative frequencies below for each cell of the cross-tabulation table to facilitate probability calculations.

- Symbolic notation for relative frequencies:

Contingency Tables

- Relative Frequencies

- Here are the resulting probabilities (relative frequencies). For example,

P(T1 and S1) = 5/67

P(T2 and S2) = 11/67

P(T3 and S3) = 15/67

P(S1) = 17/67

P(T2) = 19/67

Contingency Tables

- Relative Frequencies

- The nine joint probabilities sum to 1.0000 since these are all the possible intersections.

- Summing the across a row or down a column gives marginal probabilities for the respective row or column.

Contingency Tables

- Example: Payment Method and Purchase Quantity

- A small grocery store would like to know if the number of items purchased by a customer is independent of the type of payment method the customer chooses to use.

- Why would this information be useful to the store manager?

- The manager collected a random sample of 368 customer transactions.

Contingency Tables

- Example: Payment Method and Purchase Quantity

- Here is the contingency table of frequencies:

- Calculate the marginal probability that a customer will use cash to make the payment.

Contingency Tables

- Example: Payment Method and Purchase Quantity

- Let C be the event cash.

P(C) =

126/368 =

.3424

- Now, is this probability the same if we condition on number of items purchased?

Contingency Tables

- Example: Payment Method and Purchase Quantity

P(C | 1-5)

= 30/88

= .3409

P(C | 6-10)

= 46/135

= .3407

P(C | 10-20)

= 31/89

= .3483

P(C | 20+)

= 19/56

= .3393

- P(C) = .3424, so what do you conclude about independence?

- Based on this, the manager might decide to offer a cash-only lane that is not restricted to the number of items purchased.

Contingency Tables

- How Do We Get a Contingency Table?

- Contingency tables require careful organization and are created from raw data.

- Consider the data of salary gain and tuition for n = 67 top-tier MBA schools.

Once coded, tabulate the frequency in each cell of the contingency table using MINITAB’s

Stat | Tables | Cross Tabulation

Contingency Tables

- How Do We Get a Contingency Table?

- The data should be coded so that the values can be placed into the contingency table.

Tree Diagrams

- What is a Tree?

- A tree diagram or decision tree helps you visualize all possible outcomes.

- Start with a contingency table.

- For example, this table gives expense ratios by fund type for 21 bond funds and 23 stock funds.

Tree Diagrams

- What is a Tree?

- To label the tree, first calculate conditional probabilities by dividing each cell frequency by its column total.

= .5238

- For example,

= 11/21

P(L | B)

- Here is the table of conditional probabilities

- The tree diagram shows all events along with their marginal, conditional and joint probabilities.

Tree Diagrams

- What is a Tree?

- To calculate joint probabilities, use

P(AB) = P(A | B)P(B) = P(B | A)P(A)

- The joint probability of each terminal event on the tree can be obtained by multiplying the probabilities along its branch.

- For example,

P(BL)

= P(L | B)P(B)

= (.5238)(.4773)

= .2500

Tree Diagrams

- Tree Diagram for Fund Type and Expense Ratios

Bayes’s Theorem

- Thomas Bayes (1702-1761) provided a method (called Bayes’s Theorem) of revising probabilities to reflect new probabilities.

- The prior (marginal) probability of an event B is revised after event A has been considered to yield a posterior (conditional) probability.

- Bayes’s formula is:

Bayes’s Theorem

- Bayes’s formula begins as:

- In some situations P(A) is not given. Therefore, the most useful and common form of Bayes’s Theorem is:

False Negative

False Positive

96% of time

4% of time

1% of time

99% of time

Bayes’s Theorem

- How Bayes’s Theorem Works

- Consider an over-the-counter pregnancy testing kit and it’s “track record” of determining pregnancies.

- If a woman is actually pregnant, what is the test’s “track record”?

- If a woman is not pregnant, what is the test’s “track record”?

Bayes’s Theorem

- How Bayes’s Theorem Works

- Suppose that 60% of the women who purchase the kit are actually pregnant.

- Intuitively, if 1,000 women use this test, the results should look like this.

Bayes’s Theorem

- How Bayes’s Theorem Works

- Of the 580 women who test positive, 576 will actually be pregnant.

- So, the desired probability is:

P(Pregnant│Positive Test) = 576/580 = .9931

- From the contingency table, we know that:

Bayes’s Theorem

- How Bayes’s Theorem Works

- Now use Bayes’s Theorem to formally derive the result P(Pregnant | Positive) = .9931:

- First defineA = positive test B = pregnantA' = negative test B' = not pregnant

- And the compliment of each event is:

P(A | B) = .96P(A | B') = .01P(B) = .60

P(A' | B) = .04P(A' | B') = .99 P(B') = .40

P(A | B)P(B)

P(B | A) =

P(A | B)P(B) + P(A | B')P(B')

(.96)(.60)

=

(.96)(.60) + (.01)(.40)

.576

.576

=

=

=

.9931

.576 + .04

.580

Bayes’s Theorem

- How Bayes’s Theorem Works

- So, there is a 99.31% chance that a woman is pregnant, given that the test is positive.

Bayes’s Theorem

- How Bayes’s Theorem Works

- Bayes’s Theorem shows us how to revise our prior probability of pregnancy to get the posterior probability after the results of the pregnancy test are known.

- Bayes’s Theorem is useful when a direct calculation of a conditional probability is not permitted due to lack of information.

Bayes’s Theorem

- How Bayes’s Theorem Works

- A tree diagram helps visualize the situation.

Bayes’s Theorem

- How Bayes’s Theorem Works

The 2 branches showing a positive test (A) comprise a reduced sample space B A and B' A,

so add their probabilities to obtain the denominator of the fraction whosenumerator is P(B A).

Bayes’s Theorem

- General Form of Bayes’s Theorem

- A generalization of Bayes’s Theorem allows event B to be polytomous (B1, B2, … Bn) rather than dichotomous (B and B').

Bayes’s Theorem

- Example: Hospital Trauma Centers

- Based on historical data, the percent of cases at 3 hospital trauma centers and the probability of a case resulting in a malpractice suit are as follows:

- let event A = a malpractice suit is filedBi= patient was treated at trauma center i

0.

Bayes’s Theorem

- Example: Hospital Trauma Centers

- Applying the general form of Bayes’ Theorem, find P(B1 | A).

Bayes’s Theorem

- Example: Hospital Trauma Centers

- Conclude that the probability that the malpractice suit was filed in hospital 1 is .1389 or 13.89%.

- All the posterior probabilities for each hospital can be calculated and then compared:

= 10,000x.2

= 10,000x.3

= 10,000x.5

= 5,000 - 5

= 2,000 x .008

= 3,000 x .005

= 5,000 x .001

= 3,000 - 15

= 1,984 - 16

Bayes’s Theorem

- Example: Hospital Trauma Centers

- Intuitively, imagine there were 10,000 patients and calculate the frequencies:

Bayes’s Theorem

- Example: Hospital Trauma Centers

- Now, use these frequencies to find the probabilities needed for Bayes’ Theorem.

- For example,

Bayes’s Theorem

- Example: Hospital Trauma Centers

- Consider the following visual description of the problem:

Bayes’s Theorem

- Example: Hospital Trauma Centers

- The initial sample space consists of 3 mutually exclusive and collectively exhaustive events (hospitals B1, B2, B3).

Bayes’s Theorem

- Example: Hospital Trauma Centers

- As indicated by their relative areas, B1is 50% of the sample space, B2 is 30% and B3 is 20%.

30%

50%

20%

P(B2 | A)

P(B3 | A)

P(B1 | A)

Bayes’s Theorem

- Example: Hospital Trauma Centers

- But, given that a malpractice case has been filed (event A), then the relevant sample space is reduced to the yellow area of event A.

- The revised probabilities are the relative areas within event A.

Counting Rules

- Fundamental Rule of Counting

- If event A can occur in n1 ways and event B can occur in n2 ways, then events A and B can occur in n1 x n2 ways.

- In general, m events can occurn1 x n2 x … x nm ways.

Counting Rules

- Example: Stock-Keeping Labels

- How many unique stock-keeping unit (SKU) labels can a hardware store create by using 2 letters (ranging from AA to ZZ) followed by four numbers (0 through 9)?

- For example, AF1078: hex-head 6 cm bolts – box of 12RT4855: Lime-A-Way cleaner – 16 ounceLL3319: Rust-Oleum primer – gray 15 ounce

Counting Rules

- Example: Stock-Keeping Labels

- View the problem as filling six empty boxes:

- There are 26 ways to fill either the 1st or 2nd box and 10 ways to fill the 3rd through 6th.

- Therefore, there are 26 x 26 x 10 x 10 x 10 x 10 = 6,760,000 unique inventory labels.

Counting Rules

- Example: Shirt Inventory

- L.L. Bean men’s cotton chambray shirt comes in 6 colors (blue, stone, rust, green, plum, indigo), 5 sizes (S, M, L, XL, XXL) and two styles (short and long sleeves).

- Their stock might include 6 x 5 x 2 = 60 possible shirts.

- However, the number of each type of shirt to be stocked depends on prior demand.

Counting Rules

- Factorials

- The number of ways that n items can be arranged in a particular order is nfactorial.

- n factorial is the product of all integers from 1 to n.

n! = n(n–1)(n–2)...1

- Factorials are useful for counting the possible arrangements of any n items.

- There are n ways to choose the first, n-1 ways to choose the second, and so on.

Counting Rules

- Factorials

- As illustrated below, there are n ways to choose the first item, n-1 ways to choose the second, n-2 ways to choose the third and so on.

Counting Rules

- Factorials

- A home appliance service truck must make 3 stops (A, B, C).
- In how many ways could the three stops be arranged?

3! = 3 x 2 x 1 = 6

- List all the possible arrangements:

{ABC, ACB, BAC, BCA, CAB, CBA}

- How many ways can you arrange 9 baseball players in batting order rotation?

9! = 9 x 8 x 7 x 6 x 5 x 4 x 3 x 2 x 1 = 362,880

Counting Rules

- Permutations

- A permutation is an arrangement in a particular order of r randomly sampled items from a group of n items and is denoted by nPr

- In other words, how many ways can the r items be arranged, treating each arrangement as different (i.e., XYZ is different from ZYX)?

Counting Rules

- Example: Appliance Service Cans

- n = 5 home appliance customers (A, B, C, D, E) need service calls, but the field technician can service only r = 3 of them before noon.

- The order is important so each possible arrangement of the three service calls is different.

- The number of possible permutations is:

ABC, ACB, BAC, BCA, CAB, CBA

Counting Rules

- Example: Appliance Service Cans

- The 60 permutations with r = 3 out of the n = 5 calls can be enumerated.

- There are 10 distinct groups of 3 customers:

- Each of these can be arranged in 6 distinct ways:

ABCABDABEACD

ACE

ADEBCDBCEBDE

CDE

- Since there are 10 groups of 3 customers and 6 arrange-ments per group, there are 10 x 6 = 60 permutations.

Counting Rules

- Combinations

- A combination is an arrangement of r items chosen at random from n items where the order of the selected items is not important (i.e., XYZ is the same as ZYX).

- A combination is denoted nCr

Counting Rules

- Example: Appliance Service Calls Revisited

- n = 5 home appliance customers (A, B, C, D, E) need service calls, but the field technician can service only r = 3 of them before noon.

- This time order is not important.
- Thus, ABC, ACB, BAC, BCA, CAB, CBA would all be considered the same event because they contain the same 3 customers.

- The number of possible combinations is:

Counting Rules

- Example: Appliance Service Calls Revisited

- 10 combinations is much smaller than the 60 permutations in the previous example.

- The combinations are easily enumerated:

ABC, ABD, ABE, ACD, ACE, ADE, BCD, BCE, BDE, CDE

Applied Statistics in Business and Economics

End of Chapter 5