1 / 39

Central Limit Theorem

Central Limit Theorem. The central limit theorem and the law of large numbers are the two fundamental theorems of probability.

amie
Download Presentation

Central Limit Theorem

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Central Limit Theorem

  2. The central limit theorem and the law of large numbers are the two fundamental theorems of probability. Roughly, the central limit theorem states that the distribution of sample means of a large number of independent, identically distributed variables will be approximately normal, regardless of the underlying distribution. The importance of the central limit theorem is hard to overstate; indeed it is the reason that many statistical procedures work.

  3. Your task today… • Is to be a noticer • As you see each slide ask yourself: • What do I notice?

  4. Intro to CLT • We will begin by drawing samples from a population that has a uniform distribution. • The scores in the population range from 1 to 5.  The mean of the population is 3.0 and the standard deviation of the population is 1.41 [μ=3.0; σ =1.41]. • Each level of the variable had the same probability of occurring. The population distribution is presented left.

  5. Six successive samples… • Let’s start small and draw 6 samples randomly from the uniform population presented on the previous page. • Each sample has only 5 subjects (N=5). The central limit theorem requires that all samples must have the same sample size. The distribution of scores in each of these samples is presented below. • The sample mean is shown in blue.

  6. Distribution of sample means • What do you notice?

  7. 25 additional sample means…

  8. Frequency Distribution • What do you notice? • Let's see what happens when we randomly select 100 samples from the same population.

  9. Compare and Contast it • Remember these sample means were taken from a uniform distribution! • Compare and contrast this to the two previous frequency distributions…

  10. Compare and Contrast it • We can see that this distribution of sample means is even closer to a normal distribution than the distributions calculated with 6 and 25 samples. • The mean of this distribution is quite close to the population mean of 3 • The standard deviation is smaller than the population standard deviation of 1.41

  11. Infinite samples • Let's see what would happen if we were to randomly select an "infinite" number of samples from the same population.

  12. What do you notice? • The sampling distribution of the mean is normally distributed. • The mean of the normal distribution is the same as the population mean. • The standard deviation of the normal distribution is equal to the population standard deviation divided by the square root of the sample size.

  13. Summary so far

  14. Let’s increase the sample size. • Let’s increase the sample size from 5 to 25…

  15. What do you notice

  16. Let’s increase n to 100… • What do you notice? • What does this say about sample size?

  17. Central Limit Theorem • The central limit theorem states that when an infinite number of successive random samples are taken from a population, the sampling distribution of the means of those samples will become approximately normally distributed with mean μ and standard deviation σ/√ N as the sample size (N) becomes larger, irrespective of the shape of the population distribution.

  18. Sample Size • What do you noitce? – fill in on handout

  19. What can we see from these comparisons? • With " infinite" numbers of successive random samples, the sampling distributions all have a normal distribution with a mean of 3.0, which is equal to the population mean (µ= 3.0). • As the sample sizes increase, the variability of each sampling distribution decreases. The range of the sampling distribution is smaller than the range of the original population. • The standard deviation of each sampling distribution is equal to σ/√N (where N is the size of the sample drawn from the population). • Taken together, these distributions suggest that the sample mean provides a good estimate of µ and that errors in our estimates (indicated by the variability of scores in the distribution) decrease as the size of the samples we draw from the population increases.

  20. Starting with a Poisson Distribution

  21. Starting with a Normal Distribution

  22. Standard error of the mean Sampling distribution of the mean Sample means normal distribution Sample error of the estimate You randomly draw an infinite number of samples of 10 subjects from a population, calculate the mean for each sample, and plot the sample means. The distribution that you obtain from plotting sample means is called the… Lecture Quiz – Question One

  23. B. Sampling distribution of the mean Answer:

  24. The sampling distributions of all statistics eventually become perfectly normally distributed. There are never outliers that will affect the distribution when you take over 25 samples. He took a large number of large samples from the population. The population from which it was drawn was normally distributed. A colleague plots a set of sample means drawn from 100 successive samples of 50 subjects. He is not sure what the distribution should look like and asks for your opinion. You tell him that the distribution should be approximately normally distributed and fairly smooth because… Question 2

  25. Answer C. He took a large number of large samples from the population.

  26. Which of the following distributions is most likely if you draw 15 samples of 6 subjects from a population whose distribution is unknown, calculate the mean of each sample, and graph the values of the sample means… Question 3 A. B. C. D. Can’t be determined

  27. Answer A.

  28. The central limit theorem gives the exact probability of estimating the true mean. The central limit theorem only applies when the population distribution is normal. The range of values for the sampling distribution of means is larger than the range of scores in the population. The central limit theorem requires that all samples are randomly selected from a single population. Which of these statements is true? Question 4

  29. Answer: D. The central limit theorem requires that all samples are randomly selected from a single population.

  30. The central limit theorem states that the standard deviation of the mean must equal the: Sample standard deviation Population standard deviation Standard deviation of the distribution of sample means Average of scores across all random samples selected. Question 5

  31. Answer: C. Standard deviation of the distribution of sample means

  32. It is the easiest measure of central tendency to calculate on all the separate samples. The mean of the sampling distribution of the mean is always equal to μ. The sampling distribution of μ is always close to the sample means. Infinite sampling from a defined population is always more accurate than random sampling. How does the central limit theorem show us that the mean is a good estimator of the population mean (μ)? Question 6

  33. Answer B. The mean of the sampling distribution of the mean is always equal to μ.

  34. The standard error of the mean is always smaller. The standard error of the mean is always larger. The standard error is sometimes smaller and sometimes larger depending on sample size. The standard error is only smaller than the population standard deviation when the population follows a Poisson distribution. When comparing the size of the standard error of the mean with the size of the population standard deviation: Question 7

  35. Answer • The standard error of the mean is always smaller.

  36. When graphing the sampling distribution of the mean, the x-axis represents the: Sample size Population parameter Value of the sample mean Frequency occurrence Question 8

  37. Answer C. Value of the sample mean

  38. A statistics text presents the following sampling distribution: Which of the following graphs is most likely to represent the population from which it was drawn? Can’t be determined because the central limit theorem applies to any population distribution. Question 9

  39. Answer D. Can’t be determined because the central limit theorem applies to any population distribution.

More Related