1 / 52

520 likes | 653 Views

Part 2: Quantitative Methods. October 2, 2006. Sampling. High School Sports Officials Students enrolled in 5th grade in NM schools Albuquerque Residents The U.S. Electorate. National Association of Sports Officials Membership New Mexico 5th graders Albuquerque Phone Book

Download Presentation
## Part 2: Quantitative Methods

**An Image/Link below is provided (as is) to download presentation**
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.
Content is provided to you AS IS for your information and personal use only.
Download presentation by click this link.
While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

**Part 2: Quantitative Methods**October 2, 2006**High School Sports Officials**Students enrolled in 5th grade in NM schools Albuquerque Residents The U.S. Electorate National Association of Sports Officials Membership New Mexico 5th graders Albuquerque Phone Book Registered Voters Target vs. Accessible Population**The**Inferential size of sample Leap Simple Random Sampling volunteers Population Validity Systematic Sampling Sampling Random Sampling Stratified Error Processes Procedures Sampling Cluster Sampling Pros Selection Biased Convenience and and Sampling Sampling Cons Assignment**Simple Random Sampling**1 092725 012157 827052 297980 625608 964134 2 104460 007903 484595 868313 274221 367181 3 676071 388003 266711 323324 044463 762803 4 881878 862385 203886 261061 096674 811548 5 534500 336348 086585 241740 581286 008435 6 094276 615776 242112 985859 075388 082003 1. Andrea 2. Tina 3. Paul 4. Wilbur 5. Sandra 6. Kathy 7. Jim 8.George 9. Emir 10. Becky 11. Sharon 12. Gladys 13. Jose 14. Bill 15. Sue 16. Erica 17. Aaron 18. Fred 19. Pam 20. Roger**Stratified Random Sampling**1 092725 012157 827052 297980 625608 964134 2 104460 007903 484595 868313 274221 367181 3 676071 388003 266711 323324 044405 762803 4 881878 862308 203886 261061 096674 811548 5 534500 336348 086585 241740 581286 008435 6 094276 615776 242112 985859 075388 082003 6. Paul 7. Wilbur 8. Jim 9. George 10. Emir 1. Andrea 2. Tina 3. Kathy 4. Sandra 5. Becky 6. Sharon 7. Gladys 8. Sue 9. Erica 10. Pam 1. Jose 2. Bill 3.Aaron 4. Fred 5. Roger**Systematic Sampling**• Say you have a target population that has a 100,000 members. • And: • A list is available. • You need 1,000 cases for your sample. • 100,000/1000 = 100. • Select a random number from table. • Then select every 100th case.**Cluster Sampling**• Naturally occurring groups. • State, district, school, classroom, student. • Randomly sample from one level then survey, interview, etc. • Multistage sampling. • Randomly select from one level. • Then randomly select within that level.**Convenience Sampling**• Why convenient? • Sample that is located near the researcher • Connections with administrator or staff • Researcher is familiar with the setting • Data is already available • Shortcomings of convenience samples?**Volunteers in Sampling**• How might volunteers differ? • Children having parental permission • More academically competent • More popular with peers • More physically attractive • Less likely to smoke or use drugs • More likely to be white • More likely to come from two-parent household • More likely to be involved in extracurricular activities • Less likely to be socially withdrawn • Less likely to be aggressive**Size of the Sample**• Bigger is (usually) better. • Unless? • How big is big? Power analysis. • Practical issues. • Attrition. • Reliability. • Cost/ benefit.**Correlation& Instrumentation**Reliability and Validity**Correlation Coefficients**• Pearson product-moment correlation • The relationship between two variables of degree. • Positive: As one variable increases (or decreases) so does the other. • Negative: As one variable increases the other decreases. • Magnitude or strength of relationship • -1.00 to +1.00 • Correlation does not equate to causation**Correlations**• Thickness of scatter plot determines strength of correlation, not slope of line. • For example see: • http://noppa5.pc.helsinki.fi/koe/corr/cor7.html • Remember correlation does not equate to causation.**Operationism vs. Essentialism**• According to Stanovich • What are they? • How do they differ?**Essentialist**• Like to argue about the meaning of our terms • “What does the theoretical concept really mean?” • Must have a complete and unambiguous understanding of the language involved. • Operationism • Link concepts to observable events that can be measured. • Concepts in science related to a set of operations. • Several slightly different tasks and behavioral events are used to converge on a concept.**Validity and Reliability**• Validity is an important consideration in the choice of an instrument to be used in a research investigation • It should measure what it is supposed to measure • Researchers want instruments that will allow them to make warranted conclusions about the characteristics of the subjects they study • Reliability is another important consideration, since researchers want consistent results from instrumentation • Consistency gives researchers confidence that the results actually represent the achievement of the individuals involved**Reliability**• Test-retest reliability • Inter-rater reliability • Parallel forms reliability • Internal consistency (a.k.a. Cronbach’s alpha)**Validity**• Face • Does it appear to measure what it purports to measure? • Content • Do the items cover the domain? • Construct • Does it measure the unobservable attribute that it purports to measure?**Validity**• Criterion • Predictive • Concurrent • Consequential**Types of validity (cont.)**Here the instrument samples some and only of the construct**Types of validity**Here the instrument samples all and more of the construct**The construct**Here the instrument fails to sample ANY of the construct The instrument**The construct**Here the instrument samples some but not all of the construct The instrument**In groups of 3 to 4**• Sampling • What is the target population? • What sampling procedure was used? • Do you think the sample is representative? • Why or why not? • Measurement • What types of reliability and validity evidence are provided? • What else would you like to know?**Ways to Classify Instruments**• Who Provides the Information? • Themselves: Self-report data • Directly or indirectly: from the subjects of the study • From informants (people who are knowledgeable about the subjects and provide this information)**Rating scales**Interview schedules Tally sheets Flowcharts Performance checklists Observation forms Types of Researcher-completed Instruments**Excerpt from a Behavior Rating Scale for Teachers**Instructions: For each of the behaviors listed below, circle the appropriate number, using the following key: 5 = Excellent, 4 = Above Average, 3 = Average, 2 = Below Average, 1 = Poor. A. Explains course material clearly. 1 2 3 4 5 B. Establishes rapport with students. 1 2 3 4 5 C. Asks high-level questions. 1 2 3 4 5 D. Varies class activities. 1 2 3 4 5**Excerpt from a Graphic Rating Scale**Instructions: Indicate the quality of the student’s participation in the following class activities by placing an X anywhere along each line. Always Frequently Occasionally Seldom Never 1. Listens to teacher’s instructions. Always Frequently Occasionally Seldom Never 2. Listens to the opinions of other students. Always Frequently Occasionally Seldom Never 3. Offers own opinions in class discussions.**Questionnaires**Self-checklists Attitude scales Personality inventories Achievement/aptitude tests Performance tests Projective devices Types of Subject-completed Instruments**Item Formats**• Questions used in a subject-completed instrument can take many forms but are classified as either selection or supply items. • Examples of selection items are: • True-false items • Matching items • Multiple choice items • Interpretive exercises • Examples of supply items are: • Short answer items • Essay questions

More Related