Session 5: Quantitative Research Methods descriptive research

1. Session 5: Quantitative Research Methods�descriptive research SP ED 6610 Introduction to Research Design Summer 2004

2. Clean-cut men have fewer strokes 20 year study 2,438 middle-aged Welsh men Men who don�t shave regularly� Were less likely to be married Were more likely to be blue-collar workers Had a 45% higher death rate Had a 70% higher risk for stroke Were shorter Were more likely to suffer from angina What type of design? Does not shaving cause these things? What are alternate explanations? Non-shavers smoked more, 7 lead unhealthier lifestyles. Even when control for smoking and lifestyle, difference existed.What type of design? Does not shaving cause these things? What are alternate explanations? Non-shavers smoked more, 7 lead unhealthier lifestyles. Even when control for smoking and lifestyle, difference existed.

3. Descriptive Research Purpose To describe the way things are Or �what is� Many of the methods used, can also be used for correlational research Difference is the purpose describing v. examining a relation Two main types Surveys Observations Method type I often used to describe design. E.g., survey researchMethod type I often used to describe design. E.g., survey research

4. Surveys Two general formats Questionnaire Interview Some people think surveys are easier �Oh, I�ll just type it up and send them out.� Explicit design and thoughtful subject selection are very important to the concept of control Always pilot test the instrument So when reading a study of a survey, pay close attention to design and selectionSo when reading a study of a survey, pay close attention to design and selection

5. Questionnaires May be Distributed by: Hand Each method has its own strengths and weaknesses.Each method has its own strengths and weaknesses.

6. Questionnaires (cont.) Important points to consider Response/Nonresponse rates The % of recipients that actually completed the survey (or didn�t return it) Structure Overall look of survey Professional? Easy to understand? Spacing of items or responses Type of items Open-ended Closed response Nonresponse rate: Why important? Differential selection�may be something different about the people who didn�t respond. Overall look: professional? Improves response rate. Closed = circle best, rank, etc. Most surveys used mainly closed.Nonresponse rate: Why important? Differential selection�may be something different about the people who didn�t respond. Overall look: professional? Improves response rate. Closed = circle best, rank, etc. Most surveys used mainly closed.

7. Simulation 6.1 You have recently been employed by Monolith Oil Corporation as a research associate. Due to the energy crisis, Monolith executives have decided that they should become aware of the opinions of consumers. As you arrive on the job, you are summoned to the president�s office regarding a questionnaire study that has been conducted on consumer views of the energy problem. By way of background, you are told that the problem is one of what appears to be a very negative response (the consumers did not believe that there was an energy crisis, but that the oil companies were reaping unjustifiable profits from the public). Obviously, this is not what the president wants to hear, and so you are being asked to show how the study was conducted incorrectly. Disregard your personal opinions for the moment and consider the facts surrounding the study. The questionnaire was six pages long, it was mailed to respondents with no follow-up, and there was a 10 percent response. Tactfully give the president advice. What information would you give the president? Was the study conducted correctly? If not, what would you suggest?Tactfully give the president advice. What information would you give the president? Was the study conducted correctly? If not, what would you suggest?

8. Interviews may be conducted Face-to-face

9. Interviews (cont.) Important points to consider Structure of interview Very detailed questions and series of questions Or open-ended? Script for interviewer to read Characteristics of the interviewer Personal characteristics (ethnicity, age, sex) Communication skills/behavior Appearance How are responses recorded? Paper Computer Audio or videotape Why use a script? CONTROL!!! Record responses: for longer responses or when it�s important to get actual real-time quote, record.Why use a script? CONTROL!!! Record responses: for longer responses or when it�s important to get actual real-time quote, record.

10. Simulation 6.2 You have been asked to serve as a consultant with the department of sociology of Northern Delta University which is undertaking an interview study in a predominantly black neighborhood in Detroit. The researchers are relatively inexperienced in terms of interview studies and have asked your advice regarding the procedures that should be used. What would you suggest?What would you suggest?

11. Observations Observer should NOT be a participant in the setting Nonparticipant observation Two types of settings Naturalistic Simulation

12. Observations (cont.) Important points Variables to observe should be well-detailed Observable Measurable Training of observers How was it done? How long did it take? How successful was it (i.e., how consistent are they)? Interobserver reliability Make sure observers are consistent Recheck at various points throughout study Like a good objective on an IEP!!! Disruptive behavior, off-task/on-task, paying attention�bad examples! What is adequate IOA? 80% 90%? Recheck 25-30% of observations. Like a good objective on an IEP!!! Disruptive behavior, off-task/on-task, paying attention�bad examples! What is adequate IOA? 80% 90%? Recheck 25-30% of observations.

13. Observations (cont.) Important Points How are observations recorded? Paper Computer Videotaped Recording methods Continuous Interval Whole Partial Momentary time sampling Continuous: set aside a time period (ex. 30 minutes) record for whole time. Interval: divide set time period into interval, record whole (beh. present over entire interval) partial (beh,Continuous: set aside a time period (ex. 30 minutes) record for whole time. Interval: divide set time period into interval, record whole (beh. present over entire interval) partial (beh,

14. Observations (cont.) Important Points Data types Frequency (also called rate or tally) How often a behavior occurs within a period of time Duration How long a behavior lasts Latency How long before the behavior occurs after a trigger Intensity (also called severity) The amount or force of a behavior