1 / 22

Interpreting and Generalizing your Results

Interpreting and Generalizing your Results. Psych 231: Research Methods in Psychology. Announcements. This week in labs: POSTER SESSIONS Jen has final papers available at her office hours (not in class today) Amanda’s may be done by labs this week. Research Results. Goal of Research

tracy
Download Presentation

Interpreting and Generalizing your Results

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Interpreting and Generalizing your Results Psych 231: Research Methods in Psychology

  2. Announcements • This week in labs: POSTER SESSIONS • Jen has final papers available at her office hours (not in class today) • Amanda’s may be done by labs this week

  3. Research Results • Goal of Research • Experiments: • To establish a cause and effect relationship between independent and dependent variables • Correlational studies • To determine potential relationships between different variables

  4. Interpretation of your results • Statistical significance • Tell us if differences or (relationships with correlations) go beyond what we’d expect by chance • Don’t tell us anything about what the result really means in theoretical terms

  5. Interpretation of your results • Theoretical Significance • Return to your theory(ies) • Reject them? • Support (not prove) them? • Revise them? • What are the limitations of your interpretations? • Are there alternative theories still to test? • Yes, there are always going to be alternatives (not always good ones) • Do your results generalize well?

  6. Generalizing results • External validity revisited • What limits/constraints were imposed because of: • the use of experimental control • availability of resources • Participant factors (who did you test?) • Volunteers • College students • Sex • Culture • Location/setting factors (where did you test?) • College • Region • Laboratory

  7. Generalizing results • Experimenter factors • Personality, sex, experience as experiementer • Experimental items • Do the results only apply to the stimuli that you used, or would they extend to others • E.g., memory for: • cat, dog, truck, car, … all concrete objects • Would the same pattern of results be seen for: • call, dig, truth, cut, … more abstract concepts • cath, dob, trush, caf, … all non words

  8. Threats to external validity as interactions • Generalization as interactions • Does your theory (or anyone else’s) predict an interaction? • If you collect the appropriate data/controls, you can do some statistical tests

  9. In defense of college students • Convenient? • Yes, but not because researchers are lazy • Researchers do have limited resources • Criticisms about generalizability need to be backed up with theory and/or data • College students are after all humans • Replications with other samples provide a safegaurd against limited generalizability

  10. Replications • Importance of replications • Demonstrate that the results weren’t a “one time” thing • Single failure to replicate - don’t panic • Repeated failure to replicate - original results probably wrong (maybe a Type I error)

  11. Replications • Types of replications • Exact replications • Replication of the research as precisely as possible • Conceptual replications • Same independent variables, but measured in a different way • Same conceptual variables, different operational variables

  12. Increasing External Validity • Aggregation • Grouping together data • Over participants • Over stimuli or situations • Over trials or occasions • Over measures (converging operations)

  13. Increasing External Validity • Non-reactive measurements • Unobtrusive measures • Observation without participant awareness • Naturalistic observation • To validate experimental findings • Field experiments • Experimentation outside of the lab

  14. Example • Results from Lab studies • Self awareness reduces likelihood of people engaging in socially undersirable behaviors (e.g., cheating or lying)

  15. Beaman, Klentz, Diener, & Sanum (1979)

  16. “Hi, what’s your name?” Nont Anonymous “Hi, what are you dressed as?” Anonymous

  17. No Mirror Mirror Nont Anonymous Anonymous

  18. Please take only one piece of candy

  19. No Mirror Mirror 8% 38% Nont Anonymous 18% 19% Anonymous

  20. The big picture • Generalizing your to the outside world • The bottom of the hourglass • How do these results impact … • Not always stated in the report • But, should always be in the back of your mind. • why are you doing the research? • why is it important? • who will benefit from this research?

  21. Next time • Review of course

More Related