1 / 27

London, Dec 13, 2012

London, Dec 13, 2012. British Academy of Management Linking Research Questions to Appropriate Designs. What is the best design?. Randomized controlled study? Grounded theory a pproach? Cohort / panel study? Qualitative field research? Longitudinal study?

rangle
Download Presentation

London, Dec 13, 2012

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. London, Dec 13, 2012 British Academy of Management Linking Research Questions to Appropriate Designs

  2. What is the best design? • Randomized controlled study? • Grounded theory approach? • Cohort / panel study? • Qualitative field research? • Longitudinal study? • Post-test only study? • Survey? • Action research? • Case study?

  3. What is the BEST car?

  4. (more / less appropriate)

  5. What is the best design? quants vsquallies, positivists vs post structuralist, etc

  6. on the research question

  7. Types of questions Does it work? Does it work better than ....? Does it have an effect on ....? What is the success factor for ....? What is required to make it work ...? Will it do more good than harm? Effect

  8. Types of questions: non-effect Needs: What do people want or need? Attitude: What do people think or feel? Experience: What are peoples’ experiences? Prevalence: How many / often do people / organizations ...? Procedure: How can we implement ...? Process: How does it work? Explanation: Why does it work? Economics: How much does it cost?

  9. Effect vs Non-effect

  10. Internal validity

  11. Internal validity internal validity = indicates to what extent the results of the research may be biased and is thus a comment on the degree to which alternative explanations for the outcome found are possible.

  12. Causal relations We are pattern seeking primates: we are predisposed to see order and causal relations in the world

  13. Causality So, when do we know there is causal relation? Three criteria: the "cause" and the "effect" are related the "cause" precedes the "effect" in time there are no plausible alternative explanations for the observed effect

  14. ‘Effect’ questions Considerations for research: effect size before and after measurement randomization, blinding, control group Are the "cause" and the "effect” related? Does the "cause" precede the "effect" in time? Are there no plausible alternative explanations for the observed effect?

  15. Bias & Confounding Research shows: Shoe size > quality of handwriting Smoking youngsters > better lung function

  16. Research shows: Charismatic leaders Successful companies

  17. Levels of internal validity

  18. Which design for which question? Explanation

  19. Different types of research questions require different types of research designs, but ...

  20. But 1: feasibility Best research design?

  21. But 1: feasibility

  22. But 2: it’s a trade off • All research designs are flawed – though each is flawed differently: • Controlled studies: high internal validity, but sometimes less suited to generalization • Surveys and field research: low internal validity, but sometimes more useful for management practice. McGrath, J. (1981). Dilemmatics, The Study of Research Choices and Dilemmas. American Behavioral Scientist, 25(2).

  23. SO: Evidence accrual requires convergence of findings derived from multiple studies that research the same constructs and variables with different research designs and in different contexts.

  24. But 3: stage of development The appropriateness of a research design is also determined by the body of evidence’s stage of development. mature: extensively studied > controlled studies to identify independent, dependent and moderating variables nascent: open-ended the research questions > exploratory qualitative studies to shape the understanding of the topic . Edmondson, A. C., & McManus, S. E. (2007). Methodological fit in management field research. Academy of Management Review, 32(4), 1155-1179.

  25. Figure 5: Controlled vs uncontrolled studies

  26. In summary • Different types of research questions require different types of research designs, but ... • feasibility • past research • stage of development • also have to be taken into account!

More Related