MIS 650 Generating Knowledge: Some Methodological Issues

1. MIS 650Generating Knowledge: Some Methodological Issues MIS 650 Knowledge Generation

2. Background Information systems research is by necessity multidisciplinary. Our focus is on usersof technology in context. This automatically implies a social-scientificecological approach. However, because we are concerned with motives, goals, and plans, we of necessity will look at images, expressions, and strategies; these imply humanistic approaches also. Our roots, however, are in maths and computer science and imply a tendency to see the world in scientific and systems terms. This implies a scientific or systems scientific method. On the other hand, IS tends to construct, modify and attempt improvement; we sometimes adopt an engineering or medical approach. It’s a stew of methods! MIS 650 Knowledge Generation

3. Understanding Research • Goal of our enterprise isknowledge • Knowledge requires research [from the Latin word cicare to explore from circus, a ring from IE root *(s)ker- to turn, bend] • Research requires a phenomenon, an observation method, and an interpretive scheme(-a). • Research issues centre on the phenomena, the methods and the schemes. MIS 650 Knowledge Generation

4. Modeling Research • Research requires a phenomenon, an observation method, and an interpretive scheme(-a). “This says That is These” MIS 650 Knowledge Generation

5. Modeling Research • APhenomenon has locale, temporal status, antecedents, consequents, etc. • The phenomena, taken as a group, are a field of study. Where temporal status is fleeting and antecedents and consequents are difficult to define or observe, research is difficult. MIS 650 Knowledge Generation

6. Modeling Research • An observation method has procedures, resources, use characteristics, etc. • Methods that have poorly defined procedures, require a lot of resources or special users, can’t be performed reliably, or present ethical problems make for difficult situations in research MIS 650 Knowledge Generation

7. Modeling Research • An interpretive scheme(-a) has procedures, content, use characteristics, input requirements, output characteristics • This enables communication of results to interested consumers of the research. Where the procedures are “slippery” and only certain individuals can understand your interpretations, where it isn’t clear what the interpretations mean, research is problematic MIS 650 Knowledge Generation

8. Innovation in Research Gravitational Big Bang There are two different ways in which a field innovates through its ideas. (a) Big Bang: one idea or method spawns many others; soon there is specialization and different streams of research (b) Gravitational: a series of disparate ideas is drawn together to form a new line of thought or method. MIS 650 Knowledge Generation

9. Research Flow and Your Paper Chapter 1 Chapter 2 Chapter 3 Chapter 4 Chapter 5 MIS 650 Knowledge Generation

10. Research Issues Research • What is appropriate research in IS? • Do we lead or follow business? • How to avoid bias at all phases of research • Are we just researching learning? • How do we research experience? • Is anything really new? New wine in old bottles? • How central is the technology in our research? • Fatalism, determinism, particularism • Pure vs. applied research Knowledge MIS 650 Knowledge Generation

11. Methodological Issues Methods • Qualitative methods • New or different paradigms, including interpretivistic ones, action research, evaluation research • “Subtle” vs. bold effects • Problems posed by new technology, globalization, E-Commerce, etc. • Researcher bias from a variety of sources • Holding down the phenomenon long enough to measure it. Research MIS 650 Knowledge Generation

12. Qualitative Approaches Designing research for Qualitative methods Using qualitative data Problems of reliability, informants, recording Appropriate data analysis methods Interpreting results Mixed methods and triangulation MIS 650 Knowledge Generation

13. New Paradigms Interpretivistic approaches Understanding “meaning” and informants Objectivity is a problem Action research Object is to change something Researcher becomes part of the situation Evaluation research Schema is the important aspect here MIS 650 Knowledge Generation

14. Subtle Effects How do we select appropriate analysis techniques How big an effect are we looking for? What is the difference between significant (p<0.001) and SIGNIFICANT? How permanent an effect are we looking for? How broad an effect are we looking for? Does statistics matter? What will we do with the effect? [issue of control/prediction and their costs] MIS 650 Knowledge Generation

15. The New Technologies The new technologies are pervasive: how to select a level of phenomenon and to sample from what sampling frame. The new technologies are global: how to overcome cultural problems and bias The new technologies are expensive: what to learn from a trial and how much technology is employ. MIS 650 Knowledge Generation

16. Researcher Bias Sources of bias include the The researcher, conscious or unconscious The researcher’s milieu(x), Society at large, The economics of research and resulting social pressures MIS 650 Knowledge Generation

17. Slippery Phenomena How do we select appropriate analysis techniques How big an effect are we looking for? What is the difference between significant (p<0.001) and SIGNIFICANT? How permanent an effect are we looking for? How broad an effect are we looking for? Does statistics matter? What will we do with the effect? [issue of control/prediction and their costs] MIS 650 Knowledge Generation

18. Other Issues in Methodology, some very specific indeed 1. ICT convergence: Level of aggregation 2. Ethics: informed consent, esp. in interventions 3. Use of students or other disadvantaged participants 4. “Naïve” subjects? Get with the context 5. The availability of alternative explanations 6. Sampling frame, snowball sampling, convenience sampling 7. Appropriate proxies (experience, computer capability, poorly conceptualised variables) MIS 650 Knowledge Generation