Research Methods for Computer Science, HILCO

1. Research Methods for Computer Science, HILCO By TemtimAssefa Revised September, 2013

2. Learning Objectives • Explain the purpose of research • Understand basic concepts in research (constructs, relationship, indicators, research model, theory, etc) • Understand research as a scientific method to acquire knowledge • Acquire skill to formulate researchable research problems • Identify major research problems in computer engineering • Explain the different research approaches and methods (Quantitative, qualitative and design science)

3. Objective … • Justify the rational for selecting a particular research method to solve computer Science problems • Able to design research projects or research proposal • Able to collect data relevant to the research problem • Undertake validity and reliability tests of research instruments

4. Objective … • Able to interpret data into meaningful information • Acquire skill to plan, execute, and implement research projects in computer science • Able to review research articles • Able to produce publishable research articles (conference or journals, etc) • Contribute new knowledge to your discipline

5. Meaning, objective and Overview of research

6. What Research Is Not • Gathering information from resources such books or magazines isn’t a research. • It has no contribution to new knowledge. • Merely transporting facts from one resource to another doesn’t constitute research. • It has no contribution to new knowledge, although this might make existing knowledge more accessible.

7. Research is not • Research is not simply learning about something • Gathering information to know more about a certain area is different from looking at a body of data and deciding how it contributes to the solution of a problem • Research problems do not simply result in a “yes” or a “no” answer • Should able to explain why something is happened - e.g computer increases organizational efficiency but add how ?

8. Research: A Definition • “…the systematic process of collecting and analyzing information (data) in order to increase our understanding of the phenomenon about which we are concerned or interested.” • an activity that contributes to the understanding of a phenomenon [Kuhn, 1962; Lakatos, 1978]

9. Research ... • Research: • phenomenon: a set of behaviors of some entity(ies) that is found interesting by a research community • understanding: knowledge that allows prediction of the behavior of some aspect of the phenomenon • activities considered appropriate to the production of understanding (knowledge) are the research methods and techniques of a research community

10. Research Characteristics • Originates with a question or problem. • Requires clear articulation of a goal or objective. • Follows a specific plan or procedure. • Often divides main problem into sub-problems. • Guided by specific problem, question, proposition or hypothesis. • Accepts certain critical assumptions. • Requires collection and interpretation of data. • Cyclical (helical) in nature.

11. Types of Research • Basic Research • its main purpose is the disclosure of fundamental truths or principles • Focuses the testing and development of theory • To extend existing human understanding • Has no immediate application to real world problems • Example - • Physists are interested in understanding basic elements that make up matter • Computer scientist are interested to create an efficient algorithm to process data, retrieve information, etc

12. Cont’d • Applied research • To solve existing societal problems • Example - software automation like • Developing a SW that convert word files into database format • Doing payroll processing by a computer • Developing a program that copys files from a computer to a mobile phone

13. Basic Concepts in Research

14. Epistemology of Knowledge • is the branch of philosophy concerned with the nature and scope (limitations) of knowledge • It answers the following questions • What is knowledge? • How is knowledge acquired? • To what extent is it possible for a given subject or entity to be known?

15. Continued … • There is a debate between • Knowledge as objective Truth • Knowledge as subjective truth

16. Objective Truth • Knowledge exists independent of the knower • Knowledge can be measured by measuring instruments • Observed independent of the researcher • Can be quantified using different statistical methods • It is constructed by deductive methods • Research is targeted to falsify an existing truth or theory

17. Knowledge is constructed mainly through observation and experience. • Aristotle is the main supporter of this view

18. Subjective truth • Knowledge is a human construct • People born with some thought constructs that are used to interprate and give meaning what we experience • It is the human that gives meaning to real world objects • It is a social construct and exits in the language, text, etc by the human being

19. Cont’d • Knowledge is constructed by reflection, interpretation what respondent says • The researcher is part of the knowledge construction process • It is constructed by inductive method • From observations, general truths are drawn • There are as many truth as the there are a number of human beings

20. Theory • An abstraction of realities that serve as a guide for future practice • You may think theory as an absolute truth, such as the theory of gravity or the theory of relativity • Actually a changing phenomenon, especially in the soft or social sciences.  • Theories are developed based on what is observed or experienced, often times in the real world.  • Changed as we gather new facts and observe new relationship

21. Theory -- Cont’d • Dubin (1978) notes theory contains three main elements: • A set of well-defined concepts (or units); • Laws of interaction (or interrelationships between the units); • A boundary within which the theory holds. • Example • Theory of planned behavior • Design theory • Communication theory • Human Computer Interaction theory (HCI), etc

22. Theory of Planned Behavior Attitude Intention Behavior Subjective Norms Controlling Variables Source – Ajzen, 1991

23. Conceptual Framework • It is the researchers understanding of the Research Problem • It contains variables and their relationship to be investigated in the research • It serve as a guide for the research process • It is build from existing theory or prior experience of the researcher • It is accepted or modified after the collected empirical data is analyzed and interpreted

24. Conceptual Framework – uses … • are analytical schemes; • simplify reality to make it easer to discuss, analyze or research; • simplify reality by selecting certain phenomena/variables and suggesting certain • relationships between them; • are judged in terms or utility, not correctness.

25. Types of Conceptual Framework

26. Cause and Effect – explanation … • seeing other people being rewarded for acting well (vicarious reward) • and punished for acting badly (vicarious punishment); • whether people believe they control their own destinies or are at the mercy of forces beyond their control (locus of control) • and their level of moral development • increases the likelihood that people will make decisions that are ethical rather than pragmatic.

27. Type of CF … Stages in a Process • the concepts are related because they are stages in a process. • Example Project Management Problem • It starts with planning and • then proceeds through the stages of doing, • monitoring and • Revising the plan. Here the theory is represented as a circle that flows in a cycle. What about software development theory?

28. Type of CF … Hierarchical relationships • In many conceptual frameworks, concepts are related because they occupy higher or lower positions on a scale or in a hierarchy. • Example Maslow’s (1954) Need Hierarchy • physiological needs • safety needs • belongingness needs • esteem needs • self-actualisation.

29. Type of CF … Map and coordinates • You can define the relationships between concepts by plotting • them against a series of coordinates. High SW success SW Testing Low SW success User requirement Elicitation Low High

30. Theory visa-vis Conceptual Framework • Conceptual frameworks provide generalisations about processes, about the interaction of the concepts, • whereas theories provide hypotheses about the outcomes of these processes. • A conceptual framework might identify persistence, graphical buttons, user experience, etc linked with good user interface design • Theory would show how these factors can increase use of the software by different groups of users

31. Proposition • Predictions about the world are made using propositions, that is, conclusions that may be deduced logically from the theory. • It establishes one construct with another construct • It guides the research process in data collection and data analysis • Used in qualitative research methods especially in case study research

32. Proposition … Example • Proposition #1 --- ERP implementation can be successful only if there is a strong and committed leadership guiding the initiative” (Sarker and Lee 2000, p416) • “Proposition #2 ----ERP implementation can be successful only if there is open and honest communication among the stakeholders” (Sarker and Lee 2000, p416) • “Proposition #3 --- ERP implementation can be successful only if the implementation team is empowered and balanced” (Sarker and Lee 2000

33. Hypothesis • A hypothesis is an empirically testable statement that is generated from a proposition • Hypothesis is a tentative solution forwarded by the researcher based on previous theory or experience • It is expressed in terms that support collection and analysis of empirical data • Terms used in the hypothesis are “things observable” (Dubin 1978) • One proposition may generate many hypotheses

34. Cont’d • Begins with theory to identify variables • Both hypothesis and research questions are used to guide the researcher • To collect what type of data • How to analyze the collected evidences

35. Hypothesis … • Example • Graphical software interface increases SW learnability. • Cloud service reduces IT operation costs • Component based SW development increases SW project success • The deductive testing of hypotheses involves looking for disconfirming evidence to falsify hypotheses (Lee 1989). • Falsified hypotheses are then refined based on the reasons for falsification and subjected to further empirical testing.

36. Methodology • A methodology is “a system of principles, practices, and procedures applied to a specific branch of knowledge • A methodology might help researchers to produce and present high quality research results that is accepted as valuable, rigorous, and publishable in Computer Science research outlets. • Method is one component in the Methodology • Data collection method like interview • Data analysis method like open coding, correlation, regression, etc • Method of prototype system evaluation – how do you evaluate it

37. Definitions of Terms • Define each technical term as it is used in relation to your research project. • Resource – how is defined in the context of library and computer system • This helps remove significant ambiguity from the research itself by ensuring that reviewers, while they may not agree with your definitions, at least know what you’re talking about. .

38. Metrics in Research • Metrics are measures used to represent the variable • For example: • a sex variable is measured by Male or Female • Attitude is measured by likearte scale (Very strongly disagree <->Strongly Agree) • How do you measure CPU performance? • Clearly state how you measure your research variable

39. Scales of variable measurement • There are four measurement scales • Nominal – which does not show magnitude like male or famale • Ordinal – which measure magnitude but cannot quantify difference e.g poor and rich • Interval - measures magnitude and the difference between the two values • e.g age -- 10 years and 20 years • Scale – measures which has vales below zero e.g temperature

40. Know your Research Contributions • In what way(s) does your study add significant contribution(s) to: • Extant Theory? • Relevant Practice?

41. Free Access Journals • http://www.springer.com/computer/hci?SGWID=0-154-12-116377-0 • http://ocw.mit.edu/courses/mathematics/18-996-topics-in-theoretical-computer-science-internet-research-problems-spring-2002/lecture-notes/