90 likes | 106 Views
Learn about evaluation research, the systematic assessment of worth, context, and merit, and how the STARS process creates informed decisions and action. Discover how evaluation differs from academic research and the importance of applying value structures.
E N D
Evaluation is…. • Applied social science research (Trochim) • A way of viewing the project, its participants, it effect • Accounting for CONTEXT and MEANING • Determining the VALUE of something • Measurements are the currency
Defining Evaluation Research • Evaluation is the systematic assessment of the worth or merit of some object • Evaluation provides useful feedback • This definition is hardly perfect • Many evaluations do not result in an assessment of worth or merit - Trochim
Understanding Evaluation Research 1.Systematically define what data will be collected, how, when & by whom 2.Process the data to determine what it means within specified contexts 3.Tell constituents about findings in appealing & appropriate ways 4.Disseminate broader findings to share within disciplines
The Process: STARS Overall Informed Decisions & Actions • How is STARS making a difference? • Corps Students • CS Faculty • CS Depts. • K12 outreach participants • Multiple perspectives from: • Corps Students • CS Faculty • CS Depts. • K12 outreach participants • EA projects • External evaluator input • National comparisons • How, what, when, who measures? • Corps Students • Surveys & interviews • CS Faculty • Surveys & focus groups • CS Depts. • Chair interviews • K12 outreach participants • EA projects • How is STARS making a difference? • Corps Students & Faculty say collectively + individual stories • Exemplars • Modifications Revise, Reform & Disseminate
Evaluative Thinking • Reflective practice of systematically using data to inform decisions • Ongoing process • Approach to making decisions, what actions to take, to become/remain effective at the organizational (or individual) goals • It is LEARNING and APPLYING learning
Evaluation and Academic Research Evaluation Academic Research Applies research methods to answer questions about a program’s efficacy & value Considers context (stakeholders, climate, etc.) Makes a judgment call on WORTH, and defines value structure (i.e. value to whom?) Applies research methods to answer a research question Knowledge gained in scientific discipline Does not apply value structure; values are seen as bias
In summary, evaluation… • Uses research methods • Applies methods to social, political and economic realities • Helps to interpret academic research within larger socio-economic/geo-political realities • Answers the “so what?” of observed outcomes Research = Knowledge Discovery Evaluation = Extracting Meaning from Knowledge