Introductions. NC DELTA Empowerment Evaluation TeamBeth MoraccoTina PetersonKathryn Andersen Clark. What We Will Cover Today?. Introduction of EE Team: Beth, Christina and KathrynIntroduction to Empowerment Evaluation (EE) ~BREAK~ Introduction to Getting to Outcomes (GTO)Tying it all together: How we will use EE and GTO at the state levelDiscussion/Questions.
1. NC DELTA, Empowerment Evaluation and Getting to Outcomes: An Overview Beth Moracco
2. Introductions NC DELTA Empowerment Evaluation Team
Kathryn Andersen Clark
3. What We Will Cover Today? Introduction of EE Team: Beth, Christina and Kathryn
Introduction to Empowerment Evaluation (EE) ~BREAK~
Introduction to Getting to Outcomes (GTO)
Tying it all together: How we will use EE and GTO at the state level
4. What is evaluation?
5. What is Empowerment Evaluation? Evaluation “system” that aims to increase probability of success by:
Providing stakeholders with tools for planning, implementation and self-evaluation; and
Integrating evaluation into program/organizational needs assessment, planning, and implementation
6. Integrated Vision of Evaluation
7. EE vs. “Traditional” Evaluation Traditional (Proving)
Done to you
Conducted by outsider
Focused on what happened
Done with you
Conducted by participants
Focused on what is happening now
8. Principles of Empowerment Evaluation Improvement
9. Principles of EE: Improvement Goal of evaluation is to improve process and performance
Use data to inform decision-making
Monitor change over time
10. Principles of EE: Community Ownership Stakeholders have control over the evaluation process
Evaluator is coach/facilitator; offers tools, training, technical assistance re needs assessment, planning, implementation, and evaluation
Stakeholders take responsibility for oversight and direction of the evaluation
11. Principles of EE: Inclusion Stakeholders should represent communities they serve
EE facilitates direct participation by all stakeholders
12. Principles of EE: Democratic Participation Stakeholders and EE commit to democratic participation in decision-making
Facilitate environment where all voices equally valued, shared, and heard
EE monitors participation and decision-making and provides feedback
13. Principles of EE: Social Justice Think through potential implications of evaluation results; aim is to make a difference toward the larger social good
Base programmatic decisions on a social justice framework
Work should facilitate social change and address social inequities
14. Principles of Empowerment Evaluation: Community Knowledge Respect and value knowledge that lies within the organization/community
Use and validate community knowledge
Combine local/state-specific knowledge with evidence-based strategies
15. Principles of Empowerment Evaluation: Evidence-Based Strategies Identify evidence-based strategies that can lead to program/organization’s goals
Adapt (with care!) evidence-based strategies within community context
16. Principles of EE: Capacity Building Empowerment Evaluator provides training and TA for self-evaluation
Stakeholders guide training/TA needs
Empowerment Evaluator works self out of a job
17. Principles of Empowerment Evaluation: Organizational Learning Empowerment Evaluator and stakeholders foster a culture of learning
Stakeholders involved in interpretation of results and forming recommendations
18. Principles of Empowerment Evaluation: Accountability Use appropriate tools, measures and methods
Identify reasons that implementation differed from plan (process)
Identify reasons why desired outcomes were and were not reached (outcome)
19. Role of Empowerment Evaluator in NC DELTA Work with NC DELTA Coordinator and ED to Build IPV Prevention Capacity in:
State Steering Committee
20. State IPV Prevention Plan Develop Using Getting To Outcomes
Coordinated by NC Delta Coordinator
Facilitated by EE Team
Authored by State Steering Committee
Includes local plans as Appendix
Due June 2008
21. Role of Empowerment Evaluator in the NC DELTA State Steering Committee Support SSC to create state-level:
Intimate Partner Violence Prevention Plan (June 2008)
Increase state and local capacity re evidence-based planning and evaluation
Leave infrastructure of training materials, databases, report templates, data collection protocols, etc.
24. Introduction to Getting to Outcomes (GTO)
25. Getting To Outcomes (GTO) GTO is a 10-step framework for planning, implementation and evaluation
Manual under development for IPV and SV
Designed to be used as a tool or framework for Empowerment Evaluation
26. State-Level Use of GTO State Steering committee uses GTO to develop statewide IPV Prevention Plan
NCCADV team uses GTO to develop statewide IPV Progress Report
EE team provides coaching, training/TA on GTO
27. 10 Steps of GTO Needs and Resources Assessment
Setting Goals, Populations and Desired Outcomes
Implementation with Process Evaluation
Continuous Quality Improvement
28. Applying GTO Needs and Resources Assessment
What are the underlying needs and conditions that must be addressed to prevent IPV capacity?
What resources are available to help prevent IPV ?
Goal, Populations and Desired Outcomes
What are the state’s goals and desired outcomes (objectives) for IPV prevention in NC?
What priority populations) does the state want to reach?
29. Applying GTO 3. Evidence-based Strategies:
What evidence-based strategy(s) will help us achieve our goals?
How will the chosen strategies to build IPV prevention capacity “fit” within the context of IPV prevention in North Carolina?
What capacities does the state need to implement the chosen strategy(ies)? Evidenced-based strategies for NCCADV – getting organizational buy-in for preventionEvidenced-based strategies for NCCADV – getting organizational buy-in for prevention
30. Applying GTO Plan:
What is the specific plan to implement the strategy(ies) for IPV prevention?
How will the quality of implementation of the IPV Prevention Strategy(s) be assessed (i.e. fidelity)?
31. Applying GTO Outcomes:
What were the results of the strategy(s) to prevent IPV?
Did we meet our goals and desired outcomes?
How will the state improve the IPV Prevention strategy(s) over time? (CQI)
If the strategy is successful, how will it be sustained?
32. Focus on GTO Step 1 GTO Step 1: State Level IPV Needs and Resource Assessment (4-6 months)
Definition: systematic process of gathering and critically interpreting information about IPV; and the resources available to address that problem within the state
Goal: Comprehensive picture of IPV in North Carolina, including differences in needs and resources among regions and populations
33. Focus on GTO Step 1 GTO Step 1: State Level IPV Needs and Resource Assessment (4-6 months)
Establish a work group or committee
Geographic and demographic areas of interest
Develop Needs and Resource Assessment Workplan
Identify existing IPV data sources (archival/secondary data)
Understand value and limitations of various data sources
Identify data/information gaps
Determine which groups have greatest “risk” of IPV
Identify protective factors for IPV
Consider primary data collection
34. Focus on GTO Step 1 GTO Step 1: State Level IPV Needs and Resource Assessment (4-6 months)
Product: State IPV Profile
Description of IPV funding streams
IPV in NC:
Risk and Protective Factors
Separate IPV profiles by region or county?
IPV Prevention Resources
35. Focus on GTO Step 2 GTO Step 2: Goals, Desired Outcomes and Priority Populations
Goals are broad statements that describe the kind of change you want to see as a result of your work.
Outcomes (objectives) are specific, measurable statements that let you know when you have reached your goals.
36. Focus on GTO Step 2 GTO Step 2: Goals, Desired Outcomes and Priority Populations
Decide what you want to change
Should be based on data from Step 1
Decide what level of social ecology to address
Identify risk factors to reduce
Identify protective factors to promote
Identify indicators for each outcome
What will change
Who will change
When will it change
By how much will it change
How will the change be measured
37. Where do we go from here? EE Facilitation “Menu”
Identification of SSC TA needs
Formation of sub-committees
Develop goals, timelines, workplans
Begin Working on GTO Step 1 (and 2?)