Developing & Evaluating an Outcomes-Focused SPIL PART 1: Goals & Objectives April 21, 2010; 3:00-4:30 PM EST PART 2: Evaluation April 28, 2010; 3:00-4:30 PM EST Presented by: Mike Hendricks, Ph.D. SILC-NET Presents…. 1. Our 3-Step Approach. Step 1: Decide what you want to achieve
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
PART 1: Goals & Objectives
April 21, 2010; 3:00-4:30 PM EST
PART 2: Evaluation
April 28, 2010; 3:00-4:30 PM EST
Mike Hendricks, Ph.D.
Step 1: Decide what you want to achieve
Mission, goals, objectives, partial logic model
Step 2: Turn generalizations into specifics
Measurable indicators, geographic scope, target performance level in 2013, timetable for interim progress
Step 3: Develop your action strategy to achieve each Objective
Activities, lead organization, key partners, resources
State your Mission
- But whose mission? Your total IL program’s!
- “PWDs in our state live independently and participate fully in their community”
- Your Mission will be different, but…
- Wording is important:
Start with your target group
Follow with a present-tense verb phrase
End however makes sense
- But what about a Vision statement?
- Desired outcomes one level below your Mission
- Objectives explain “How will we achieve our Mission?”
- What outcomes do you need to achieve first, in order to achieve your Mission?
- Outcome “stepping stones” on the way to your Mission
- Put each Goal in a box, right below the Mission
Step 1, cont’d.
IF we achieve these three Goals, THEN we can achieve our Mission
Your Goals will be different
You may not even agree with these Goals
Try this format, using the suggested wording
- Typically can’t achieve Goals in 3 years
- Make progress, yes; fully achieve, probably no
- Need another level of outcomes below Goals…. Objectives!
- “How will we achieve our Goals?”
- What outcomes do you need to achieve first, in order to achieve your Goals?
Step 1, cont’d.
Your Objectives will be different – try not to have too many (37 in one SPIL)
[Occasionally, may need to include sub-Objectives]Partial Logic Model with Objectives
Objectives are the core, but they’re too general
“IL providers are well-trained” – What does this mean – exactly?
Use columns 1-5 of our SPIL Planning Table (see next slide)
A. Develop this Goalmeasurable indicators for each objective
- What exactly should change in 3 years?
- How exactly will we know if we’re being successful on this Objective?
- How exactly would two parallel universes be different?
- “# and % of front-line staff who have an up-to-date Prime Provider certificate”
Step 2, cont’d.
Step 2, cont’d. this Goal
B.Specify the geographic scope for each Objective
C.Set performance targets for each Objective
D. Set timeframes for this Goalinterim progress
Please don’t wait 3 years to see how you’re doing
Measure an indicator as often as makes sense (annual, 6 months, 3 months)
Shoot for a trend that makes sense (steady, gathers steam, levels off)
Step 2, cont’d.
Now you know exactly what you want to achieve – very specifically
But how are you going to achieve each Objective?
Use columns 6-10 of our SPIL Planning Table (see next slide)
A Objective. Determine the Activities you need to conduct in order to achieve each Objective
- What you do -- “-ing” words such as training, surveying, disseminating, etc.
- One or more activities for each Objective
- But this will vary for each Objective
- Activities depend almost entirely on the decisions you’ve made in Steps 1 and 2
- Put activities right below Objectives on your logic model (IF-THEN)
Step 3, cont’d.
Important for the buck to stop some ONE place
SILC, DSU(s), or CILs might usually be the lead
But maybe not always?
Step 3, cont’d. Objective
C. Agree on key partners for each Objective
D. Document the resources needed to achieve each Objective
– Generally in $$ terms
– As closely as possible, but may not be perfect
Step 3, cont’d. Objective
E. Clarify funding sources
Required by RSA
SPIL evaluation plans not the strongest
Evaluation is important
Focus on improvement, not reporting
Evaluations should vary among states
Certain aspects are probably essential
Evaluation is a collaborative activity
How well are we achieving our Objectives?
- You’ve already done lots of this work
- Create a SPIL Evaluation Plan
Objectives, measurable indicators, sources, methods, responsible organizations, frequency of gathering outcome information
RSA specifically requires this question
Think of this as one of your Objectives
(e.g., “Consumers are satisfied with our services”)
Then add to SPIL Evaluation Plan
This is a different kind of question
Don’t assume this happens automatically
Use the “Three C’s”
COMPILE your evaluation information
describe what is
compare as appropriate
interpret the meaning
CONVENE key stakeholders Objective
At least quarterly
Include all key stakeholders
CONSIDER the implications
What findings say is happening?
Do we believe it’s true?
What should we do about it?
Improve things, keep evaluating
Evaluating Your SPIL, cont’d.
Click the link below now Objective to complete an evaluation of today’s program found
Support for development of this Webinar/teleconference was provided by the U.S. Department of Education, Rehabilitation Services Administration under grant number H132B070003-09. No official endorsement of the Department of Education should be inferred. Permission is granted for duplication of any portion of this PowerPoint presentation, providing that the following credit is given to the project: Developed as part of the SILC-NET, a program of the IL NET, an ILRU/NCIL/APRIL National Training and Technical Assistance Project.