Developing & Evaluating an Outcomes-Focused SPIL
This presentation is the property of its rightful owner.
Sponsored Links
1 / 27

Developing & Evaluating an Outcomes-Focused SPIL PART 1: Goals & Objectives PowerPoint PPT Presentation


  • 78 Views
  • Uploaded on
  • Presentation posted in: General

Developing & Evaluating an Outcomes-Focused SPIL PART 1: Goals & Objectives April 21, 2010; 3:00-4:30 PM EST PART 2: Evaluation April 28, 2010; 3:00-4:30 PM EST Presented by: Mike Hendricks, Ph.D. SILC-NET Presents…. 1. Our 3-Step Approach. Step 1: Decide what you want to achieve

Download Presentation

Developing & Evaluating an Outcomes-Focused SPIL PART 1: Goals & Objectives

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Developing evaluating an outcomes focused spil part 1 goals objectives

Developing & Evaluating an Outcomes-Focused SPIL

PART 1: Goals & Objectives

April 21, 2010; 3:00-4:30 PM EST

PART 2: Evaluation

April 28, 2010; 3:00-4:30 PM EST

Presented by:

Mike Hendricks, Ph.D.

SILC-NET Presents…

1


Our 3 step approach

Our 3-Step Approach

Step 1: Decide what you want to achieve

Mission, goals, objectives, partial logic model

Step 2: Turn generalizations into specifics

Measurable indicators, geographic scope, target performance level in 2013, timetable for interim progress

Step 3: Develop your action strategy to achieve each Objective

Activities, lead organization, key partners, resources


Step 1 decide what you want to achieve

Step 1: Decide what you want to achieve

State your Mission

- But whose mission? Your total IL program’s!

- “PWDs in our state live independently and participate fully in their community”

- Your Mission will be different, but…

- Wording is important:

Start with your target group

Follow with a present-tense verb phrase

End however makes sense

- But what about a Vision statement?

3


Developing evaluating an outcomes focused spil part 1 goals objectives

B. Develop your Goals

- Desired outcomes one level below your Mission

- Objectives explain “How will we achieve our Mission?”

- What outcomes do you need to achieve first, in order to achieve your Mission?

- Outcome “stepping stones” on the way to your Mission

- Put each Goal in a box, right below the Mission

Step 1, cont’d.

4


Partial logic model with goals

Partial Logic Model with Goals

IF we achieve these three Goals, THEN we can achieve our Mission

Your Goals will be different

You may not even agree with these Goals

Try this format, using the suggested wording

5


Developing evaluating an outcomes focused spil part 1 goals objectives

C. Define your Objectives

- Typically can’t achieve Goals in 3 years

- Make progress, yes; fully achieve, probably no

- Need another level of outcomes below Goals…. Objectives!

- “How will we achieve our Goals?”

- What outcomes do you need to achieve first, in order to achieve your Goals?

Step 1, cont’d.

6

6


Partial logic model with objectives

IF we achieve these four Objectives, THEN we can achieve this Goal

Your Objectives will be different – try not to have too many (37 in one SPIL)

[Occasionally, may need to include sub-Objectives]

Partial Logic Model with Objectives

7


Step 2 turn generalities into specifics

Step 2: Turn Generalities into Specifics

Objectives are the core, but they’re too general

“IL providers are well-trained” – What does this mean – exactly?

Use columns 1-5 of our SPIL Planning Table (see next slide)

8

8


Spil planning table

SPIL Planning Table

9


Developing evaluating an outcomes focused spil part 1 goals objectives

A. Develop measurable indicators for each objective

- What exactly should change in 3 years?

- How exactly will we know if we’re being successful on this Objective?

- How exactly would two parallel universes be different?

- “# and % of front-line staff who have an up-to-date Prime Provider certificate”

Step 2, cont’d.

10


Developing evaluating an outcomes focused spil part 1 goals objectives

Step 2, cont’d.

B.Specify the geographic scope for each Objective

  • Statewide? Only certain areas?

    C.Set performance targets for each Objective

  • What an indicator should “read” at the end of the 3-year SPIL period

  • Art + science: other States, national standards, expert recommendations, extrapolation of your own performance, etc.

11


Developing evaluating an outcomes focused spil part 1 goals objectives

D. Set timeframes for interim progress

Please don’t wait 3 years to see how you’re doing

Measure an indicator as often as makes sense (annual, 6 months, 3 months)

Shoot for a trend that makes sense (steady, gathers steam, levels off)

Step 2, cont’d.

12


Step 3 develop your action strategy to achieve each objective

Step 3: Develop your action strategy to achieve each Objective

Now you know exactly what you want to achieve – very specifically

But how are you going to achieve each Objective?

Use columns 6-10 of our SPIL Planning Table (see next slide)

13


Example full spil planning table

Example Full SPIL Planning Table

14


Developing evaluating an outcomes focused spil part 1 goals objectives

A. Determine the Activities you need to conduct in order to achieve each Objective

- What you do -- “-ing” words such as training, surveying, disseminating, etc.

- One or more activities for each Objective

- But this will vary for each Objective

- Activities depend almost entirely on the decisions you’ve made in Steps 1 and 2

- Put activities right below Objectives on your logic model (IF-THEN)

Step 3, cont’d.

15


Partial logic model with activities

Partial Logic Model with Activities

16


B agree on one lead organization for achieving each objective

B. Agree on one lead organization for achieving each Objective

Important for the buck to stop some ONE place

SILC, DSU(s), or CILs might usually be the lead

But maybe not always?

17


Developing evaluating an outcomes focused spil part 1 goals objectives

Step 3, cont’d.

C. Agree on key partners for each Objective

  • - Other organizations may need to be involved, too

  • – Important to plan from the beginning

    D. Document the resources needed to achieve each Objective

    – Generally in $$ terms

    – As closely as possible, but may not be perfect

18


Developing evaluating an outcomes focused spil part 1 goals objectives

Step 3, cont’d.

E. Clarify funding sources

  • – Part B? Part C? Chapter 2 – Older Blind?

19


Evaluating your spil

Evaluating Your SPIL

Required by RSA

SPIL evaluation plans not the strongest

Guiding principles:

Evaluation is important

Focus on improvement, not reporting

Evaluations should vary among states

Certain aspects are probably essential

Evaluation is a collaborative activity

20


Use evaluation to answer three key questions

Use Evaluation to Answer Three Key Questions

How well are we achieving our Objectives?

- You’ve already done lots of this work

- Create a SPIL Evaluation Plan

Objectives, measurable indicators, sources, methods, responsible organizations, frequency of gathering outcome information

21


Example spil evaluation plan

Example SPIL Evaluation Plan

22


2 how satisfied are our consumers

2. How satisfied are our consumers?

RSA specifically requires this question

Think of this as one of your Objectives

(e.g., “Consumers are satisfied with our services”)

Then add to SPIL Evaluation Plan

23


3 how can we improve our state s total il program

3. How can we improve our State’s total IL program?

This is a different kind of question

Don’t assume this happens automatically

Use the “Three C’s”

COMPILE your evaluation information

describe what is

compare as appropriate

interpret the meaning

recommend improvements

24


Developing evaluating an outcomes focused spil part 1 goals objectives

CONVENE key stakeholders

At least quarterly

Include all key stakeholders

CONSIDER the implications

What findings say is happening?

Do we believe it’s true?

What should we do about it?

Improve things, keep evaluating

Evaluating Your SPIL, cont’d.

25


Developing evaluating an outcomes focused spil part 1 goals objectives

Click the link below now to complete an evaluation of today’s program found

https://vovici.com/wsb.dll/s/12291g4408a

26


Silc net

SILC-NET

Support for development of this Webinar/teleconference was provided by the U.S. Department of Education, Rehabilitation Services Administration under grant number H132B070003-09. No official endorsement of the Department of Education should be inferred. Permission is granted for duplication of any portion of this PowerPoint presentation, providing that the following credit is given to the project: Developed as part of the SILC-NET, a program of the IL NET, an ILRU/NCIL/APRIL National Training and Technical Assistance Project.

27


  • Login