The big bang creating an evaluation program from the beginning
1 / 18

The Big Bang: Creating an Evaluation Program From the Beginning - PowerPoint PPT Presentation

  • Uploaded on

The Big Bang: Creating an Evaluation Program From the Beginning. Kelly R. Brantley Health Assistance Partnership 13th Annual SHIP Director's Conference. Why Program Evaluation?. Why Program Evaluation?. Basic SHIP Grant for FY 2007

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' The Big Bang: Creating an Evaluation Program From the Beginning' - claude

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
The big bang creating an evaluation program from the beginning

The Big Bang:Creating an Evaluation Program From the Beginning

Kelly R. Brantley

Health Assistance Partnership

13th Annual SHIP Director's Conference

Why program evaluation1
Why Program Evaluation?

  • Basic SHIP Grant for FY 2007

    • Provide locally-based individual counseling services to a greater number of individual beneficiaries unable to access other channels of information,

    • Increase targeted outreach to diverse and hard-to-reach populations,

    • Increase and enhance the counselor workforces

    • Increase local and State participation in CMS education and communication activities

Why program evaluation2

Informs program planning and delivery

Involves stakeholders

Supports learning

Respects community

Test a theory

Tell a story

Be accountable

Inform the field

Support fundraising

Understand and improve program

Why Program Evaluation?

What does program evaluation look like1
What Does Program Evaluation Look Like?

  • Forms and Reports: CCFs, PAMs, Resource Reports, State database

  • Surveys or Interviews: Client satisfaction, training, outreach, presentations

  • Performance Review: Top-down and bottom-up strategies

  • Effectiveness or cost-effectiveness studies

Evaluation myths
Evaluation Myths

  • It is too complex.

  • We did it once before.

  • We don’t have enough resources.

  • We don’t know if we will do it right.

  • I already know what we need to do.

What do you do with your numbers1
What Do You Do With Your Numbers?

  • Tabulate

  • Report to CMS

  • Draw trend lines

  • Decide where to focus

  • Ask and answer questions

  • Develop agenda items

Implementation evaluation
Implementation Evaluation

  • Answers who, what, when, where, why

  • Also called process evaluation

  • In SHIPs, implementation evaluation is most common

Implementation evaluation1
Implementation Evaluation

  • An example: Evaluate a presentation to the public

    • Who was the audience?

    • How many people were there?

    • When was the presentation?

    • How long was the presentation?

    • What were the topics?

    • What did people think of the presentation?

Outcomes evaluation
Outcomes Evaluation

  • Measures changes in knowledge, skills, attitudes, behavior, motivation, decisions, policies, and conditions

  • Often asks a vague, immeasurable question

  • So must use an indicator to capture a value

Outcomes evaluation1
Outcomes Evaluation

  • An example: Evaluate a counselor training session

    • Do counselors understand the topic sufficiently to provide needed information to clients?

      • Indicator: Eighty percent of trained counselors should pass a post-test with a score of 80% or higher.

Components of outcomes evaluation
Components of Outcomes Evaluation

  • Inputs

  • Activities

  • Outputs

  • Outcomes

    • Outcome targets

    • Outcome indicators

Planning evaluation
Planning Evaluation

  • Answer basic questions:

    • What do you want to be able to decide from your results?

    • Who is the audience for the results?

    • What information should be gathered?

    • When do you need this information?

    • Where and how do you get the information?

    • What resources are available to get, analyze, and report the information?


  • Basic Guide to Outcomes-Based Evaluation for Nonprofit Organizations with Very Limited Resources:

  • Evaluation Activities in Organizations:

  • Volunteer Program Evaluation:

  • Innovation Network:

  • Outcome Measurement Resource Network:

Thank you
Thank You

  • Kelly R. Brantley

    • Senior Education and Training Associate

    • Health Assistance Partnership

  • Contact Information

    • [email protected]

    • (202) 737-6340