the big bang creating an evaluation program from the beginning n.
Skip this Video
Download Presentation
The Big Bang: Creating an Evaluation Program From the Beginning

Loading in 2 Seconds...

play fullscreen
1 / 18

The Big Bang: Creating an Evaluation Program From the Beginning - PowerPoint PPT Presentation

  • Uploaded on

The Big Bang: Creating an Evaluation Program From the Beginning. Kelly R. Brantley Health Assistance Partnership 13th Annual SHIP Director's Conference. Why Program Evaluation?. Why Program Evaluation?. Basic SHIP Grant for FY 2007

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'The Big Bang: Creating an Evaluation Program From the Beginning' - claude

Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
the big bang creating an evaluation program from the beginning

The Big Bang:Creating an Evaluation Program From the Beginning

Kelly R. Brantley

Health Assistance Partnership

13th Annual SHIP Director's Conference

why program evaluation1
Why Program Evaluation?
  • Basic SHIP Grant for FY 2007
    • Provide locally-based individual counseling services to a greater number of individual beneficiaries unable to access other channels of information,
    • Increase targeted outreach to diverse and hard-to-reach populations,
    • Increase and enhance the counselor workforces
    • Increase local and State participation in CMS education and communication activities
why program evaluation2
Informs program planning and delivery

Involves stakeholders

Supports learning

Respects community

Test a theory

Tell a story

Be accountable

Inform the field

Support fundraising

Understand and improve program

Why Program Evaluation?
what does program evaluation look like1
What Does Program Evaluation Look Like?
  • Forms and Reports: CCFs, PAMs, Resource Reports, State database
  • Surveys or Interviews: Client satisfaction, training, outreach, presentations
  • Performance Review: Top-down and bottom-up strategies
  • Effectiveness or cost-effectiveness studies
evaluation myths
Evaluation Myths
  • It is too complex.
  • We did it once before.
  • We don’t have enough resources.
  • We don’t know if we will do it right.
  • I already know what we need to do.
what do you do with your numbers1
What Do You Do With Your Numbers?
  • Tabulate
  • Report to CMS
  • Draw trend lines
  • Decide where to focus
  • Ask and answer questions
  • Develop agenda items
implementation evaluation
Implementation Evaluation
  • Answers who, what, when, where, why
  • Also called process evaluation
  • In SHIPs, implementation evaluation is most common
implementation evaluation1
Implementation Evaluation
  • An example: Evaluate a presentation to the public
    • Who was the audience?
    • How many people were there?
    • When was the presentation?
    • How long was the presentation?
    • What were the topics?
    • What did people think of the presentation?
outcomes evaluation
Outcomes Evaluation
  • Measures changes in knowledge, skills, attitudes, behavior, motivation, decisions, policies, and conditions
  • Often asks a vague, immeasurable question
  • So must use an indicator to capture a value
outcomes evaluation1
Outcomes Evaluation
  • An example: Evaluate a counselor training session
    • Do counselors understand the topic sufficiently to provide needed information to clients?
      • Indicator: Eighty percent of trained counselors should pass a post-test with a score of 80% or higher.
components of outcomes evaluation
Components of Outcomes Evaluation
  • Inputs
  • Activities
  • Outputs
  • Outcomes
    • Outcome targets
    • Outcome indicators
planning evaluation
Planning Evaluation
  • Answer basic questions:
    • What do you want to be able to decide from your results?
    • Who is the audience for the results?
    • What information should be gathered?
    • When do you need this information?
    • Where and how do you get the information?
    • What resources are available to get, analyze, and report the information?
  • Basic Guide to Outcomes-Based Evaluation for Nonprofit Organizations with Very Limited Resources:
  • Evaluation Activities in Organizations:
  • Volunteer Program Evaluation:
  • Innovation Network:
  • Outcome Measurement Resource Network:
thank you
Thank You
  • Kelly R. Brantley
    • Senior Education and Training Associate
    • Health Assistance Partnership
  • Contact Information
    • (202) 737-6340