Georgia pilot site technical assistance meeting
Download
1 / 25

Georgia Pilot Site Technical Assistance Meeting - PowerPoint PPT Presentation


  • 54 Views
  • Uploaded on

Georgia Pilot Site Technical Assistance Meeting. Wednesday, January 19, 2011 10 am ET. The Process in More Detail: Where Are You?. The Five Step Process. STE P FOUR. Develop an Evaluation Plan. Why Evaluate?.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Georgia Pilot Site Technical Assistance Meeting' - stacey-reyes


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Georgia pilot site technical assistance meeting

Georgia Pilot Site Technical Assistance Meeting

Wednesday, January 19, 2011 10 am ET




Ste p four

STEP FOUR

Develop an Evaluation Plan


Why evaluate
Why Evaluate?

Make sure your improvement strategy works somewhere before you attempt to apply it everywhere


Types of evaluations
Types of Evaluations

  • Formative Evaluation

    • Process measures

      • How well was the program implemented

      • “The cook tasting the soup”

  • Summative Evaluation

    • Outcome measures

      • Did the program produce the desired results

      • “The guests taste the soup”


Write smart objectives
Write SMART Objectives

  • Evaluation objectives must be

    • Specific

    • Measurable

    • Achievable

    • Relevant

    • Time-limited


Formative process evaluation

Formative (Process) Evaluation

What we all know and do well


Select process measures
Select Process Measures

  • Attendance

  • Response rate

  • Satisfaction of implementers with process

  • Satisfaction of participants with process

  • On time accomplishment of tasks

  • Quality evaluation of implementation services

  • More


Process objectives
Process Objectives

  • 75% of invitees will respond to the invitation by the RSVP date

  • 60% of the invitees will attend the event

  • 50% of the participants will bring at least one parent or guardian to the event

  • 75% of the participants will score their satisfaction with the event as a 4 (very good) or 5 (excellent) on the exit evaluation instrument


Process measurement tools
Process Measurement Tools

  • Invitation/Outreach records

  • Registration/Response records

  • Attendance records

  • Participant demographics

  • Evaluation instrument

  • Planning timeline

  • More


Develop a process evaluation plan
Develop a Process Evaluation Plan


Summative outcome evaluation

Summative (Outcome) Evaluation

The ultimate impact of our efforts

RESULTS


Select outcome measures
Select Outcome Measures

  • Short-term goals

    • Increase in awareness

    • Increase in knowledge

    • Change in attitude

    • Change in behavior

  • Long-term goals

    • Enrollment

    • Achievement

    • Completion

    • Graduation

    • Transition


Long term goals and objectives
Long-term Goals and Objectives

  • Increase the participation of females in Ag

    • From FY09 to FY11, female enrollment in Ag 010101 will increase by 5 percentage points as measured by Overton Banner Data Collection System.

  • Increase the participation of females in PLTW

    • The participation rate of girls in the Gateway to Technology course at the middle school will increase by 5 percentage points the year following the implementation of the Focus Your Future event as measured by Perkins reported enrollment data


Long term measurement tools
Long Term Measurement Tools

Typically maintained by administration or institutional research office and reported to a funder, accrediting agency or system agency

  • Student level demographic data

  • Attendance records

  • Achievement records

  • Graduation records

  • Perkins core indicator data


Select outcome measures1
Select Outcome Measures

  • Short-term goals

    • Increase in awareness

    • Increase in knowledge

    • Change in attitude

    • Change in behavior

  • Long-term goals

    • Enrollment

    • Achievement

    • Completion

    • Graduation

    • Transition


Short term objectives
Short-term Objectives

  • 80% of participants in Female Farm Today workshop will increase their knowledge of farm business practices as measured in pre-and post-workshop survey.

  • After participating in Focus Your Future event 50% of the participating students will show a one point (on a 5 point likert scale) increase in their willingness to consider enrolling in the pre-engineering program at the high school.


Short term measurement tools
Short-term Measurement Tools

  • Pre-post attitude assessment

  • Pre-post knowledge assessment

  • Evaluation instrument

  • Post activity survey


Develop a outcome evaluation plan
Develop a Outcome Evaluation Plan


Assessment resources
Assessment Resources

  • STEM Equity Pipeline Webinars

    • May 21, 2008 Assessing Effectiveness: Do Your Program Activities Make a Difference?

    • June 16, 2008 Building Effective Program Assessments

    • Archived at www.stemequitypipeline.org

  • Assessing Women and Men in Engineering - www.aweonline.org


Summary
Summary

  • Align short term goals with long term goals

  • Tie long term objectives to existing data collection systems

  • Tie short term objectives to activities

  • Check for any required data

  • Determine types of data needed—

    quantitative, qualitative, or both?

  • Decide on a data collection instrument

    • Assessing Women in Engineering

  • Develop an Evaluation Plan