evaluating your schoolwide program l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Evaluating Your Schoolwide Program PowerPoint Presentation
Download Presentation
Evaluating Your Schoolwide Program

Loading in 2 Seconds...

play fullscreen
1 / 58

Evaluating Your Schoolwide Program - PowerPoint PPT Presentation


  • 251 Views
  • Uploaded on

Evaluating Your Schoolwide Program. 2011 Title Programs Conference June 14-17, 2011 Atlanta, Georgia. Presenters. Ms. Elaine Dawsey Georgia Department of Education Title I Program Specialist edawsey@doe.k12.ga.us (478) 971-0114 Dr. Judy Alger Georgia Department of Education

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Evaluating Your Schoolwide Program' - Albert_Lan


Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
evaluating your schoolwide program

Evaluating Your Schoolwide Program

2011 Title Programs Conference

June 14-17, 2011

Atlanta, Georgia

presenters

Presenters

Ms. Elaine Dawsey

Georgia Department of Education

Title I Program Specialist

edawsey@doe.k12.ga.us

(478) 971-0114

Dr. Judy Alger

Georgia Department of Education

Title I Education Program Specialist

jualger@doe.k12.ga.us

(229)838-6067

introduction learning objectives annual review basics
Introduction, Learning Objectives, Annual Review Basics
  • Annual Review Basics
  • Measuring Your Progress
  • Annual Review Steps & Planning Ahead (Six-step annual review process)
target audience
Target Audience

Includes:

  • School principals, assistant principals
  • Counselors
  • Instructional coaches
  • General education teachers
  • Special education teachers
why do an annual review
Why do an annual review?
  • Federal requirement
  • More than just paperwork
  • Can guide your decisions
  • Part of a continuous planning process
program evaluation requirements
Program Evaluation Requirements
  • Federal legislation (CFR 200.26(c)) requires that a school operating a Title I program to:
    • Annually evaluate the implementation of the Title I program, using data from state’s annual assessments and other indicators of academic achievement.
    • Determine the effectiveness in increasing the achievement of students, especially the targeted students.
    • Revise the plan, as necessary, based on the results, to ensure the improvement continues.
what should you include
What should you include?
  • Guiding questions that match goals
  • High-priority issues
  • Relevant data
  • Jargon-free results and analysis
more annual review benefits
More Annual Review Benefits
  • Evaluates program implementation
  • Analyzes program effectiveness
  • Keeps focus on results
  • Helps you work toward AYP goals
  • Provides accountability
purpose of evaluation
Purpose of Evaluation
  • The purpose of program evaluation is:
    • To determine if the identified strategies are contributing to the desired outcomes either in terms of improvement in student achievement, or increases in other activities that lead to increased student achievement such as greater parental involvement or more high-quality professional development. (ED guidance)
    • To determine if the effectiveness is increasing the achievement of students meeting the State’s academic standards.
    • To determine if the right students are served.
    • To determine if the right services are provided.
    • To verify, increase or change the impact of services for students.
purpose of evaluation11
Purpose of Evaluation
  • The purpose of program evaluation is: (continued)
    • To improve delivery strategies to be more efficient and effective.
    • To identify program strengths and weaknesses.
    • To assist district and school level leaders in making informed decisions. Especially important due to ARRA funds ending in 2011.
    • To address stakeholder questions and help them understand how effectively schools are meeting goals.
    • To increase understanding of improvement strategies.
two types of evaluation
Two Types of Evaluation
  • Ongoing Evaluation (quarterly/monthly):
    • Review data (weekly assessments, analysis of student work, teacher perception).
      • Discuss and analyze data
      • Instructional Strategies
      • Other factors
    • Summarize Progress Towards Goals
      • Progress Made
      • No Progress Made
    • Address any issues
two types of evaluation13
Two Types of Evaluation
  • Annual Evaluation
    • Determine Progress Made For each Goal
      • Is there significant progress made? Why or why not?
      • Any trends?
      • Which goals, strategies are working? Which are not?
    • Review Needs and Goals
      • Have the needs and goals changed?
      • Any new needs that should be addressed?
    • Review components of SW or TA Plans
      • Are the components being implemented as indicated in the plan?
      • What updates/additions are needed?
    • Address any issues that arise
      • New concerns?
      • Will new issues need to be added to the plans?
measuring your progress

Measuring Your Progress

Gathering the right types of data

what are we evaluating
What are we evaluating
  • Progress toward schoolwide program goals
  • Efforts to address required program components
monthly data meeting benefits
Monthly Data Meeting Benefits
  • Best practice
  • Helps you gather, analyze current data
  • Leads to strategic decisions
  • Keeps focus on student results
monthly data meeting tips
Monthly Data Meeting Tips

Tip #1—Build a Team

  • Diverse leadership group
  • Include teachers, parents
  • Assign roles

Tip #2—Celebrate Success

  • Schoolwide/administration
  • Within grade levels
  • Classroom
  • Individual
  • Report to stakeholders
monthly data meeting tips18
Monthly Data Meeting Tips

Tip #3—Follow an Agenda

  • Allows for pre-planning
  • Standardizes information
  • Provides focus
  • Documents efforts
monthly meeting tip 3 follow an agenda
Monthly Meeting Tip #3: Follow an Agenda
  • List the goal
  • Data review
  • Answer key questions
  • Summary
  • Timeline
  • New concerns
monthly meeting tip 4 pre planned discussions
Monthly Meeting Tip #4: Pre-Planned Discussions
  • List overall data
  • Disaggregate data
  • Note changes in data
  • Write down questions
monthly meeting tip 5 use timed protocols
Monthly Meeting Tip #5: Use Timed Protocols
  • Staff members reports (1-2 minutes)
  • Team comments, asks questions (30 seconds each)
  • Reporter responds (1-2 minutes)
  • Take a vote
  • Create action step: assign roles (2-3 minutes)
monthly meeting tip 6 quality not quantity
Monthly Meeting Tip #6: Quality, Not Quantity

Schedule strategically

Limit outside interruptions

Unplug technology

Divide and conquer

Split goals among meetings

annual review steps and planning ahead
Annual Review Steps and Planning Ahead

Who should do the review?

  • Internal or external reviewers
  • Outside reviewers preferred
  • Make it a collaborative decision
step 1 identify purpose audience
Step 1: Identify Purpose & Audience
  • Evaluate implementation and results
  • A broad audience: teachers, administrators, parents, students, community members
step 2 identify issues and develop questions
Step 2: Identify Issues and Develop Questions
  • Refer to monthly data meeting agendas
  • Evaluate all goals through multiple lenses
  • Review what matters
  • Remain realistic
step 3 identify data collection tools
Step 3: Identify Data Collection Tools
  • Quantitative data: Test scores, grades
  • Qualitative data: Survey responses, interviews, focus groups
step 4 collect data
Step 4: Collect Data
  • Communicate clearly
  • Explain the review’s
  • List the data being collected
  • Tell how the results will be used
  • Provide training
  • Seek large samples
step 5 analyze and interpret results
Step 5: Analyze and Interpret Results
  • Describe school progress
  • Pinpoint individual strategies
  • Identify areas of need
step 6 create a report
Step 6: Create a Report
  • Be concise
  • Include background information, evaluation questions and procedures
  • Explain how data were analyzed
  • List findings and recommendations
  • Use clear language
  • Make it easily accessible
next steps
Next Steps
  • What should we continue?
  • What should we stop doing?
  • What needs to be done before the summer?
slide35
True or False?The annual review provides a broad picture of your schoolwide program, not details, such as individual strategies.
comprehensive needs assessment
Comprehensive Needs Assessment
  • Examine current data on the school’s demographics, test scores, teacher qualifications, attendance rate, discipline referrals, and survey results.
    • How have the school’s needs changed from the previous year as reflected by the data?
    • What needs have been met or unmet?
    • What contributed to meeting or not meeting the need?
    • What should continue, be revised or eliminated?
scientifically based instructional strategies
Scientifically Based Instructional Strategies
  • Closely examine the instructional strategies to ensure they are part of the overall school reform.
    • How have the reform strategies chosen strengthened the core academic program?
    • After reviewing/analyzing the data, did the strategies target the specific needs of the students?
    • Are the strategies addressing the quality and quantity of learning time?
    • Did the strategies and practices minimize removing students from the regular classroom during the regular school day? (Targeted Assistance Program)
    • Did program merit the money that is budgeted for the strategies/programs/activities?
instruction by highly qualified professional staff
Instruction by Highly Qualified Professional Staff
  • The school’s instructional staff constantly changes; therefore, a review of this section must provide for a plan to ensure that all teachers and paraprofessional are highly qualified.
    • Are all teachers highly qualified? If not, how will compliance be attained?
    • Are there procedures in place to ensure only highly qualified paraprofessionals are hired?
    • Are there plans in place to ensure that teachers and paraprofessionals remain highly qualified?
    • Are all paraprofessionals working under direct supervision of highly qualified teachers?
professional development
Professional Development
  • Professional development activities should align with the needs assessment to provide teachers and other staff with tools to ensure success for all students.
    • Are the professional development opportunities aligned to the identified needs?
    • Are the professional development activities provided directly impacting the identified needs of the school? How do you know?
professional development42
Professional Development
  • Questions: (continued)
    • What evidence does the school have that the professional development opportunities are making a difference with achievement of students?
    • What embedded support and follow up is provided to ensure implementation and effective use of the learned skills and strategies by the staff?
    • Does the data indicate additional professional development is needed to improve teacher delivery?
    • What have the teachers indicated as their professional development

needs?

strategies to attract highly qualified teachers
Strategies to Attract Highly Qualified Teachers
  • Plans should include means of attracting and retaining highly qualified staff.
    • What is the teacher retention rate?
    • What is being done to ensure the most qualified teachers remain at the school?
    • Have you been able to fill vacancies with highly qualified staff? If not, should an incentive plan or different recruiting method be used?
    • What are the results of the staff survey in regard to school climate?
    • What marketing strategies are in place for recruitment?
strategies to increase parental involvement
Strategies to Increase Parental Involvement
  • Plans must include strategies to build the capacity of parents to assist in their child's education.
    • What methods are used to ensure that parents of targeted students are included in parental involvement activities?
    • Are there strategies in place to improve student learning for families?
    • How are the results of the annual survey used to evaluate the parental involvement strategies? How are the results shared?
    • What activities are offered to parents to build capacity? How does the school measure the effectiveness of these activities?
assisting preschool in a successful transition
Assisting Preschool in a Successful Transition
  • A well thought out transition plan eases the stress of young children and their parents sets the tone of success for years to come.
    • Are the present preschool transitional plans working successfully?
    • Are all demographics and backgrounds of incoming students included?
    • What are the survey results in regard to pre-school transition? How is this data collected?
    • How is this data used to improve pre-school transition to elementary schools?
    • What transition plans are in place for students transitioning to middle school? To high school? Are plans successful? How do you know?
measures to include teachers in academic assessment decisions
Measures to Include Teachers in Academic Assessment Decisions
  • Instructional planning by teachers must be based on the students’ academic progress toward the goals measured through appropriately aligned assessment.
    • Are school administrators/teachers able to interpret test data (state, benchmark and classroom assessments)?
    • Are teachers able to discuss their individual students’ needs and strengths in regard to state standards as measured by both the state and benchmark assessments?
    • How are teachers collaborating with other teachers, coaches, etc to help plan instruction and intervention based on the data from assessments?
measures to include teachers in academic assessment decisions47
Measures to Include Teachers in Academic Assessment Decisions
  • Questions: (continued)
    • How is the data being shared among staff?
    • What do the teachers say is working? Not working?
    • How is the progress of students in targeted assistance programs being monitored throughout the year? Are modifications being made in instruction based on this monitoring?
    • What criteria are used to exit or add students to the targeted assistance program?
ensure effective timely additional assistance
Ensure Effective, Timely Additional Assistance
  • Students who experience difficulty mastering standards must be provided with effective, timely assistance.
    • How is the success of students receiving intervention measured? What kind of process monitoring is being conducted?
    • Are modifications being made in instruction based on the monitoring?
ensure effective timely additional assistance49
Ensure Effective, Timely Additional Assistance
  • Questions:(continued)
    • How are the students who need additional time and/or additional support receiving it? Is the additional time/support working?
    • If extended day or year is provided, are the students who are in most need attending? If not, what can be done to help increase participation or what can be done within the school day to help these students?
coordination and integration of federal and local services and programs
Coordination and Integration of Federal and Local Services and Programs
  • Procedures should be in place for the coordinating and integrating Title I resources with other resources to enable children served to meet the State standards.
    • Are all the programs and services available coordinated and integrated?
    • What strategies and/or activities are coordinated with other school improvement efforts?
    • Are the services and programs meeting the needs?
components of a schoolwide program
Components of a Schoolwide Program
  • Activities to ensure that students who experience difficulty mastering standards shall be provided with effective, timely assistance . . .
  • Description of how individual student assessment results and interpretation will be provided to parents.
components of a schoolwide program52
Components of a Schoolwide Program
  • Provisions for the collection and disaggregation of data on the achievement and assessment results of students.
  • Provisions to ensure that disaggregated assessment results for each category are valid and reliable.
  • Provisions for reporting of disaggregated data.
  • Plan developed during a one year period . . .
components of a schoolwide program53
Components of a Schoolwide Program
  • Plan developed with the involvement of the community to be served and individuals who will carry out the plan including . . .
  • Plan available to the LEA, parents, and the public.
  • Plan translated to the extent feasible, into any language that a significant percentage of the parents . . .speak as their primary language.
  • Plan is subject to the school improvement provisions of Section 1116.
decisions
Decisions
  • Do you have effective ongoing and annual evaluation/monitoring procedures in place to make informed decisions about what is working and what is not?
  • Are there programs that need to be eliminated?
  • Are there means of providing the same service without additional funds?
  • Are you getting what you are paying for?
decisions55
Decisions
  • With Title I, Part A-ARRA funds no longer available in FY12 what programs, activities, staff will be continued?
  • Evaluation is the key.
  • I would advise program administrators to focus Title I schools on their needs assessment and other data to identify and focus services and to keep the focus on activities and resources that are going to make a difference over the long haul. (Dr. Zollie Stevenson in Title1Admin, January 3, 2011.)
contact information
Contact Information

Dr. Judy Alger

Title I Program Specialist – Area 5

Telephone: (229) 669-1775

Fax: (229) 838-6103

Email: jualger@doe.k12.ga.us

Ms. Elaine Dawsey

Title I Education Program Specialist – Area 10

Telephone: (478) 971-0114

Fax: (478)971-1244

Email: edawsey@doe.k12.ga.us

evaluating your schoolwide program58

Evaluating Your Schoolwide Program

2011 Title Programs Conference

June 14-17, 2011

Atlanta, Georgia