Download
1 / 28
280 likes | 284 Views
Learn about the Program Quality Reviews (PQR) for community and adult learning centers and correctional institutions. Discover how to prepare for a review and what to expect before and after. Updated September 2019.
E N D
Program Quality Reviews (PQR)FY2019 – FY2022Community Adult Learning Centers and Correctional Institutions Adult and Community Learning Services (ACLS) Updated September 2019
CONTENTS Overview of Program Quality Reviews 1 2 How to Prepare for a Program Quality Review 3 What to Expect During a Program Quality Review 4 What to Expect After a Program Quality Review
PQR Cohorts • All programs reviewed during a four-year funding cycle. • Programs organized into cohorts by fiscal year: • Year 1 (FY19)-Cohort 1 • Year 2 (FY20)-Cohort 2 • Year 3 (FY21)-Cohort 3 • PQR Master Schedule released at the beginning of each fiscal year.
PQR Team-cont. • Depending on the size of the program, a Review Team may be comprised of anywhere from two to nine members. • The Local MassHire Workforce Development Board representative is always invited, but depending on schedules may or may not be part of the Review Team.
Indicators of Program Quality • The following Indicators of Program Quality (IPQ) will be the focus: • IPQ 3-Career Pathways Collaboration • IPQ 4-Curriculum and Instruction • IPQ 7-Organizational Capacity • IPQ 8-Educational Leadership • Indicators will be rated using IPQ-specific rubrics
Ratings Ratings will: • Be assigned at the standard and/or indicator level; • Be based on solid evidence; • Be used as corroborative evidence in future funding decisions; • Capture the program’s performance at the time of the visit; • Inform the site visit technical assistance process; • Inform the program’s continuous improvement process.
Ratings-cont. • Exemplary: The program demonstrates consistent evidence related to all standards of the Indicator and is a potential exemplar in this area. • Proficient: The program demonstrates consistent evidence related to most standards of the Indicator and/or minor concerns are noted. • Developing: The program demonstrates inconsistent evidence related to the Indicator and/or moderate concerns are noted. • Limited evidence: The program demonstrates little to no evidence related to the Indicator and/or significant concerns are noted.
Data Collection Classroom Observations Classroom observations are scheduled for 30 minutes each and are conducted in such a way as to not disrupt classroom activities. The Review Team will visit several classes and use a rubric to gather evidence on activities and practices related to four essential elements of high-quality instruction: scaffolding, differentiated instruction, checking for understanding, and student engagement.* During the visit, the Review Team will interview program leadership, a sampling of teachers, advisors, and students. No written response to the interview questions is expected. Interview questions will relate to the four Indicators reviewed during the visit. For some of the Indicators, ACLS requires programs to have specific documents prepared for the day of the visit, prior to the team’s arrival. Document Review Interview Questions *Substitute teachers in classrooms the day of the visit will not be observed or interviewed.
Interviews • Each interview must be held in a secure, quiet location. • More than one interview may be scheduled at the same time during the visit. • Each participant must be present for the entirety of the interview and is given complete freedom to speak. • The Review Team Lead will work with the program director on the interview schedule with regard to staff that have multiple roles. • In general, supervisors and supervisees should not be in the same group interview.
Interviews-cont. Program Leadership Teachers • One hour and thirty minutes. • Must include staff who oversee the AE program directly and are responsible for its daily management (program director, assistant director, lead teacher). • One hour. • Must represent advisors who work with students at all levels. • One hour. • Should include a minimum of eight students and a maximum of ten students. • Should represent all levels and content areas serviced by the program. • Program staff must not be in attendance. • One hour and thirty minutes. • Should represent all levels and content areas serviced by the program. • Depending on program size, the group may vary in size. Final number to be decided during preparation phone call. Students Advisors
Structure of the Day – Sample Schedule #1 Sample Schedule for a smaller program, 2-3 member team. (*Note: Start and end times of activities are subject to change.) *Interview times may vary up to thirty minutes in length depending on the size of a program.
Structure of the Day – Sample Schedule #2 Sample Schedule for a larger, multi-site program, 6-7 member team (*Note: Start and end times of activities are subject to change.)
Logistics • The program director should inform the team of: • Parking logistics • Food allergy restrictions in the building • Meeting place in the morning • Debrief room • Interview room • ADA Accessibility • Review Team members cannot accept or solicit any meals. • Program director needs to be available throughout the day for any clarifying questions.
End of Day Report-Out • Program leadership and their supervisor are required to attend. • The Review Team will only share a set of preliminary observations, most likely on one of the four Indicators only. • The Review Team will not provide ratings or extensive feedback at this time.
Useful Documents • Program leadership and staff participating in the Program Quality Review should review the following documents in preparation for the visit: • Program Quality Review Protocol • Indicators of Program Quality • ACLS Performance Standards
Final Report and Next Steps • Program Director receives final report from the Review Team Lead. • Program Director works with Program Specialist and/or SABES on Indicators needing improvement. • Program Director develops an improvement plan if needed.
THANK YOU Adult and Community Learning Services (ACLS) 781.338.3850 75 Pleasant Street, Malden, MA 02148 http://www.doe.mass.edu/acls/
