SPDG Bidders Webinar May 4, 2010

1. SPDG Bidders WebinarMay 4, 2010 Planning for a Good Evaluation The extent to which the methods of evaluation are thorough, feasible, and appropriate to the goals, objectives, and outcomes of the proposed project. Rebecca Walker, Director Glen Martin Associates rwalker@glenmartinassociates.com 1

2. Extent to which the methods are appropriate: Lesson Learned #1: Focus, Focus, Focus • Avoid abstract language and concepts, such as: • Objective 1: Through shared meaning and vision, groundwork will be laid for systemic changes, long-term sustainability, and institutionalization of evidence-based practices. • Be clear and concise: Are these different? • Objective 2: To increase the number of paraprofessionals trained to become special education teachers. • Objective 3: Expand the pool of licensed special education teachers from which urban LEAs can draw to fill personnel vacancies. • Performance measures aren’t tracking devices 2

3. Extent to which the methods are thorough: Lesson Learned #2: Use Mixed Methods • Utilize quantitative and qualitative approaches, such as: • Student outcome data (SWIS and EIP) and school site visits • Paraprofessional outcome database and surveys/focus groups • Consider validated and project-developed measures, such as: • School-wide Evaluation Tool (SET)- validated fidelity measure • Literacy Evaluation Tool (LET)- project-developed self-assessment 3

4. Extent to which the methods are thorough: Lesson Learned #3: Involve all stakeholders in the evaluation process, such as: • When conducting school site visits/focus groups • Clarify purpose (tell me 3 things you want to know) • Communicate role (FAQ) • Report informally and formally 4

5. Extent to which the methods are feasible: Lesson Learned #4: Be flexible and adaptable, such as: • When working with SPDG project staff • Recognize evaluation anxiety • Find out who really has the data • Don’t collect data you are not going to use or stop collecting data you’re not using 5