Evaluating, Scoring, and Writing Comments for Results Items

1. Evaluating, Scoring, and Writing Comments for Results Items

2. You will be able to • Explain the purpose of results • Describe where results are found • Describe the information requested in Results Items • Indicate that results respond to “what” questions • Apply the evaluation process to a Results Item • Describe the elements of a good Results comment • Write Results comments that include those elements

3. Results Items • Answer “what” questions • Link to important processes and action plan requirements • Cover students/customers, products/services, market/financial, HR, operational, governance/social responsibility

4. Organizational Performance Results

5. Point Values for Results Items

6. Key Terms • Results • Summative assessment • Formative assessment • Measures and indicators

7. Key Terms, con’t. • Current levels of performance • Trends • Comparisons • Segments

8. Item Evaluation Process

9. The Item Evaluation ProcessStep 1

10. Item 7.1

11. The Item Evaluation Process Step 2

12. Item 7.1 Key Factors • Programs--regular, alternate, adult; K-12, ESL, LCC, ESP, NCS, special ed • 64 elementary schools, 30 middle, 8 high schools • requirements: academic excellence--most universal, highQ curriculum • strategic challenges--responding to NCLB/poverty pockets • Comparative data--SDE, ASVE, USEA, USAEP, SAT, PSAT, ESC, USSBO

13. The Item Evaluation Process Step 3

14. The Item Evaluation Process Step 4

15. Summary Notations • Phrases containing • Subject identified from the Criteria or application • Verb(s) and descriptive language from Criteria • Examples from the application • Citation of relevant figure numbers • Include • the Area to Address (e.g., 1a[1]) • +, -, ++, --

16. Scoring Factors to Consider • Performance levels • Rate and breadth of performance • Comparisons and benchmarks • Linkage

17. The Item Evaluation Process Step 5

18. Scoring Guidelines

19. The scoring process • Review Criteria requirements and summary notations • Note balance and importance of strengths and OFIs relative to Item requirements and the key factors • Read the description for a 50-65% range in the Scoring Guidelines to determine whether the applicant would score within, above, or below this range • Continue reading the descriptors until you have determined the range that is most descriptive of the organization’s achievement level • Read the range descriptions above and below the selected range to determine where, within the range, the applicant’s score would fall • Determine a percent score that is a multiple of 5 • Verify balance and importance of strengths and opportunities for improvement correspond to the score

20. Scoring Exercise

21. The Item Evaluation Process Step 6

22. Feedback-ready comment “Although satisfaction results are provided for some of the professional services provided by the applicant (Figure 7.2-7), results are not provided for other services such as speech and hearing therapy, social work, or psychological assistance. It is not evident how the applicant tracks progress in these areas, which may impact its ability to provide learning to others as a benchmark school district.”

23. Results comment format • Levels/numbers from, to: Performance Levels, Trends, Comparisons • Linkage to Criteria requirements, Org. Profile (KFs) • Gaps—what important results are missing? • So what… • Subject—The applicant or the result(s) • Verb(s) and descriptive language • Citations (Figure 7.-) • Timeframe— (in, from/to, during)

24. Item Evaluation Process

25. Linkage • To what extent do results link to key factors and Process Items (e.g., important customers/students, product and service, market, and action plans/ performance requirements)?

26. Comments Exercise

27. You will be able to • Explain the purpose of results • Describe where results are found • Describe the information requested in Results Items • Indicate that results respond to “what” questions • Apply the evaluation process to a Results Item • Describe the elements of a good Results comment • Write Results comments that include those elements