A8 01 Section 7 October 24, 2012

1. A801 Section 7October 24, 2012 Assessing the Performance of an Education System

2. Agenda • Situating Ourselves in the Course (1 minutes) • Discussion of the readings (10 minutes) • Reimers & McGinn, Informed Dialogue • Kremmerer, Utilizing Education and Human Resource Sector Analyses • OECD’s Education at a Glance (2011) • Student section Leading (45 mins) • Logical Framework (30 minutes) • Housekeeping & Questions (5 minutes)

3. Course Overview • 1 • Introduction to Comparative and International Education • 2 • The Process of Policy Analysis • 3 • Education Policy Options

4. Course Overview • 1 • Introduction to Comparative and International Education • 2 • The Process of Policy Analysis • Week 6 – How Education Policy is Made • Week 7 – Assessing the Performance of an Education System • Week 8 – Policy and Program Evaluation

5. Case Studies from Informed Dialogue Summary

6. Kremmerer Summary

7. Education at a Glance Summary

8. Student Section Leading

9. Program Theory “Program theory…refers to the mechanisms that mediate between the delivery (and receipt) of the program and the emergence of the outcome of interest. The operative mechanism of change isn’t the program activities per se but the response that the activities generate.” - Carol Weiss, Evaluation, p. 57 You will be reading a section of this book for next week.

10. Program Theory For each program, there may be multiple pathways to the intended outcome. GOAL: More 6-year-olds in school

11. From Program Theory to Implementation to Evaluation • Logical Frameworks • can help you to organize: • Design • Implementation • Evaluation • Developed by USAID in the 1960s • Vary slightly, but always include: 4 x 4 • Narrative Summary, Indicators, Means of Verification, and Assumptions

13. Logical Frameworks

14. Logical Frameworks THEN IF AND THEN IF AND THEN IF AND

15. Logical Frameworks

16. Logical Frameworks

17. Logical Frameworks

18. Logical Frameworks

19. Logical Frameworks

20. Logical Frameworks

21. Logical Frameworks

22. Appendix

23. Sector Analysis: What is it? • Sector Review: summary of the state of the sector • Sector Assessment: success of the sector in meetings certain goals • Sector Analysis: (most comprehensive) includes review and assessment (above), and also describes sector needs, constraints, and opportunities for improvement. • (Kremmerer, 1994)

24. Sector Analysis: What is it? Tries to answer questions relating to: • External efficiency • Internal efficiency • Access & equity • Administration & supervision • Costs & financing (Pigozzi & Cieutat, 1998)

25. Sector Analysis: What is it? The contents of a sector analysis may include: • Synthesis • Economic & Financial Analysis • History, Structure & Management Capacity • Analysis by Sub-Sectors: • Special Studies • A list of background documents (Pigozzi & Cieutat,1988)

26. Sector Analysis: Steps Initiation Formation of the National Steering Committee Determination of the scope of the analysis Formation of the subsector teams Formation of the technical analysis team Instrumentation and collection of data Preliminary analysis of data Discussion of preliminary findings Collection of any additional data Formulation of draft recommendations Discussion of draft recommendations Revision and prioritization of recommendations. (Kremmerer, 1994)

27. Political Mapping: An Example

28. Political Mapping: An Example

29. Stakeholder Map: An Example