1 / 37

UKFIET International Conference on Education and Development 15-17 September, 2009 Oxford, England

UKFIET International Conference on Education and Development 15-17 September, 2009 Oxford, England. The Politics of Formal Examinations: language policy and progress Convenors Pauline Rea-Dickins Guoxing Yu. The symposium. Rationale: all researching in contexts where:

chyna
Download Presentation

UKFIET International Conference on Education and Development 15-17 September, 2009 Oxford, England

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. UKFIET International Conference on Education and Development15-17 September, 2009Oxford, England The Politics of Formal Examinations: language policy and progress Convenors Pauline Rea-Dickins Guoxing Yu

  2. The symposium • Rationale: all researching in contexts where: • English as an L2/L3 is used in high stakes formal examining contexts: SSA, Malaysia, USA & UK • Politics & policy impacts on issues of fair & ethical assessment • Policy is intended to lead to progress & equitable distribution of resources & opportunities for ALL learners • Progress?

  3. The symposium Dr Ong Saw Lan (Universiti Sains Malaysia ) Narrowing the science achievement gap with the dual-language test-booklet Professor Jamal Abedi (University of California, Davis) Impact of language factors on the assessment outcomes of English language learners

  4. UKFIET International Conference on Education and Development15-17 September, 2009Oxford, England The Politics of National Examining Processes: the case of languages in Zanzibar Abdulla H. Mohamed, Pauline Rea-Dickins, Guoxing Yu Student Performance in National Examinations: the dynamics of language in school achievement (SPINE) www.bristol.ac.uk/spine(ESRC/DfID RES-167-25-0263)

  5. Introduction 5 • Empirical data & documentary evidence reflecting some of the realities of national examining processes: • Student performance on exam items • Statistical data on student exam performance • Implementation of classroom assessment • The policy & the politics: historical perspectives: focus on CWA • Conclusions : policy & politics & issues of justice in examining • progress?

  6. Student performance on exam items English RC Qn: How whales resemble man 45 students took this item: • 35.6% = no answer • 26.7% = wrong answer • 28.9% = partially correct answer • 8.8% = correct answer

  7. Interview: D1 who didn’t answer Q3 explains D1: “because I did not understand by this this … resemble” (lines 115-117) Int: “If I tell you that resemble means ‘to look like’ … can you do the question now? D1: “Yes” Int: OK so what’s the answer? D1: “Man … is warm blooded … and whales also … whales have lungs and man also have lungs …” (122-133)

  8. Biology: responses to original item • No answer = 67.4% • Wrong answer = 21.7% • Partially correct answer = 6.5% • Correct answer = 4.4%

  9. Biology: on locusts

  10. Biology: on locusts

  11. Biology: on locusts Questions: a) In which picture do you think the locust will/may die? b) Why do you think it will/may die?

  12. Original item modified: • Greater contextualisation • Simplification of instruction • 2 structured parts: A & B • Visual clues to support information retrieval • Rephrasing of the item • Altering item layout

  13. Results • Original item • Only 32.6% of students wrote an answer • Just under 11% gave a partially correct or correct answer • Modified item • 100% responded to this item • 42% gave a partially correct answer to Part A • 53% gave a partially correct answer to Part B

  14. Changes in student response

  15. Means of Form II Exam Results (MoEVT)

  16. ENG and MATH

  17. ENG and BIO 17

  18. English and CHEM

  19. How about KISWAHILI & ARABIC? • Although other two languages (Kiswahili and Arabic) are also significant predictors of the students’ performance in maths, biology and chemistry, it is noted that they are less capable of explaining the variances than ENGLISH. • KISWAHILI explains (275.993-88.954)/275.993=31.54% of CHEM total variance, (114.968-76.585)/ 114.968=33.39% of BIO total variance, (90.4-75.678)/90.4=16.29% of MATH total variance. • ARABIC explains (275.993-203.452)/275.993=26.28% of the CHEM total variance, (114.968-88.569)/114.968=22.96% of the BIO total variance, (90.4-71.885)/90.4=20.48% of the maths total variance.

  20. Summary of the multilevel models (a) • It is very clear that ENGLISH is a significant and substantial predictor of the students’ performance in MATH, BIO & CHEM. • The school-level variances explained in the cons models as well as in the models including ENGLISH as the single explanatory variable demonstrated a substantial proportion of the variance is attributable to school factors

  21. Summary of the multilevel models (b) • Not much improvement in terms of fitness of the models (measured by the change of % of school-level variance in the total variance). • Therefore, essential to collect further school- and pupil-level data to examine what factors (e.g. English language learning opportunities at home and at school, academic English proficiency) and how much they account for the variances (in the tradition of school effectiveness studies) – our plan for nationwide data collection using pupil and headteacher questionnaires and vocabulary knowledge test

  22. Coursework assessment as part of national examining: implementation issues In Form II, Teacher Assessment (TA) was implemented based on the following assessment procedures: • Class work • Oral questions • Homework • Weekly tests • Terminal tests

  23. Continuous Assessment Format & Guidelines • Term: --------- Class: --------- subject---------

  24. Coursework assessment as part of national examining: implementation issues • The first three activities make up 40% and the fourth makes 60% which when combined make 100% • The final score (out of 100% ) obtained is sent to the Department of Curriculum and Examination for further processing (CWA is 25% of overall exam score)

  25. Coursework assessment as part of national examining: implementation issues However: significant variability among teachers: • the types of specific activities that constitute teacher assessment • the number of activities from which they take marks for each month • decisions on how to handle student absenteeism • how to get 10% of marks for each month; some picked the one that students did better on, some picked randomly, and some put the average of all marks

  26. Coursework assessment as part of national examining: implementation issues • Understanding of what assessment is to be done • Awareness of guidelines • Percentage of marks that go to the final examination • Sharing what teachers know and practice about assessment guidelines among teachers within and across schools • Level of monitoring of Teacher Assessment by head teachers.

  27. Continuous Assessment Format & Guidelines • Note: Coursework assessment will be obtained from class works, home works and weekly tests or as it will be directed otherwise by the Department or the Ministry. All the marks scored by the pupil from the mentioned activities within a particular month, will be combined and transformed into percentage of ten (10%) before filled in the relevant space in this form. • Source: Ministry of Education Working Guidelines: Guideline No. 9 (1995)

  28. Continuous Assessment format & Guidelines Additional notes from another version • If the term is less or more than four (4) months, four activities chosen by the teacher him or herself should be picked at equal intervals. The teacher is advised to give as many tests as he can in a term but should choose only four for recording. • In getting pupil’s marks for terminal exam for each subject, the exam itself should contribute 60% and classroom assessments (coursework assessments) should contribute 40%

  29. Coursework assessment as part of national examining: implementation issues • The language to be used is as indicated in the lesson plan. • These notes appear to contradict with the first version which might be leading to confusion. This version requires the teacher to find average of marks in a month while the second requires the teacher to choose one activity from which the marks can be recorded. • Source: Ministry of Education Working Guidelines: Guideline No. 9 (1995)

  30. The Policy & the Politics: historical perpsectives • The need to make Assessment procedures more friendly, less competitive and practically focused • The prescription that student assessment must: • Include works that can enable students to function effectively in their environments • Cover both student performance in theoretical works and in practical productive works • Be done throughout the year

  31. The Policy & the Politics: historical perpsectives • The National Examination Council of Tanzania (NECTA), formalised the new examination system by including projects, character assessment, exercises and tests in the assessment system Teachers were then given responsibility to: • measure students’ ability to use knowledge and skills acquired, in their local environments and, • keep ongoing records of their progress

  32. The Policy & the Politics: historical perpsectives Tanzania and Zanzibar Education Policies • Both The Tanzania Education and Training Policy (1990:79) & The Zanzibar Education Policy (2006:28) emphasised that continuous assessment combined with the final exam paper would be the basis for awarding of certificates at Secondary Education levels • For selection purposes and quality control, consistency between teacher assessment and that of the National examinations was emphasized in The Zanzibar Education Master Plan of 1996-2006

  33. Language Policy and Assessment • Students assessment is affected by Language policy because students have to demonstrate knowledge and ability through a language accepted by the system. • The Zanzibar Education Policy of 1995, Kiswahili version Section 5.72 (28), The Zanzibar Education Master Plan of 1996 (43), the Education Policy of 2006, all emphasized the use of English Language as a language of instruction for all subjects in secondary education except for Kiswahili and Islamic studies.

  34. Language Policy and Assessment So, English, as a language of instruction in teaching science, maths and so forth at secondary level must be a language of assessment Does this have to be the case?

  35. Policy & Politics: progress for learners & learning? Given that English is politically& policy wise the language of the examinations: • “No test taker shall be harmed by the test (Hamp-Lyons 1989:13) • No learner should be disadvantaged, in the interests of justice for ALL learners • Ethical issues re. fairness: need to give individual a fair chance

  36. Policy & Politics: What progress towards social justice?

  37. Policy & Politics: What progress towards social justice?

More Related