英语教学评估

1. 英语教学评估 首都师范大学英语教育系 任真 June 2006

2. 教师们常说：高考不改我不改；高考怎 么改我怎么改。 请思考： 1．关于评价，教师应知道些什么？ 2．如何使课堂评价促进学生学习积极性？ 3．什么样的形成性评价具有可信度和操作性？ 4．如何对情感态度、文化意识进行评价？ 5．如何评判试题/试卷的质量？ 6．高考与学业考试的区别在那里？

3. 教师为什么要了解评价？ 传统的解释 • 诊断学生的优势与不足 • 监控学生的进步 • 给学生评定等级 • 评定教师的教学效果

4. 新理由 • 学生在评价中的表现越来越多地被当作教师评估过程的一部分 • 评价工具有助于教师明确教学目标，并进而改善教学质量 • 测验结果影响公众对教育效果的认识

5. 评价改革的思路是什么？ • 在评价活动中学生是参与者和合作者 • 通过评价，学生认识自我，建立信心 • 教师获取反馈信息，反思教学 教师在评价改革中的作用： 实践者 (practitioner) 、帮助者 （facilitator)

6. 教师为什么需要对教学行为进行反思 教师培训概念的变化 • Teacher training - skills • Teacher education - theories • Teacher development - reflection (强调教师反思教学，观察自己的课堂行为，评估自己的教学效果）

7. 反思、调整 Student needs Instructional objectives Match Mismatch Decision Decision Continue with Modify Select students instructional plans objectives whose needs match objectives

8. 思考 • A teacher has gone through a textbook three times. Still the students are not developing as she had planned. • Changes in instruction are called for. • The specific changes she makes will depend on her interpretation of why student performance is below expectation

9. 关于评价，教师应知道些什么？ • 不同的评价方法 （课堂评价方法不只是纸 笔测验一种形式。） • 评价的基本原则 • 评估教育的标准 • 如何评判自编试题以及他人所编试卷的质量 • 如何对测验的结果进行解释

10. 关于评价方法 • 形成性评价(formative assessment ) 在学习过程中通过教师和学生共同实施的评价。评价应发挥学生自我评价的能力，使他们能够及时地、主动地去了解自己学业进展情况，肯定成绩，发现问题，增强信心。 To provide immediate feedback which leads to improvement

11. 学生自评 • Self-assessment can increase learners involvement in and responsibility for their own learning • Actively involving learners in assessing their own progress can sensitizethem to instructional objectives and assist hem in setting realistic goals

15. 自评要与其他评价相结合 The information from self-assessment should always be used in conjunction with data from other assessment methods. • Portfolios • Journals • Questionnaires • Interviews • observation • Tests

16. 关于评价方法 • 终结性评价 （summative assessment） 教学程序后完成，例如学期结束或结业的时候，对学习结果进行评价。 To provide a public outcome statement on performance at the end of a period of language instruction.

17. 值得思考的问题 • 形成性评价不是否定终结性评价 • 反复、高频考试（a series of mini-summative assessments)不等于形成性评价 • 形成性评价应具有可信度和操作性（不是简单地划 或打分

18. 关于考试类型 常模参照考试 norm-referenced test - a candidate’s scores are interpreted with reference to the performance of the other candidates. - it is more concerned with spreading individuals

19. 学业考试achievement test refers to the mastery of what has been learnt, what has been taught or what is in the syllabus, textbook, materials, etc.

20. 值得思考的问题 • 每次考试后该不该给学生排名次？ • 难题是否能激励学生学习？ • 其中期末考试大部分学生不及格说明什么？

21. 评估考试的标准 可信性 reliability 有效性 validity 可行性 practicality 真实性 authenticity 后效性 backwash/ impact

22. 可信性 • 信度是测试结果的可信、可靠的程度 • 测试的分数所反映的被试的表现的可信、可靠程度 • 信度高的测试有很好的一致性 (consistency)和稳定性(stability)

23. 有效性 指测试在多大的程度上测量 与其要测量的东西，能够在 多大程度上达到预期目标。 2006年高考考试大纲修订说明(英语) 语言知识题的命制原则为：保证知识覆盖面；

24. 可行性 Practicality (usability) • 指命题人的想法是否切合实际 可行性的测试应： • 便于组织 Ease of Administration • 便于评分 Ease of Scoring • 便于解释和利用分数Ease of Interpretation

25. 区分性 (discrimination) • A fundamental property of language tests (especially norm-referenced) in their attempt to capture the range of individual abilities. • The more widely discriminating the test the better it is. • An important indicator of a test’s reliability

26. 值得思考的问题 • 高考试卷应有较强的区分能力，使其能够区分不同语言水平的考生，否则会影响为高校选拔新生的录取工作。 • 期中、期末考试，毕业会考数与学业考试，通常绝大多数考生能够过关，不及格的人所占比例不宜过大。 • 试题过难或过于容易，区分性都可能是比较差。

27. Example • 任务的真实性 e.g. Suppose you were applying for a position as sales clerk in a store where English was spoken, what might be your reaction to a test that required you to summarize orally a letter to the editor of a newspaper?

28. 后效性 (Impact) • Tests are developed and used to serve the needs of an educational system or of society . • The uses we make of test scores imply values and goals and these uses have consequences for, or impact on, both the individuals and the system involved. (Bachman, 1996.30)

29. Examples • 北京高考 2003，2004 开放作文 - 重视语用，创造性思维 • 全国统一高考2001 取消辨音题，增设听力部分。 知识运用由2000年20题减为2001年的15题 - 重视语言交际，技能，真实性。 引导社会重视听力。 • 北京高考2004 情景作文，让学生根据图表写出对课余活动的看法。大部分学生得出的结论是：业余活动时间太少，作业太多。这反映出某些问题：getting information, chart, opinion e.g. housework 5%, sports10%, computer13%, music 14%, TV 19%, homework 39%

31. 如何看待高考 • 高考与教材内容挂钩吗？ • 高考是仅考察了知识吗？ • 如何对情感态度、文化意识进行评价？ • 高考是怎样考察能力的？

32. 如何看待高考 • 2001年以来，全国英语高考在命题思想、内容结构、题型设计和考试方式上加大了改革力度。 • 高考试题突出语篇，强调应用，注重交际。 • 逐步将考试重点转向考查学生的中综合语言运用能力方面。

33. 试题分析 Good items [structure and usage] 2004 NMET - Can I look at the menu for a few more minutes before I decide? - Of course. ______ sir. a Make yourself at home b. Enjoy yourself c. It doesn’t matter *d. Take your time

34. [reading] 2004 NMET Giving Back Fair Way The Westborough High School golf team had taken the official photos with the state prize. The other teams, disappointed, were on the bus heading home. And then Westborough instructor Greg Rota noticed something wrong with one of the score cards. A 9 had been recorded as a 7. They were not the state prize winner; Wobum High had won. “No one would have known,” said Wobum’s instructor, Bob Doran. For Rota, it wasn’t a difficult decision: “The prize wasn’t ours to take.”

35. Question 60 What did Greg Rota probably do in the end? a. Took photos of Doran. b. Had a meeting with Doran. * c. Returned the prize to the organizer. d. Apologized to Wobum High School.

36. Question 61 Greg Rota’s decision shows that he was ______. *a honest b. polite c. careful d. friendly

37. 情感教育 care for others • 语言知识 explain words in English • 策略 dictionary use

38. 如何评判试题/试卷的质量 Purpose of the test Quality of the items Statistical analysis

39. Weak items[Structure] -- May I smoke here? [authenticity] -- No, you _______. *a mustn’t b. don’t c. must d. needn’t – You want ______ sandwich? [more than one answers] --Yes, I usually eat a lot when I’m hungry a. other *b. another c. others *d. the other

40. Avoiding Problems 1.Mixed response John ______ flowers to the party last night. a. carries b. carried c. lifts d. lifted [This item is as much a vocabulary item as it is a grammar item.]

41. 2. Length cues In the story, the merchant was unhappy because it ____. a. rained b. was dark c. was windy d. was windy and rainy and he had forgotten his raincoat. We had neither read nor understood the story in question, still we might choose option (d) and stand a reasonable chance of getting the item correct.

42. 3. Inconsistent Distractor Cues Examine the following set of distractors a. ran b. runs c. is running d. fast (d) Differs from the other options both in lexical root and in part of speech. We would eliminate that option at the start. In effect, the item has only three viable options, making it a simpler item than intended.

43. 4. Nonsense Distractors They said they ____ a. had gone. b. had go c. have went d had went They tend to be weak distractors. They have negative washback on students because they may learn errors from the examination itself.

44. 5. Review options The stranger had left his native land because he ______. a. wished to seek his fortune b. wanted to avoid his creditors c. preferred the new land d. none of the above e. a and b but not c above f. b and c but not a above (d) (e) (f) require the examinee to review the previous options, concentrating on small information. Such items may be more useful as measures of concentration and reasoning power than of reading comprehension.

45. 6. Trick questions When is it not appropriate not to be absent from class? a. When you are sick b. When you are young c. While class is in session d. Whenever the teacher is angry It is difficult to say whether the teacher’s motive is to display cleverness, to embarrass the students for revenge, or to ensure test difficulty (Henning,1987) Trick questions promote guessing, poor motivation, unfavorable attitudes toward the teacher and the target language.

46. 7. Common knowledge responses We learn from this passage that Napoleon was ___. a. British b. French d. Polish d. German The answer is common knowledge for most persons regardless of the content of the reading passage.

47. 8. Redundancy The boy took the newspaper ___. a. because he wanted to read it b. because he wanted to wrap a gift in it c. because he wanted to dispose of it d. because he wanted to remove an article To read an excess of redundant material makes the exam inefficient. Too much time is required to elicit the information gained.

48. 如何在教学中提高学生的语言能力[人教版高中1册 p5]

50. [人教版高中1册 p11] Vocabulary