1 / 45

大学英语 教改口语考试

大学英语 教改口语考试. 中国科学技术大学 李萌涛. 大学英语教改口语考试. 一、大学英语教改和口语考试 二、口语考试数据及分析 三、口语试题库 四、口语试题库的信度和效度研究 五、口语评分标准. 一、 大学英语教改和口语考试. 大学英语改革 改革的目标是要全面提高大学生的英语综合实用能力，特别是强化听说能力。 利用英语口语考试的反驳效应 ，促进口语教学。 学生基数太大，采用口语考试系统实施大规模的口语测试成为可能。. 中国科学技术大学 04 级网络多媒体英语教改试点班英语口语考试现场. 二、口语考试数据及分析

menora
Download Presentation

大学英语 教改口语考试

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 大学英语教改口语考试 中国科学技术大学 李萌涛

  2. 大学英语教改口语考试 一、大学英语教改和口语考试 二、口语考试数据及分析 三、口语试题库 四、口语试题库的信度和效度研究 五、口语评分标准

  3. 一、大学英语教改和口语考试 • 大学英语改革 • 改革的目标是要全面提高大学生的英语综合实用能力，特别是强化听说能力。 • 利用英语口语考试的反驳效应，促进口语教学。 • 学生基数太大，采用口语考试系统实施大规模的口语测试成为可能。

  4. 中国科学技术大学04级网络多媒体英语教改试点班英语口语考试现场中国科学技术大学04级网络多媒体英语教改试点班英语口语考试现场

  5. 二、口语考试数据及分析 • 2004年10月，中国科学技术大学2004级英语教学改革试点班学生英语口语摸底考试，实考517人。 • 2005年1月，中国科学技术大学2004级全体本科生英语口语期末考试，实考1815人。 • 2005年6月，中国科学技术大学2004级全体本科生英语口语期末考试，实考1798人。 • 2005年12月 1813人 • 2006年6月 1798人 • 2007年1月 3707人（二个年级）

  6. 1. 对05、06级学生进行问卷调查 • 05级90名学生，06级89名学生 • 各有51.1％、77.5％的学生选择重视口语机考 • 各有53.3％、49.2％的学生支持采用机考 • 06级学生有67.2％的学生认为，机考能体现其口语水平的60-80％

  7. 2. 对教师的问卷调查数据分析 • 收回14份老师问卷 • 13位老师支持机考，认为能反映出学生口语水平 • 92.9%的老师认为，用机考成绩来解释学生口语能力的可信赖程度达到70~90% • 对照机考口语成绩与期末笔试成绩，有70-80％的相关度

  8. 三、口语试题库 四所院校共同编写： • 中国科技大学 • 复旦大学 • 苏州大学 • 西南交通大学

  9. 多种题型、与教材配套、内容丰富的英语口语试题库多种题型、与教材配套、内容丰富的英语口语试题库 • 系统支持文本、图形、语音和视频等多种媒体，具有主题和级别等试题指标。 • 试题由多所高校优秀英语教师和测试专家开发。

  10. 口语试题库的定位 • 学业考试(Performance Test),所测即所学。 • 主题式(topic-based)，有近似主题，难度、要求不同。 • 综合＋听说教材里所涉及的主题。 • 涵盖全新版和修订版所有主题。 • 部分题型模拟四、六级口语考试形式。

  11. 口语考试题型 • 目前有7个题型，Reading aloud用于Band 1-2。每套题至少要包括以下4－5个题型。 • Reading aloud • Listening and speaking • Questions and answers • Comment on English sayings and quotations • Describing pictures • Talking about movies • Group discussion

  12. Group Discussion • Part 4 Discussion [5 minutes, 20 points] Each group is composed of three students – Student A, Student B and Student C. Topic: UFOs are alien spacecraft from outer space

  13. The UFO phenomenon may have existed for over a half-century and UFO sightings are becoming more and more frequent around the world. Some people think these objects are alien spacecraft, although there is no conclusive evidence yet. There is no doubt that unidentified flying objects in the sky do exist. But the question is — what are they? Are UFOs alien spacecraft from other planets?

  14. You will have about 5 minutes to discuss on this topic. Each person can only talk for one minute at a time. During the discussion, you may voice your opinion, argue with each other, or ask somebody to clarify his or her points. Your performance will be judged according to your contribution to the discussion.

  15. Hints: • Numerous UFO photos in the world can show UFOs are alien spacecraft. • Many planets outside the solar system are similar to the Earth. So there is a possibility that aliens do exist. • Nearly all photographs are blurry and many have been proved to be forgeries. • There is no evidence of intelligent aliens living anywhere in our solar system or in outer space. [准备时间：20 seconds] [答题时间：60 seconds]

  16. 2006.2.完成第一批48套试卷，即每一级配12套试卷，每年淘汰2套，并可升级更新。2006.2.完成第一批48套试卷，即每一级配12套试卷，每年淘汰2套，并可升级更新。 • 2007.2.完成第二批48套试卷，即每一级配12套试卷，每年淘汰2套，并可升级更新。 • 可以自由组建试题 • 可以增减考试内容

  17. 四、口语试题库的信度和效度研究 • 为什么要口语考试？ Assign grades Improve instruction Motivate students to work Provide feedback to students

  18. 如何进行口语考试？ Testing • Objective • Subjective • Formative • Summative

  19. Formative Testing • Using measurement tools to conduct evaluation for the purpose of improving student performance • Student receives feedback of results • Teacher considers results in planning subsequent instruction • Grades are not recorded!

  20. Summative Testing • Using measurement tools to conduct evaluation for the purpose of assigning student grades • Student receives feedback of results • Teacher considers results in planning subsequent instruction • Grades are recorded

  21. 口语试题库分级 • 分为四级，对应教学内容 • 难度控制 • 参照课本难度 • 参照国内外口语考试难度 • 确定难度上限，略高于四、六级口语考试难度 • 依据教学实践、课堂口语活动

  22. 合作研究口语试题库和考试系统 • 与国内大学和机构合作（出版社、讯飞） • 与国外大学合作Bath University (UK) • 对比研究，机考vs面试 • 试题库科学分级、信度、效度等研究 • 人机交互研究，智能（半智能）阅卷 • 学生在机考时的心理变化研究

  23. 五、口语评分标准 • 准则参考性口试（criterion-referenced oral test) • 常模参考性口试（norm-referenced oral test)

  24. Criterion-Referenced Test • Measures student performance against predetermined standards • Student meets or does not meet the standard • Competition is between the student and the skill, knowledge, or ability • Grade is based on accomplishment • Everybody can earn a passing grade if they meet the standard

  25. Norm Referenced Test • Make test intentionally difficult • Average score should be about 50% • Strong students should tend to score high and weak students should tend to score low • Award As for highest scores, Fs for lowest scores, Cs for average scores

  26. Characteristics of a Test • Validity • Reliability • Objectivity • Discrimination (applies to norm-referenced test only) • Comprehensiveness • Score-Ability

  27. Validity • A valid test measures: • what it is intended to measure • what the teacher intended for the students to learn • what the teacher actually taught • A valid test is FAIR

  28. Questions about Validity • Does the test actually measure what you intend it to measure? • Did you teach the content and skills that are being tested? • Does the test require the student to know or do something other than what you intended and/or taught? • Does some aspect of the test prevent the student who may know the material from responding correctly?

  29. Reliability • A reliable test provides accurate and consistent results • Test reliability can be viewed from two perspectives: • Student reliability • Scorer reliability

  30. Student Reliability • Test items are readable and clear • Instructions are simple and unambiguous • Responses test only knowledge of the subject matter and not test wiseness, reading ability, or other unrelated trait

  31. Scorer Reliability • Items can be scored consistently • Same scorer would produce similar results on repeated evaluations • Different scorers would produce similar results if working independently

  32. Objectivity • Objectively written • items are reliable • items are valid • Objectively administered • Objectively Scored

  33. Discrimination • Important ONLY for norm-referenced testing • Test separates more knowledgeable students from less knowledgeable students • Discriminating test is intended to reward best students and punish weakest students • Ideal for using normal curve to interpret score

  34. Normal distribution • On most measures of human behavior, graphing individual results will result in a “bell-shaped,” or normal distribution curve • Most individual scores will fall toward the middle (mean) • Fewer scores will fall toward the upper and lower ends

  35. Bell-shaped Curve Lowest Scores Highest Scores Average Scores

  36. 口语考试评分 • 测量出某个考生在整个群体中的相对位置 • 相对公平，不受相貌、肢体语言的干扰 • 可重复阅卷 • 等级的确立 （1－5） • 综合评分（Holistic marking） • 分析评分（analytic marking)

  37. 教师培训 • 参照标准 • 确定样本 • 教师分工 • 分数调整

  38. 1. 参照标准 • 评分采用准则参考性和常模参考性相结合的评分方法，从内容、语音和流利程度三个方面分析评价考生的英语口语水平。

  39. 评分卡： • 内容 • 语音 • 流利度 平均分： (1，2，3，4，5，可用小数点，总数相加)

  40. 2.确定样本 • 从往年学生录音中选取有代表性的口语样本 • 每个分数段取2个样本 • 2－5分的样本 • 样本录音

  41. 3.教师分工 • 由系统指派班级给阅卷老师 • 人工调整，分散班级 • 专门指派有经验的老师抽查阅卷

  42. 4.分数调整（正态分布）

  43. Thank you! mtli@ustc.edu.cn

More Related