The Great Divide

1. The Great Divide All tests are one of two basic types: • a norm-referenced test (NRT) • a criterion-referenced test (CRT) NRTs and CRTs are very different, and are used to make different kinds of educational decisions

2. Norm-referenced test (NRT) The major reason for using a norm-referenced test (NRT) is to classify students. NRTs are designed to highlight achievement differences between and among students to produce a dependable rank order of students across a continuum of achievement from high achievers to low achievers. Stiggins, 1994.

3. Criterion-referenced test (CRT) While norm-referenced tests ascertains the rank of students, criterion-referenced tests (CRTs) determine “what test takers can do and what they know, not how they compare to others”. Anastasi, 1988.

4. Differences Between NRTs and CRTs • How student scores are interpreted • With NRTs, a student’s performance is compared to all other students who took the test. • With CRTs, a student’s performance is compared to the amount of course material covered.

5. Differences Between NRTs and CRTs • What is measured • With NRTS, general language ability or proficiency is tested. • With CRTs, specific objectives-based language points or skills are tested.

6. Differences Between NRTs and CRTs • Purpose of testing • With NRTs, the purpose is to spread students out along a continuum of general abilities. • With CRTs, the purpose is to assess the amount of course objectives-based materials the students know.

7. Differences Between NRTs and CRTs • What students’ scores will look like when plotted on a graph • With NRTs, students scores are distributed along a ‘normal distribution’ pattern (bell curve) around a mean (average) score, regardless of when they take the test. • With CRTS, students should get low scores at the beginning of the course or course component and high scores at the end.

8. Differences Between NRTs and CRTs • Test structure • With NRTs, there are a few long subtests with very different contents on the test questions. • With CRTS, there are a series of short subtests corresponding to course objectives with similar contents on the test questions.

9. Differences Between NRTs and CRTs • What students know about the test questions in advance • With NRTS, students have no idea what content to expect in the test questions. • With CRTs, students should know exactly what content to expect in the test questions. Activities students do in their classes should be rehearsals for what they have to do on a CRT.

10. Selection - Entrance (to a programme) - Readiness (for a programme) NRT, because you want to compare individual applicants overall with other applicants taking the same test Different Purposes for CRTS and NRTs

11. Placement NRT, because you want to find the appropriate level within a programme for a student who is entering a programme with a number of other students Different Purposes for CRTS and NRTs

12. Diagnosis CRT, because you want to measure specific points of the students’ knowledge in relation to the goals of the programme or course. Different Purposes for CRTS and NRTs

13. Progress and Grading (achievement) CRT, once again because you want to measure specific points of the students’ knowledge in relation to the objectives of the course. Different Purposes for CRTS and NRTs