Introduction to CEM and the Baseline Tests

1. Introduction to CEM and the Baseline Tests Dr Robert Clark

2. Who / What is CEM ?

3. Centre for Evaluation & Monitoring • Not for Profit Organisation • Part of Durham University • Close links to School of Education • Established 1985 • Nursery / Reception  Post-16 • Monitoring Systems, Research and Evaluation Projects • UK & International • Over 1/3 Secondary & Post-16 Establishments • Informed by Evidence from Research

4. CEM Provides • Information Systems from Nursery to Post-16 • Student Guidance & Chances • Performance Monitoring • Evaluation & Research Projects • Entrance Testing • Support – Phone, email, documentation • Training • INSET • Roadshows • Conferences (including exhibitions)

5. The Systems

6. Alis GCSE Computer Adaptive Baseline Test A / AS / Btec / IB etc GCSE Yellis Computer Adaptive Baseline Test MidYIS Computer Adaptive Baseline Test The Systems Year 13 Year 12 Year 11 Year 10 KS3 Combines curriculum tests with developed ability INSIGHT Year 9 Year 8 Year 7

7. Early Testing & Predictions Typical Timeline • Testing is available from June at end of previous academic year e.g. Y6 / Y9 / Y11 • The baseline score is measured as early as possible and the information sent to CEM • The institution then receives feedback from CEM: baseline test results and predictions • The public examination results are sent to CEM when received by the institution • The value added data is available from September via the Institution’s website at CEM

8. Basic Principles: • Measure Student’s ability • Intake Profiles • IPR - Strengths and Weaknesses • Project future performance from national trends • Predictions • Record Final Grade • Compare actual performance to Projected Performance • Value-Added Reports

9. Starting Up

10. Pre-16 • Complete and return registration form • Paper for new schools • Online through secure website for renewals • Organise Baseline Testing • Available from 1st June (early testing) through to 30th April • Upload pupil list via secure website • Set up web links to test (or download LAN version) • Test students (can be done over extended period) • Download Feedback • Available within 2 hours of a student completing the test • Feedback updated as more students complete test

11. Secure Website - Secondary : Pre-16

12. Secondary : Pre-16 – Adaptive Test Instructions Download Instructions Upload Pupil Details Link to tests

13. Secondary : Pre-16 – INSIGHT Test Instructions Download Instructions Upload Pupil Details Link to tests

14. Post-16 • Complete and return registration form • Paper for new schools • Online through secure website for renewals • Organise Baseline Testing • Available from 1st June (early testing) through to 30th April • Student list NOT used – do not need to upload • Set up web links to test (or download LAN version) • Test students (can be done over extended period) • Upload ‘Registration Spreadsheet’ • Names, gender, dob, average GCSE score, post-16 course choices etc • Upload via secure website once students confirmed on course (mid September ?) • Download Feedback • Early Predictions available from adaptive test within 2 hours • Formal feedback including IPRS, GCSE predictions and chances graphs available once Registration Spreadsheet processed & ‘Testing Complete’ clicked

15. Secure Website - Post-16 Date last generated Quick links to reports

16. Post-16 : Adaptive Test Instructions Use this web link

17. Baseline Assessments of Developed Ability

18. Baseline Assessment • Year 7 (8) • Year 9 • Year 10 (11) • Year 12 (13+) Computer Adaptive Baseline Test Vocab Maths Non Verbal

19. What is an Adaptive test ? • All questions allocated to groups of different difficulty • All students in a year group get common difficulty starting question • If answer correct, next question harder • If answer wrong, next question easier • Test looks at all answers in a section and homes in on questions of a suitable difficulty for student Try it yourself at www.intuproject.org/demos

20. X         

21. Standardisation • Test scores are standardised; Mean = 100, SD = 15

22. The Computer Adaptive Baseline Test: Adaptive components common to MidYIS, Yellis, and Alis are: Vocabulary Maths Non- adaptive sections: Non-verbal (MidYIS, Yellis, Alis) Skills (MidYIS only) Assessments are ‘curriculum free’: i.e. students are not taught prior to the test Measure of acquired ability There is no preparation for the test

23. Difficult vocabulary

24. Difficult maths x/4 + 2

25. Non-Verbal: Cross-sections

26. Non-Verbal: Blocks 3

27. Pictures Non-Verbal: Pictures

28. Skills: Proof Reading

29. Skills: Perceptual Speed and Accuracy

30. Alis - Patterns

31. Alis – Logical Reasoning

32. INSIGHT Curriculum-based assessments covering: Maths- Number & Algebra - Handling Data - Space, Shape & Measurement Science- Biology, Chemistry, Physics, - Attitudes to Science Reading- Speed Reading - Text Comprehension - Passage Comprehension • Additionally for INSIGHT: • Developed Ability • Vocabulary • Non verbal,Skills • Attitudinalmeasures

33. INSIGHT - Maths 7

34. INSIGHT - Maths

35. INSIGHT - Science Plus Attitude to Science: Perception of Science, Relevance to Self, Environmental Actions, Enjoyment of Science

36. INSIGHT – Reading(Text Comprehension)

37. INSIGHT – Reading(Passage Comprehension)

38. INSIGHT – Reading(Speed Reading)

39. INSIGHT – Developed Ability

40. Measuring Ability Key Stage Data or Baseline Test ?

41. Key Stage Baselines – KS2; GCSE Independent Baseline Test – CEM Adaptive Test

42. Thank You Robert Clark – robert.clark@cem.dur.ac.uk