1 / 16

ePEN Reports English Team Leader Training - Module 3

ePEN Reports English Team Leader Training - Module 3. Learning Objectives. In this module you will:. Learn about the different reports available Understand how to interpret the reports Look at what actions to take using data from reports. Reports. There are 11 reports available on ePEN

tatum-andrews
Download Presentation

ePEN Reports English Team Leader Training - Module 3

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ePEN ReportsEnglishTeam Leader Training - Module 3

  2. Learning Objectives In this module you will: • Learn about the different reports available • Understand how to interpret the reports • Look at what actions to take using data from reports

  3. Reports • There are 11 reports available on ePEN • Go to ‘View Progress’ and ‘reports’ tab • You can run reports for all markers, just your team or for only one marker • Not all reports available need to be used by TLs • Examples of those that TLs most commonly used are shown • You will also complete a few short tasks to help you with the interpretation of the data

  4. Most useful ePEN reports

  5. Other ePEN reports available

  6. QC Practice AA number The number of responses attempted in the sets The number of sets attempted and the number passed The date/time the set was started and completed If it has not been completed it will be blank The % of marks agreeing with the true score and the % of marks within adjacency Item name

  7. QC Qualification AA no. The number of responses attempted in the sets Item name The date/time the set was started and completed If it has not been completed it will be blank Whether they have started or not and whether they were successful The % of marks agreeing with the true score and the % of marks within adjacency The number of sets attempted and the number passed

  8. Cumulative Qualification Report Marks given to each response in the set – only shown where there are differences Item name True scores % below true score, within tolerance and out of tolerance % above true score, within tolerance and out of tolerance Set name % same as true score

  9. Marker Differences Trait name Date marked True score Where the difference occurred The item the difference occurred on Score given by examiner Difference between true score and examiners score

  10. Marker Statistics Summary Information on backreading Including: • Number backread • % out of tolerance • % same as true score Information on rate of marking, including total time spent marking that item and number of items marked per hour on average AA Number Trait or item name Information on marking against validity responses. Including: • Number seen • % out of tolerance (non-adj) • % within tolerance (adj) • % same as true score Total marked for that item Marker name • Revamped so you can run it just for your team, for one team or all items • Can be used as evidence if an examiner needs to be stopped

  11. Task • You will be regularly running reports to help you monitor your team • You need to be able to interpret this data • In these tasks you will be provided extracts from a report • Note down your answers to the questions that accompany each section of the report

  12. The full report • Who has marked the most responses? • F Thomas • Who has marked the least responses? • F Patel • Would you take any action? • You could look further at F Patel to see if there is any reason they have marked so few responses

  13. Data about rate of marking • Who has marked the fastest? • F Thomas • Who has marked the slowest? • P Wilson • Would you take any action? • F Thomas is not marking significantly faster than the rest of the team so no action required • P Wilson is considerably slower than the rest of the team, they may require further guidance about the mark scheme for this item

  14. Data about validity items • How many validity items has S Taylor seen? • 2 • Who scored best on validity marking? • E Collins and F Patel both scored 100% on perfect agreement • Would you take any action? • S Taylor marked 50% in perfect agreement and 50% higher than the true score but within tolerance • F Thomas scored 60% perfect agreement and 40% out of tolerance • Both markers should be investigated further. Validity scores should be 80-100% perfect agreement

  15. Data about backreading • How many times has E Collins been backread? • 5 • Which markers and which traits give caused for concern? • S Taylor – 1b, 1c and 1d • F Thomas – 1c • Would you take any action? • F Thomas – complete a 2nd sample • S Taylor has already had a 2nd sample conducted on them (10 responses seen). You should consult your supervisor at this stage about whether they should be stopped from marking this item • Backreading scores should be 80-100% perfect agreement

  16. Contact Details

More Related