230 likes | 310 Views
Explore challenges and solutions when analyzing NPD data, including issues with PLASC variables, attainment metrics, and age discrepancies. Discusses limitations and nuances to enhance data reliability.
E N D
Using the NPD: Some pitfalls and issues Presentation to PLUG 13 September 2006 Andrew Ray Schools Analysis and Research Division, DfES
PLASC PLASC variables • FSM • Ethnicity • SEN • Looked after children • EAL • Not covered here: variables linked to postcode
FSM FSM is limited as a proxy for social class
Ethnicity Code changes 2002 03 Data taken from Ray Godfrey’s Changes in Ethnicity Codes in the Pupil Level Annual Schools Census 2002-2003
SEN Local Authority variation in special school provision
Looked after children Under-reporting of looked after children Source: PLASC quality report on pupils in care
EAL Complex relationship with ethnicity
Attainment Attainment data • Changing test structures • Changing qualifications • Changing point systems • Ages and Key Stages • Ceiling effects • Use of marks data for sublevels
Changes to KS3 English levels Levels and tests
Levels and tests Key Stage 2: artificial increase in ‘Bs’
Levels and tests Key Stage 1: the move to teacher assessment
Quals Additional qualifications
Points New GCSE points system introduced in 2004 Gap between “fail” and G has increased New Points = (Old Points x 6) + (10 x number of passes at G or above) (but points not awarded for all qualifications under the old system)
Ages and stages Age 15 or KS4 • End of KS4 reporting allows for more flexible rates of learning. • 98.8% of pupils at end of KS4 are 15, 0.3% were 14 and 0.9% were 16.
Ceilings Test scores are truncated
Sublevels Marks and levels
Sublevels Sublevels don’t directly correspond to marks
The NPD Coverage of the NPD • Pupils with incomplete records (2 examples) • Not covered here: • the extent of coverage of the independent sector • pitfalls in choosing coverage, e.g. when to include selective schools or schools that are semi-independent (e.g. City Technology Colleges) • whether or not to impute missing values
The NPD Pupils with no PLASC or KS4 records Source: Trends in Attainment Gaps bulletin Appendix D
The NPD Pupils with no PLASC records Source: Trends in Attainment Gaps bulletin Appendix D
Issues for PLUG • Future speakers: experts on PLASC or test data? • Documentation: what improvements can be made? • Further investigation: are there useful analyses that could illuminate some data issues? • Can any common standards be agreed, or should everything be left to individual analyses?
Useful links Bulletins: Trends in Attainment Gaps http://www.dfes.gov.uk/rsgateway/DB/SBU/b000665/index.shtml Characteristics of Low Attainers http://www.dfes.gov.uk/rsgateway/DB/SBU/b000588/index.shtml Variation in pupil progress http://www.dfes.gov.uk/rsgateway/DB/SBU/b000481/index.shtml Progress by pupil characteristics http://www.dfes.gov.uk/rsgateway/DB/SBU/b000402/index.shtm Other key publications: Results by pupil characteristics 2005 http://www.dfes.gov.uk/rsgateway/DB/SFR/s000640/index.shtml Ethnicity and education topic note http://publications.teachernet.gov.uk/default.aspx?PageFunction=productdetails&PageMode=publications&ProductId=DFES+0208+2006&