What s the adult l n story
This presentation is the property of its rightful owner.
Sponsored Links
1 / 27

What’s the adult L&N story? PowerPoint PPT Presentation


  • 150 Views
  • Uploaded on
  • Presentation posted in: General

What’s the adult L&N story?. The results from international assessments of adult literacy and numeracy skills Juliette Mendelovits CEET 17th Annual National Conference Friday 1 November 2013 Monash Conference Centre, Melbourne. A literacy deficit.

Download Presentation

What’s the adult L&N story?

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


What s the adult l n story

What’s the adult L&N story?

The results from international assessments of adult literacy and numeracy skills

Juliette Mendelovits

CEET 17th Annual National Conference

Friday 1 November 2013

Monash Conference Centre, Melbourne


A literacy deficit

A literacy deficit

  • Half of all adults in Tasmania cannot read or write properly, and many of their children are following in their footsteps as badly needed school reforms are frustrated. Sarah Dingle investigates.

  • A report by the Australian Bureau of Statistics for 2011-2012 shows half of all Tasmanians aged 15 to 74 are functionally illiterate, and more than half are functionally innumerate—meaning they don’t have the skills needed to get by in the modern world, like filling out forms, or reading the instructions on their prescription.

  • ABC Radio National, Background Briefing, Sunday 22 September 2013


What s behind the headlines

What’s behind the headlines?


Tasmanian illiteracy and innumeracy levels 15 to 74 year olds

Tasmanian 'illiteracy' and 'innumeracy' levels 15 to 74 year olds

2006 - ALLS

Document literacy

Numeracy

2011-12 PIAAC

Literacy

Numeracy


Australian illiteracy and innumeracy levels

Australian 'illiteracy' and 'innumeracy' levels

Document literacy

Numeracy

Literacy

Numeracy


According to alls and piaac

According to ALLs [and PIAAC?]

About 50% of Australian adults are functionally illiterate and innumerate

Howcan this be true?


What does below level 3 mean

What does ‘below Level 3’ mean?

  • According to the international ALLS reports, Level 3 is

    • ‘a suitable minimum level for coping with the increasing demands of the emerging knowledge society and information economy’


A level 2 literacy item from piaac

A Level 2 literacy item from PIAAC

Level 2 literacy description (226 to 275 points)

At this level, the medium of texts may be digital or printed, and texts may comprise continuous, non-continuous, or mixed types. Tasks at this level require respondents to make matches between the text and information, and may require paraphrasing or low-level inferences. Some competing pieces of information may be present. Some tasks require the respondent to

• cycle through or integrate two or more pieces of information based on criteria;

• compare and contrast or reason about information requested in the question; or

• navigate within digital texts to access and identify information from various parts of a document.


A level 3 numeracy item from piaac

A Level 3 numeracy item from PIAAC

Level 3 numeracy description (276 to 325 points)

Tasks at this level require the respondent to understand mathematical information

that may be less explicit, embedded in contexts that are not always familiar and

represented in more complex ways. Tasks require several steps and may involve the

choice of problem-solving strategies and relevant processes. Tasks tend to require

the application of number sense and spatial sense; recognising and working with

mathematical relationships, patterns, and proportions expressed in verbal or

numerical form; and interpretation and basic analysis of data and statistics in texts,

tables and graphs.


Piaac an overview

PIAAC: an overview

  • The Programme for the International Assessment of Adult Competencies (PIAAC)

  • An international survey of adults 16-64 years of age (15 to 74 year olds in Australia)

  • Commissioned by the OECD, implemented internationally by a consortium led by Educational Testing Service (ETS) (USA)

  • Administered in Australia by the ABS

  • Measures the domains of

    • literacy (reading)

    • numeracy

    • problem solving in technology-rich environments (PSTRE)

  • Modes of administration

    • paper and pen

    • computer

  • Administered in 25 OECD countries (including Australia) and sub-national entities in 2011-12

  • Comparable with the results of the Adult Literacy and Life Skills Survey ??


  • Results from piaac means for australia and selected participating countries

    Results from PIAACMeans for Australia and selected participating countries

    Level 2: 226 to 275 points

    Level 3:276 to 325 points


    Results from piaac at each literacy level for australia and selected participating countries

    Results from PIAAC% at each literacy level for Australia and selected participating countries


    Construction of the literacy and numeracy reporting scales

    Construction of the literacy and numeracy reporting Scales


    Items and test takers are placed on the same scale

    Items and test-takersare placed on the same scale

    |

    |

    X|

    |

    X|

    2 XX|

    XX|7

    XX|

    XXX|34

    XXX|19

    XXXX|23

    1 XXXXXX|12

    XXXXXX|

    XXXXX|11 22

    XXXXXX|26 27 33

    XXXXXXX|10 14 30 32

    XXXXXXX|2 5 20

    0 XXXXXXXX|1 4 6 21 29

    XXXXXXXXXX|8 16

    XXXXXXX|9 31

    XXXXXXXXX|3

    XXXXXXXX|18 25

    XXXXXXXX|13

    -1 XXXXXXX|15

    XXXXXXXX|

    XXXXXX|

    XXXXXXX|

    XXXX|24

    XXXX|

    -2 XXXXX|

    XXX|28

    XX|17

    XX|

    XX|

    X|

    -3 X|

    X|

    X|

    |

    HighAchievers

    Difficult items

    Low Achievers

    Easy items


    Relationship between difficulty of assessment items and proficiency of adults

    Relationship between difficulty of assessment items and proficiency of adults


    Anchoring of tests

    Anchoring of tests

    • The Rasch model derives comparable scores for two different assessments via the inclusion of 'anchor' items.

    • Anchoring can be used:

      • across test forms (e.g. Rotated designs)

      • across populations (e.g. Different countries)

      • across time (e.g. Different Adult literacy cycles – ALLS and PIAAC)


    Example of anchoring between two populations of different ability

    Example of anchoring between two populations of different ability

    Different tests

    Common items

    Same Scale!


    A map of item difficulty and test takers proficiency

    A map of item difficulty and test-takers’ proficiency


    Once items and adults are placed on the same scale proficiency levels are defined

    Once items and adultsare placed on the samescale, proficiency levels are defined

    |

    |

    X|

    |

    X|

    2 XX|

    XX|7

    XX|

    XXX|34

    XXX|19

    XXXX|23

    1 XXXXXX|12

    XXXXXX|

    XXXXX|11 22

    XXXXXX|26 27 33

    XXXXXXX|10 14 30 32

    XXXXXXX|2 5 20

    0 XXXXXXXX|1 4 6 21 29

    XXXXXXXXXX|8 16

    XXXXXXX|9 31

    XXXXXXXXX|3

    XXXXXXXX|18 25

    XXXXXXXX|13

    -1 XXXXXXX|15

    XXXXXXXX|

    XXXXXX|

    XXXXXXX|

    XXXX|24

    XXXX|

    -2 XXXXX|

    XXX|28

    XX|17

    XX|

    XX|

    X|

    -3 X|

    X|

    X|

    |

    Level 5

    PIAAC literacy Level 4

    • Tasks at this level often require respondents to perform multiple-step operations to integrate, interpret, or synthesise information from complex or lengthy continuous, non-continuous, mixed, or multiple type texts. ...

    Level 4

    Level 3

    PIAAC literacy Level 2

    ... Tasks at this level require respondents to make matches between the text and information, and may require paraphrasing or low-level inferences. Some competing pieces of information may be present. . ...

    Level 2

    PIAAC literacy Level 1

    • Most of the tasks at this level require the respondent to read relatively short digital or print continuous, non-continuous, or mixed texts to locate a single piece of information. ...

    Level 1

    Below Level 1


    Described literacy levels from piaac

    Described literacy levels from PIAAC

    Level 2

    • ... Tasks at this level require respondents to make matches between the text and information, and may require paraphrasing or low-level inferences. Some competing pieces of information may be present. . ...


    What does piaac tell us about the distribution of australians skills

    What does Piaac tell us about the distribution of Australians’ skills?


    Sex and skills australians aged 15 to 74

    Sex and skillsAustralians aged 15 to 74


    Employment and skills australians aged 15 to 74

    Employment and skillsAustralians aged 15 to 74


    So what about the headlines

    So what about the headlines?


    How can all of this be true

    How can all of this be true?

    PISA

    According to PISA About 15% of Australian 15-year-olds are below the required standard of reading and maths

    ALLS

    According to NAPLAN about 6% of Australian Year 9 students are below the required standard of literacy and numeracy

    NAPLAN

    According to ALLS about 50% of Australian adults are below the minimum standard of literacy and numeracy


    What s the adult l n story

    • Comparability of scales?

    • A project sponsored by the Victorian Department of Education and Early Childhood Development and the Australian Council for Education Research

    • Preliminary findings:

    • Literacy


    Questions

    Questions?


  • Login