html5
1 / 12

2.E Developing an Assessment Framework

2.E Developing an Assessment Framework. Starting from Strand A: Modules. Cognitive instruments developed under Strand A for 15-year-old students attending educational institutions in grades 7 and higher that are comparable to main PISA.

quentin-branch
Download Presentation

2.E Developing an Assessment Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 2.E Developing an Assessment Framework

  2. Starting from Strand A: Modules • Cognitive instruments developed under Strand A for 15-year-old students attending educational institutions in grades 7 and higher that are comparable to main PISA. • Cognitive instruments developed under Strand A for 15 year olds that are in grades 6 or 5 and even lower grades that are part of a national component. • Cognitive instruments (reading components) developed specifically under Strand C that are targeted on the out-of-school 15 year olds who have never been to school or who have dropped out after completing only lower grades.

  3. Types of Cognitive Instrument Specific to Strand C Need a range of assessment instruments specifically for Strand C : • Basic assessment based on PASEC / SACMEQ items • Basic literacy and numeracy assessment such as ASER-type or EGRA early years assessment • Pictorial / verbal assessment A set of channels/ filters /gateways will be needed to identify appropriate instrument

  4. Assessment Experience • ASER and UWEZO are basic surveys of child literacy and numeracy, most likely to provide basic material for those who have never been to school or dropped out after a few grades • PASEC and SACMEQ used in SSA are school based; their material likely to be useful for group that has completed primary (Strand A) • LAMP, PIAAC and STEP are oriented towards adults, but there are some elements which should be considered by a contractor. In particular, both LAMP and PIAAC have items on Reading components

  5. Other Assessment Issues • None of the other surveys reviewed have paid specific attention to the plight and treatment of children with special needs (e.g. disability). This pilot exercise is seen as an opportunity to partially remedy those omissions. • The languages and/or culture of the parent/ caregiver generation may be very different from that of the 15 year old

  6. Reading Components in LAMP • Vocabulary • Digit naming • Rapid digit naming • Lowercase letter naming • Uppercase letter naming • Rapid letter naming (lowercase) • Word recognition (high frequency words; lowercase) • Rapid word recognition (same as previous) • Decoding (rare words; non-words) • Rapid decoding (same as previous) • Sentence processing (oral reading; silent reading, timed) • Passage fluency (oral reading; silent reading, timed)

  7. Language Issues • Language of instruction for in-school 15 yos inappropriate medium for testing some of target group in Strand C. Here, we distinguish four sub-divisions of the target group: • First, a small group which will have had some secondary and then dropped out. • Second, a minority will have completed primary and then dropped out. • Third, a significant minority will have dropped out before completing primary • Fourth, a small minority (in most countries) will have never been to school

  8. Language Issues (continued) • Language of instruction appropriate for first two groups, except where entire primary cycle conducted in local language (mother tongue), possibly for third group, but clearly not for 4th • Generally agreed that four grades sufficient for learning language • Breakdowns of those currently OOS suggest that very high percentages (70% to 90%) are less than 5th grade

  9. Testing Procedures/ Filters • Age estimation: include specific event calendar. To avoid over-identification of 15 yos, calculate expected number of ‘hits’ in each area and explain to citizen volunteers • Status vis-à-vis school: in addition to direct questions to 15 yo and caregiver, need to ask about any other learning experiences, reasons why this 15yo no longer in school and about education/ schooling of other children in household

  10. Structure of tests • For Language EITHER directly ask 15yo which language they are comfortable with OR use ASER/ UWEZO approach to identify level of literacy (letters, words, sentences) • For mathematics, OOS 15 yo will almost certainly understand verbally numbers because of financial transactions, but may not be able to read them. Use ASER/ UWEZO approach to identify level of numeracy. • If 15yo unable to answer simplest item, possibility of questions based on graphic representations and non-verbal reasoning; both would have to be made equivalent

  11. Questions for Discussion Starting from Strand A: • Is it just literacy and numeracy? • What do we additionally learn from other assessments? • What can be achieved in 10-30 minutes? • How can Strand C handle multiple languages? • What do we call Strand C? Pre-PISA? • How do we adapt to 15 year olds with special needs? • How do we adapt to different cultural contexts in the households?

More Related