One team, one test Test de Connaissance du Français - Pôle É valuation et Certifications - Centre International d’ É tu

1. One team, one test Test de Connaissance du Français - Pôle Évaluation et Certifications - Centre International d’Études Pédagogiques 1, avenue Léon Journault - 92318 – Sèvres - France Marianne MAVEL, Gilles BRETON, Juliette WATTEBLED, Christine TAGLIANTE, Sébastien GEORGES (georges@ciep.fr)   Operation management process Compulsory sections Items production  TCF composition Pre-test session Pre-test development Operating procedures 80 multiple choice questions 30 in OC 20 in LS 30 in RC Duration = 1½hours • 3 compulsory sections • Oral comprehension • Language structure • Reading comprehension • 2 optional sections • Speaking • Writing Verification Psychometrical analysis of results Internal evaluation committee Items production cycle Optional test production Stocking  Why TCF is a test. The same administration and correction conditions are always applied (standardised test). Psychometrical analyses guarantee dependable and comparable results (reliable test). The TCF items measure only what they are supposed to evaluate (valid test). Each item is pre-tested on a sample population in order to define statistical characteristics (calibrated and sensitive test). Items validation committee Stocking Six levels The Common European Framework of Reference for Language learning, teaching and assessment Test development Certificates sent A methodological and scientific conception Printing Test production cycle  Marking Materials sent safely to test centres  Items commissionned from item writers Items evaluation by team manager Items evaluation by internal committee Optional test marking Test and materials returned Testing session Invigilation  Pre-test development and session 11 anchors (4 in OC, 3 in LS and 4 in RC) and 69 new items 200 to 500 examinees in accredited pre-test centres Analysis Classical Test Theory and Rasch Model Determination of items’ psychometrical qualities Seeking of differential item functioning Determination of item difficulty level Analyses lead to a rejection or acceptance of pre-tested items  Banking Anchoring   Classical Test Theory Item difficulty Key analysis Distractors analysis Item discrimination Rasch model Unidimensionality Observed / Expected Item measure / Examinee ability Lucky choice by ignorance Bias analysis   Printing Materials sent Testing session Materials returned Accepted Rejected  Scanning Production test marking Certificates sent Accepted Rejected  Test development Items compilation Conversion chart (rough score / calibrated score) Conversion chart consitency Florence Bonnaz Gilles Breton Maryse Da Gamma Nathalie Duplaissy Dorothée Dupleix Narjès El Gharbi Sébastien Georges Maryvonne Gilles Martine Gongakola Catherine Houssa Marianne Mavel Bruno Mègre Etienne Pouvreau Christine Tagliante Juliette Wattebled