1 / 20

Continuous student assesment : implementation and results

Continuous student assesment : implementation and results. P Truffert, D Lacroix, D Gosset M Lance, A Deroo, JC Alexandre. French medical studies. 6 years. DCEM4. DCEM4 ( ≈ 450 students). CSCTU faculty exam. ECN : national ranking exam About 8000 students in France.

dyanne
Download Presentation

Continuous student assesment : implementation and results

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Continuous student assesment : implementation and results P Truffert, D Lacroix, D Gosset M Lance, A Deroo, JC Alexandre

  2. French medical studies • 6 years DCEM4 DCEM4 (≈ 450 students) CSCTU faculty exam ECN : national ranking exam About 8000 students in France

  3. Lille II rank at ECN : disappointing results One of the national universities quality criteria

  4. Csctu before 2011 • Written final exam • 4 medical cases scenarios to resolve • Problem solving, clinical reasoning, knowledge and therapeutic • 80% of the total exam score • Oral test • Bedside evaluation • Specific therapeutic oriented program

  5. Csctu 2011 : continuous assesment • Same written/oral testing • No specific program • The hole ECN program is covered by assesment • 20 assesments, 2 case scenarios each

  6. Csctu : continuous evaluation • The « fridays » Friday 1h30 evaluation Friday 1h30 evaluation Monday 2h 1 Corrected record csctu 2 cases « ecn type» Hématologia 2 cases « ecn » Psychiatry Course And correction Hématologia Monday 20 senior 1 spécialist

  7. Monday Correction • Software • 20 senior residents • Sensibilisation • case elaboration • Case correction (which keywords, what relative importance) • Présence of 1 spécialist • Can modify some keywords (synonyms etc…) • Sees the principal difficulties encountered by the students • Can adapt the learning messages for next friday

  8. Correction du lundi

  9. - 7 22% 2% 47%

  10. Continuous assesment • Weekly individualized results

  11. Other learning facilities • Saturday morning seminars • In the two last months before ECN • 5 courses (3h) « best of » concerning themes chosen by the students • Evening conferences • 2 per week • 4 case scenarios and 3h correction

  12. Did results change? (and how…)

  13. Analysis strategy • Individual student ranking variation 2009-2011 • Description by quartiles • Correlation between csctu ranking and ECN ranking 2011

  14. Analysis strategy • ECN ranking estimation • linear Regression • Predicted values – Observed values • Under estimation : student winned + 1000 ranks at ECN • Over estimation : student lost -1000 ranks ECN • Correct estimation : difference < 1000 places

  15. Results Q Q Q Q Ranking distribution by quartiles 2009-2011

  16. Results Correlation r : 0.8 (p<10-4) Détermination r2 : 0.64 36% of the ECN was not explained by the csctu ranking Corrélation csctu ranking vs ECN

  17. Results under Over • Predictive quality of the csctu ranking • 38% overestimated : falsy reassured ?

  18. National ranking of Lille 2 : 2007-2011

  19. Back to the future… National ranking of Lille 2 : 2007-2011 Promotion effect? Waiting for 2012 confirmation… Understanding which learning and teaching issues are involved?

  20. Thank you for your attention

More Related