1 / 10

Making use of Rarely Given Wrong Answers on the Force Concept Inventory

A. John Mallinckrodt Cal Poly Pomona ajm@csupomona.edu. Making use of Rarely Given Wrong Answers on the Force Concept Inventory. The Problem. Many administer the FCI in ungraded, “credit for completion” mode. How do we establish that the test has been taken in good faith?. One Solution.

dustin-wise
Download Presentation

Making use of Rarely Given Wrong Answers on the Force Concept Inventory

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A. John Mallinckrodt Cal Poly Pomona ajm@csupomona.edu Making use ofRarely Given Wrong Answers on theForce Concept Inventory

  2. The Problem • Many administer the FCI in ungraded, “credit for completion” mode. • How do we establish that the test has been taken in good faith?

  3. One Solution • Have a way to identify exams that are not taken in good faith and … • … tell the class about it!

  4. Rarely Given Wrong Answers • The FCI has a large number of distractors that are rarely chosen by students—RGWAs • Random choice leads to an anomalously high occurrence frequency for RGWAs

  5. Defining RGWAs • Choice of database • Large set of previous results • Current cohort • Choice of frequency(My “discriminator” = 1/f = minimum number of exams expected to yield one instance of the specific RGWA)

  6. Procedure • Collect frequencies for all answers • Decide on a set of RGWAs • Determine expected number of RGWAs • For random guessing (=Total number of RGWAs/5) • For good faith effort (= Sum of p’s for each RGWA) • Compare with individual results(Note: We can always expect random guessing to produce 6 correct answers.)

  7. Examples

  8. Now what? • To confront or not to confront? • To deny credit or not to deny credit?

  9. Conclusions • RGWAs seem to provide a relatively robust method of identifying bad faith efforts • Still needed • Larger databases • Better statistical analyses • More user-friendly (user-friendlier?) interface • Interest from FCI community (?)

  10. A. John Mallinckrodt Cal Poly Pomona ajm@csupomona.edu Making use ofRarely Given Wrong Answers on theForce Concept Inventory

More Related