1 / 20

ICAT : Instructional Computer Adaptive Testing

ICAT : Instructional Computer Adaptive Testing. John Fountain Marine Earth and Atmospheric Sci. North Carolina State University. Active Learning. Value documented over 20 years ( Bonwell and Eison , 1991) Increasing active learning generally requires reduction in conventional lecture

finn
Download Presentation

ICAT : Instructional Computer Adaptive Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ICAT: Instructional Computer Adaptive Testing John Fountain Marine Earth and Atmospheric Sci. North Carolina State University

  2. Active Learning • Value documented over 20 years (Bonwell and Eison, 1991) • Increasing active learning generally requires reduction in conventional lecture • Background material often supplied through assignments outside of class time

  3. Is External Material Retained? • Must compete with distractions: computer games, social media, TV, partying etc. • Easy for students to avoid necessary effort • Quizzes: traditional approach to encourage attention to material • Multimedia: videos etc. – to increase interest and hopefully use

  4. ICAT • Designed to increase mastery of out-of-class material • Required Quiz: to maximize student use • Instructional: Primary design objective, uses videos, images and text.

  5. ICAT Instructional Computer Adaptive Test • Online ComputerizedTest (quiz) • Adaptive: wrong answers lead to additional questions on topic • Instructional: instructional material presented after wrong answers • Every question must eventually be answered correctly to complete exam

  6. What Mineral is this? a.Pyroxene b.Feldspar c. Quartz d.Calcite

  7. Wrong answers lead to additional questions on subject • The quiz is designed to address knowledge needed for each answer • This question requires a knowledge of mineral properties and identification of cleavage • If they answer “quartz” then they either do not remember the properties of quartz or did not recognize cleavage

  8. What mineral is this?a.Pyroxene b. Feldspar c. Quartz This wrong answer leads to:Does this sample show cleavage? a. yes b.no

  9. Instructional Material • Wrong answers lead to instructional material targeted to knowledge area • In this case on cleavage origin, significance and recognition

  10. Flow Chart • Every “main” question has a flow chart that defines the sub-question sequence and instructional material • Sub-questions designed to cover knowledge areas needed to answer main question

  11. Basic Concepts • Wrong answers lead to information • Can be text, images, video • Only information relevant to answer is shown • Every Question must be answered correctly – eventually.

  12. Reporting • Automatic report generated for each class • % first answer correct for each student • % answers correct for each question • Histogram of answers for each question • Allows assessment of individual students, of each question and of extent of understanding

  13. ICAT • Initial design for online courses • Equally applicable to seated courses • Primary use to increase mastery of material • Can be used as study aid to prepare for tests • Or as review to reinforce material

  14. Design • Web based exam, run from any browser • Giving exam takes one-line email. • Questions submitted on form • Student Identities masked

  15. ICAT Assessment • Comparison of performance of cohorts taking intro geology lab • Initial review by Teaching Assistants • Second review by non-random group • Modified program in response to each review thus results not yet appropriate for assessment

  16. Scalable and Open Source • Question bank database (MySQL), can handle any number of questions /courses/subjects • Server (Apache Tomcat) • (Walmart > 100 million pages/day) • Written in java (FX2): runs on any platform (except ipad)

  17. Structure • Client code is very small • Requires minimal memory and computing power – any processor can handle it • Secure – no access to database by client program

  18. Future Plans • Remainder of academic year for assessment and development • Expand to other courses at NC State and Wake Tech Community Coll. • Extend to other interested institutions

  19. Acknowledgements National Science Foundation Opportunities for Enhancement of Diversity in Geoscience Program Dr. David McConnell Dr. John Bedward Katherine Ryker Geoscience Learning Process Laboratory, Dept. of Marine Earth and Atmospheric Sciences, NC State Doel Gonzalez, Computer Science Department NC State

More Related