1 / 39

Using ePortfolios for General Education Assessment

Using ePortfolios for General Education Assessment. AAC&U General Education and Assessment February 2014 Martha VanCleave Professor of Mathematics, Interim Director of Division of Continuing Education. Linfield College. Linfield College .

nishan
Download Presentation

Using ePortfolios for General Education Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using ePortfolios for General Education Assessment AAC&U General Education and Assessment February 2014 Martha VanCleave Professor of Mathematics, Interim Director of Division of Continuing Education Linfield College

  2. Linfield College • Private, comprehensive, undergraduate institution in the Pacific Northwest • 47 majors through three programs: • McMinnville - traditional liberal arts and pre-professional programs (1700 students) • A Portland Campus - Linfield-Good Samaritan School of Nursing (450 students) • The Adult Degree Program - a pioneer in adult education primarily online (805, 410 FTE students). Linfield College

  3. The Linfield Curriculum(LC) Linfield’s general education curriculum was revised in 2007

  4. The Linfield Curriculum Structure • Four major components: • Inquiry Seminar(INQS) – writing intensive first year course • Six Modes of Inquiry • Diversity Studies • Major Writing-Intensive (MWI). Linfield College

  5. The Six Modes of Inquiry • Creative Studies (CS) • Individuals, Systems, and Societies (IS) • Natural World (NW) • Quantitative Reasoning (QR) • Ultimate Questions (UQ) • Vital Past (VP) Linfield College

  6. Upper-Division Mode of Inquiry • An upper-division course (300 or above) • In one of the six modes of inquiry • CS, IS, NW, QR, UQ or VP • From outside the major department Linfield College

  7. Diversity Studies • Global Pluralisms (GP) • U.S. Pluralisms (US) Linfield College

  8. Linfield Curriculum Course Requirements - “LC’s” Students are required to complete: • Inquiry Seminar (INQS) – 1 course during first or second year • Modes of Inquiry – 6 courses,1 from each area • Diversity Studies - 2 courses,1 from each area • Upper-Division Mode of Inquiry - 1 course • Major Writing Intensive Course - 1 course The INQS is 4 semester credits, all other courses are a minimum of 3 credits Total of 11 courses, minimum of 34 credits

  9. Learning Outcomes • Unique for each Mode of Inquiry and Diversity Studies area • Developed by a separate group of faculty (working group) for each Mode of Inquiry and Diversity Studies area • Consistent with LEAP Essential Learning Outcomes/VALUE rubrics • Requests for courses to fulfill requirements reviewed and approved by working group • Learning outcomes utilized when reviewing courses • Learning Outcomes must be included in syllabus • Syllabus must describe how learning outcomes will be met

  10. Linfield Curriculum Assessment Plan (LCAT) adopted 2010

  11. LCAT • Students must demonstrate meeting the learning objectives of each mode of inquiry and area of diversity studies through: • Direct evidence • Choosing an exemplar or exemplars • Posting the work in an online repository • Indirect Evidence • Supporting the choice of these exemplars with a reflection on how they meet the learning outcomes Linfield College

  12. LCAT • Faculty Working group for each LC designation • Develop rubric for assessing evidence of student learning outcomes • Assess random sample of student submissions Linfield College

  13. LCAT • Assessment of LC submissions on a rotating schedule • 2 designations per year • First assessment summer 2011 - QR and VP • 2012 – US and NW • 2013 – GP and UQ • 2014 – CS and IS • Cycle repeats Linfield College

  14. First Round of Assessment QR and VP assessed

  15. QR and VP assessment • Exemplars submitted in LMS • Limited ability to provide instructions for students • No tool for collecting demographic data • Submissions downloaded for evaluation • Record of evaluation compiled manually Linfield College

  16. Assessing QR

  17. Assessing QR • Calibrate use of assessment rubric • Random selection of submissions scored by 2 readers, then consensus • Results Linfield College

  18. Assessing QR • Observations and recommendations • Rated satisfactory or above • #1 67.1% #2 52.3% #3 27.3% #4 34.1% • Difficulty submitting materials from online courses • Students need guidance • Revision of learning outcomes • Need benchmarks Linfield College

  19. Lessons Learned • Students need direction and structure • Faculty should make connections between coursework and LC learning outcomes Linfield College

  20. Implementing an ePortfolio system

  21. Selecting the ePortfolio Platform • Working group • Faculty • Dean of Student Affairs • Registrar • Associate Dean of Faculty • Chief Technology Officer • Director of Educational Technologies Linfield College

  22. Selecting the ePortfolio Platform • Criteria • Tiered access • Matrices • Evaluation • Areas for student reflection • Ability to aggregate data • Aesthetics and usability • Support from provider Linfield College

  23. TaskStream and Linfield • Create a Directed Response Folio (DRF) • Work done by team of faculty • Supported by TaskStream Mentoring Services Linfield College

  24. The DRF . Linfield College

  25. The DRF form https://www.taskstream.com/Main/main_frame.asp • Form for each area • Course Location • Course Subject Code • Course Number • Course Name • Course Delivery (option that best describes how this course was taught) • Year Course Was Taken • Class Standing • Term Course Was Taken Linfield College

  26. The DRF form • LC Outcomes • Please select all of the QR learning outcomes covered in this course. For courses taken at Linfield, this information can be found in your course syllabus. For transfer courses, check all that apply. Note that for courses taken at Linfield, all four learning outcomes should be selected. In addition, if this is a transfer course, please select "Transfer Course." • Description of Assignment(s) for Submission • Supporting Description of Quantitative Reasoning Exemplars Linfield College

  27. TaskStream and Linfield • Enroll faculty and students • Create single sign-on using CatNET Username and Password • https://www.linfield.edu/taskstream/index.php • Batch process enrollment via secure FTP site Linfield College

  28. Assessment Using Taskstream

  29. Developing Rubrics with Taskstream

  30. Beneficial Features of TaskStream • DRF provides structure for students • Form developed to provide explicit instructions • Online evaluation using the rubric • Data storage • Data reporting Linfield College

  31. Assessing NW

  32. Assessing NW • Calibrate use of assessment rubric • Random selection of submissions scored by readers • Results Linfield College

  33. Assessing NW • Observations and recommendations • Rated satisfactory or above • #1 25% #2 75% #3 23% #4 51% • Only 6 submission (8%) received at least a satisfactory for all four learning outcomes • 13 submissions (17%) received no satisfactory scores • Most students submitted a single document • Lack of understanding of what constitutes a goo exemplar • Revision of learning outcomes Linfield College

  34. New NW Learning Outcomes Courses with the NW designation are intended to help students understand the scientific method. In particular, students must demonstrate 1) an understanding of the theoretical and/or experimental background of a particular topic or model, sufficient to form a hypothesis 2) an ability to critically analyze results of scientific inquiry in light of assumptions, 3) an understanding of how scientific results can be extended to more general situations in contemporary society Courses with NW designation address all of the above learning outcomes.

  35. Lessons Learned • More attention needs to be paid to developing students’understanding of what makes a good exemplar Linfield College

  36. Advantages of Using Taskstream • Streamlines mechanics of evaluation process • Additional reports available (summary statistics) • Provides for more meaningful faculty discussions • Between pairs of faculty evaluators • Among members of working group (4 faculty) • With faculty teaching courses in each area through sharing of assessment results

  37. Challenges • Student understanding of the LC assessment • Individual student data is not assessed • Problematic to ensure students take the task seriously • Need to further develop reflective habit of mind • Faculty development • Use of ePortfolio • Consistent articulation of relationship between LC learning outcomes and course content Linfield College

  38. Thanks • Linfield College • Charles Dunn - Curriculum Committee Chair, director of LC Assessment, co-author of DRF • Susan Agre-Kippenhan – Vice President of Academic Affairs, Dean of Faculty • TaskStream • Ben Coulter – Manager, Systems Implementation • Jose Romero – Mentoring Services • Lauren McCarty – Associate Director of Marketing • Dara Wexler – Education Solutions Specialist • Trudy Milburn - Education Solutions Specialist Linfield College

  39. Contact • Questions – contact Martha VanCleave • mvcleave@linfield.edu Linfield College

More Related