150 likes | 230 Views
Explore the evolution of information management assessments at Plattsburgh University, analyzing past methods and considering future options for more comprehensive evaluation. Assessing student proficiency in computer use, research techniques, and information synthesis. Discussing potential strategies to improve data breakdown and ensure accurate assessment results.
E N D
Plattsburgh’s Information Management Assessment Michelle Toth
Information & Technology Literacy • Required LIB105 (or proficiency exam) • Integrated in all General Education courses: • “General Education courses will: integrate critical thinking and information literacy/management competencies into the curriculum”
Assessment Cycle • Every Three years • Coordinated through the Provost’s office • Gen Ed upper level integration ‘Global Issues’ course students are used for assessment
Info Management Assessments • 2002-2003 - Home grown multiple choice • 2005-2006 – Revised home grown multiple choice • 2008-2009 – ETS’s iSkills
2002-2003 • Home grown multiple choice assessment. • Questions grouped to match SUNY Information Management categories • Demographic data, number of credit hours completed, took the course, passed the exam, transfer credit, or requirement unmet
2005-2006 • Librarians reviewed the 2003 item analysis of the assessment questions & made revisions • Structure and division of questions remained the same along with demographic data • Suggested raising the level scores
2008-2009 • ETS iSkills Assessment (Now defunct, replaced with iCritical Thinking) • Computer simulation-based assessment • Results limited to ETS reports/data • Individual scores not broken down in the categories • No standard score for meeting/exceeding, etc…
Assessment Results • Perform basic operations of personal computer use • Students met or exceeded 2003 = 88.6% • Students met or exceeded 2005 = 87.1% • Not available for 2009 (iSkills)
Assessment Results • Understand and use basic research techniques • Students met or exceeded 2003 = 75.7% • Students met or exceeded 2005 = 73.5% • Not available for 2009 (iSkills)
Assessment Results • Locate, evaluate and synthesize information from a variety of sources • Students met or exceeded 2003 = 82.4% • Students met or exceeded 2005 = 61.23% • Not available for 2009 (iSkills)
Assessment Results iSkills Results: • Unable to break out results into the 3 Information Management categories • 64% of students assessed met or exceeded overall (includes all categories)
2011-2012 Option #1: Return to home grown exam • Will need extensive revisions • Will provide comparable data for ’03 and ’06 • Ensure data broken down into I.M. categories
2011-2012 Option #2:Find another outside assessment • Cost is a concern • Lose comparability of past data • More or less staff time to set up, run and report
2011-2012 Option #3: (I’ll let you know when I come up with it) • May be a better alternative that answers all of our assessment prayers • May make my life more stressful than it already is