Life After VSA: An Update. Oklahoma Association of Institutional Research and Planning Fall 2009 Conference October 23, 2009. Voluntary System of Accountability (VSA).
Oklahoma Association of
Institutional Research and Planning
Fall 2009 Conference
October 23, 2009
Initiative for public universities to supply basic, comparable information on the undergraduate student experience to important constituencies through a common web report – the College Portrait.
Sponsored by APLU & AASCU. Funded by the Lumina Foundation for Education.
Assemble information that is transparent, comparable, and understandable
Demonstrate accountability and stewardship to public
Measure educational outcomes to identify and enhance effective educational practices
Prospective students and families
High school, community college counselors
Policymakers and elected officials
Campus faculty and staff
Accrediting associations, institution and state boards
Taxpayers and public-at-large
Perceived lack of useful and transparent data preventing institutions from demonstrating accountability and contribution to public good (Spellings Commission)
Policymakers and employers demand evidence of educational outcomes – particularly broad transferable skills
Free web report that communicates user-friendly, consistent information about college campuses.
No rankings, no spin ... just the facts!
Institution description, highlights
Cost of attendance, net cost calculator
Success & progress rate
Degree programs, class sizes
Post graduation plans
Menu links take users to each section and data element
Campus Defined Buttons
interaction with faculty
Selected responses from Seniors
Learning gains in critical thinking, analytic reasoning, written communication measured at institution level
Reported in a common format using CAAP, CLA or MAPP
Funded by the Fund for the Improvement of Post-Secondary Education (FIPSE).
Two reports are available on the VSA website:
How Should Colleges Assess & Improve College Learning?
Employers’ Views on the Accountability Challenge
Key findings from survey among 301 employersConducted November 8 – December 12, 2007for
How useful do you find the college transcript in helping you evaluate job applicants’ potential to succeed at your company?
Just somewhat useful
Supervised/evaluated internship/community-based project where students apply college learning in real-world setting
Advanced comprehensive senior project, such as thesis, demonstrating student’s depth of knowledge in major & problem-solving, writing, and analytic reasoning skills
Essay tests to evaluate level of problem-solving, writing, and analytical-thinking skills
Electronic portfolio of student’s college work, including accomplishments in key skill areas and faculty assessments
Multiple-choice tests of general content knowledge
Faculty supervisor’s assessment of applicant’s student internship/ community-based project applying college learning in real-world setting
Sample of applicant’s student senior project and overview of faculty assessment of the project
Electronic portfolio of applicant’s college work, including accomplishments in key skill areas and faculty assessments
Applicant’s score on essay test to evaluate level of problem-solving, writing, and analytical-thinking skills
Applicant college’s score showing how the college compares to others in advancing students’ critical-thinking skills
Applicant’s score on multiple-choice test of general content knowledge
Tell The Students What They Are Expected to Accomplish
A website open to everyone in higher education
Free to join, easy to sign up
A library of sorts…a site where a collection of rubrics (and other best practices) can be:
Built with open source software to share knowledge and best practices openly
Develop criteria from rubric collection
Each rubric development team member wrote a row of performance descriptors for one criteria
Draft rubric then discussed and debated, edited and transformed
Testing and feedback – e-Portfolios