1 / 23

Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis

Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis. Collaboration Across Three Liberal Arts Colleges Student Success and the Quality Agenda, AAC&U 2013. Teagle Senior Thesis Evaluation. Capstone as most significant student artifact No systematic evaluation

ghazi
Download Presentation

Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis Collaboration Across Three Liberal Arts Colleges Student Success and the Quality Agenda, AAC&U 2013

  2. Teagle Senior Thesis Evaluation • Capstone as most significant student artifact • No systematic evaluation • Developed Senior Thesis Rubric • Performed cross-institution thesis evaluation • Administered Thesis Experiences Survey • Will perform second thesis evaluation on individual campuses using rubric Collaborators New College of Florida Bard College Bennington College Colorado College Hampshire College Smith College Wellesley College

  3. Key Questions for Thesis Evaluation • Are there common evaluative criteria across analytic disciplines? Can a common rubric be developed? • Can a rubric improve on the validity, reliability and systematicity of grades for evaluating analytic work? • Can using a rubric help institutions improve pedagogy? • To what extent do student input characteristics predict high-quality senior theses? • Can we identify student experiences that predict high-quality theses? • Do the same experiences lead to high-quality work no matter whether theses are required, optional, or honors-only?

  4. Timeline at Bard College • June 2009: first reading/evaluation of senior theses using the rubric. Three Bard faculty participated. • June 2010: full consortium meeting at Bard. Faculty discussed results from the June 2009 reading and planned for improvement. • February 2012: meeting at Bard for Bard faculty to further disseminate the work of the grant. Led by Steve Weisler and Carol Trosset in conjunction with Bard Center for Faculty and Curricular Development. Steve and Carol also held a focus group with students. • April 2012: meeting at Bard with faculty in the performing and practicing arts from Bard, Bennington, and New College. Explored possibilities for rubrics in the arts. • May 2012: first survey of graduating seniors at Bard about their Senior Project experiences. The response from the class of 2012 was encouraging. ~160 students responded.

  5. Results at Bard College • The results from the June 2009 meeting showed that Bard senior theses were not theses that stand alone well with respect to the rubric, in comparison with the other colleges in consortium. • The June 2010 meeting produced enough momentum to focus the discussion of the Senior Project on campus for first time in many years. Indeed, the discussion has shifted away from anecdotal stories about individual students to a discussion focused on talking about how we prepare and evaluate all students. • A number of programs have instituted practices that help students prepare for the Senior Project and provide a scaffolding for students as they progress through the Senior Project. In addition, several programs are experimenting with rubrics to advise and evaluate students. • Take home lesson for Bard: make the Senior Project more like a course.

  6. New College of Florida Senior Thesis Practices • Public honors college, narratives instead of grades, contracts not credit hours • Senior thesis/project required of each student. • 6th semester Thesis Prospectus form • Thesis advisor and 2 additional faculty serve as Baccalaureate Committee for oral exam. • Thesis is a major focus of final semester.

  7. Results:NCFAssessment and Priorities for Discussion 2009 Thesis Assessment Results 2012 Faculty and Student Priorities for Discussion Students & Faculty: Preparing students for thesis success before thesis year Faculty: Managing thesis workload Students: regular meetings with advisor, time to revise drafts, support for interdisciplinary and non-standard projects • In 2009 Thesis Assessment, New College compared favorably with others • New College theses weakest areas Scholarly Context and Position

  8. Evolving NCF Thesis Discussions • Initial skepticism/resistance to rubric assessments • Later, rubric seen as possible tool: set expectations, guide theses, replace SAPA • Positive and energizing conversations with Bard and Hampshire Faculty • Hampshire’s workload depiction and assigning advisors • Bard’s midway and moderation practices • Reinvest in “projects” as well as “theses”

  9. NCF Enduring Insights • Learning process can be highly successful even when the senior thesis itself is disappointing. • No matter how well we prepare students, there will always be a distribution from low to high quality. • There is tension in expecting students to be flexible, independent, risk-takers and also meet honors standards for senior thesis.

  10. Thesis Rubric Introduction: Rational

  11. Most theses get A’s.

  12. Using a Rubric Diversifies and Focuses the Evaluation Process

  13. Scores Can Show Institutions How to Improve

  14. Grades and Self-Rated Quality

  15. External readers are more discriminating.

  16. Student judgments correlate with external readers more than with grades.

  17. Do inputs predict quality?

  18. Are theses better at more selective institutions?

  19. Different experiences are more common at different institutions.

  20. What makes for a good thesis? Predicted Grade Predicted Self-Rated Quality Student felt prepared to form their own position or argument on a subject Student felt prepared to manage their own time Hours per day spent on the thesis Student usually took the adviser’s advice • Student felt prepared to find and evaluate relevant scholarship • Student felt prepared to fairly consider conflicting points of view

  21. The Best Predictors of Quality Only two survey items predicted* both the adviser-assigned grade and self-rated quality: • Student views the thesis as the most important work done in college • Student feels challenged by the adviser to do his/her best work *in a stepwise regression equation, for more than one institution

  22. Next Steps • Survey will be administered again this spring. • Each institution will conduct a thesis-reading applying the rubric to theses written by students who completed the survey. • A new analysis will discover whether particular experiences predict higher rubric scores for the same theses.

  23. Discussion

More Related