Assessing quality and sharing best practices for the undergraduate senior thesis
Download
1 / 23

Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis - PowerPoint PPT Presentation


  • 135 Views
  • Uploaded on

Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis. Collaboration Across Three Liberal Arts Colleges Student Success and the Quality Agenda, AAC&U 2013. Teagle Senior Thesis Evaluation. Capstone as most significant student artifact No systematic evaluation

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis' - ghazi


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Assessing quality and sharing best practices for the undergraduate senior thesis

Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis

Collaboration Across Three Liberal Arts Colleges

Student Success and the Quality Agenda, AAC&U 2013


Teagle senior thesis evaluation
Teagle Undergraduate Senior Thesis Senior Thesis Evaluation

  • Capstone as most significant student artifact

  • No systematic evaluation

  • Developed Senior Thesis Rubric

  • Performed cross-institution thesis evaluation

  • Administered Thesis Experiences Survey

  • Will perform second thesis evaluation on individual campuses using rubric

Collaborators

New College of Florida

Bard College

Bennington College

Colorado College

Hampshire College

Smith College

Wellesley College


Key questions for thesis evaluation
Key Questions for Thesis Evaluation Undergraduate Senior Thesis

  • Are there common evaluative criteria across analytic disciplines? Can a common rubric be developed?

  • Can a rubric improve on the validity, reliability and systematicity of grades for evaluating analytic work?

  • Can using a rubric help institutions improve pedagogy?

  • To what extent do student input characteristics predict high-quality senior theses?

  • Can we identify student experiences that predict high-quality theses?

  • Do the same experiences lead to high-quality work no matter whether theses are required, optional, or honors-only?


Timeline at bard college
Timeline at Undergraduate Senior ThesisBard College

  • June 2009: first reading/evaluation of senior theses using the rubric. Three Bard faculty participated.

  • June 2010: full consortium meeting at Bard. Faculty discussed results from the June 2009 reading and planned for improvement.

  • February 2012: meeting at Bard for Bard faculty to further disseminate the work of the grant. Led by Steve Weisler and Carol Trosset in conjunction with Bard Center for Faculty and Curricular Development. Steve and Carol also held a focus group with students.

  • April 2012: meeting at Bard with faculty in the performing and practicing arts from Bard, Bennington, and New College. Explored possibilities for rubrics in the arts.

  • May 2012: first survey of graduating seniors at Bard about their Senior Project experiences. The response from the class of 2012 was encouraging. ~160 students responded.


Results at bard college
Results at Undergraduate Senior ThesisBard College

  • The results from the June 2009 meeting showed that Bard senior theses were not theses that stand alone well with respect to the rubric, in comparison with the other colleges in consortium.

  • The June 2010 meeting produced enough momentum to focus the discussion of the Senior Project on campus for first time in many years. Indeed, the discussion has shifted away from anecdotal stories about individual students to a discussion focused on talking about how we prepare and evaluate all students.

  • A number of programs have instituted practices that help students prepare for the Senior Project and provide a scaffolding for students as they progress through the Senior Project. In addition, several programs are experimenting with rubrics to advise and evaluate students.

  • Take home lesson for Bard: make the Senior Project more like a course.


New college of florida senior thesis practices
New College of Florida Senior Thesis Practices Undergraduate Senior Thesis

  • Public honors college, narratives instead of grades, contracts not credit hours

  • Senior thesis/project required of each student.

  • 6th semester Thesis Prospectus form

  • Thesis advisor and 2 additional faculty serve as Baccalaureate Committee for oral exam.

  • Thesis is a major focus of final semester.


Results ncf assessment and priorities for discussion
Results:NCF Undergraduate Senior ThesisAssessment and Priorities for Discussion

2009 Thesis Assessment Results

2012 Faculty and Student Priorities for Discussion

Students & Faculty: Preparing students for thesis success before thesis year

Faculty: Managing thesis workload

Students: regular meetings with advisor, time to revise drafts, support for interdisciplinary and non-standard projects

  • In 2009 Thesis Assessment, New College compared favorably with others

  • New College theses weakest areas Scholarly Context and Position


Evolving ncf thesis discussions
Evolving NCF Thesis Discussions Undergraduate Senior Thesis

  • Initial skepticism/resistance to rubric assessments

  • Later, rubric seen as possible tool: set expectations, guide theses, replace SAPA

    • Positive and energizing conversations with Bard and Hampshire Faculty

      • Hampshire’s workload depiction and assigning advisors

      • Bard’s midway and moderation practices

      • Reinvest in “projects” as well as “theses”


Ncf enduring insights
NCF Enduring Insights Undergraduate Senior Thesis

  • Learning process can be highly successful even when the senior thesis itself is disappointing.

  • No matter how well we prepare students, there will always be a distribution from low to high quality.

  • There is tension in expecting students to be flexible, independent, risk-takers and also meet honors standards for senior thesis.


Thesis rubric
Thesis Rubric Undergraduate Senior Thesis

Introduction: Rational


Most theses get a s
Most theses get A Undergraduate Senior Thesis’s.



Scores can show institutions how to improve
Scores Can Show Institutions ProcessHow to Improve




Student judgments correlate with external readers more than with grades
Student judgments correlate with Processexternal readers more than with grades.





What makes for a good thesis
What makes for a good thesis? institutions.

Predicted Grade

Predicted Self-Rated Quality

Student felt prepared to form their own position or argument on a subject

Student felt prepared to manage their own time

Hours per day spent on the thesis

Student usually took the adviser’s advice

  • Student felt prepared to find and evaluate relevant scholarship

  • Student felt prepared to fairly consider conflicting points of view


The best predictors of quality
The Best Predictors of Quality institutions.

Only two survey items predicted* both the adviser-assigned grade and self-rated quality:

  • Student views the thesis as the most important work done in college

  • Student feels challenged by the adviser to do his/her best work

    *in a stepwise regression equation, for more than one institution


Next steps
Next Steps institutions.

  • Survey will be administered again this spring.

  • Each institution will conduct a thesis-reading applying the rubric to theses written by students who completed the survey.

  • A new analysis will discover whether particular experiences predict higher rubric scores for the same theses.


Discussion

Discussion institutions.