Expertiza : Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer

Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF DUE under a CCLI grant NCSU Faculty Center for Teaching and LearningNCSU STEM Initiative Center for Advanced Computing and Communication

Expertiza Rationale Team Assignments Expertiza “Virtual” Demo Forthcoming Features Workshop Outline Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Expertiza began as a peer-review system for co-production of course resources. Building resources through electronic peer review gets students working together to improve others’ learning experiences, helps them learn, by performing tasks that are similar to real-world responsibilities, gives them experience in writing their ideas up for an audience of their peers, allows each cohort to “stand on the shoulders” of students in earlier classes. Introduction Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

For students to demonstrate mastery of the subject. Every student does the same thing—redundant effort. Work is graded and thrown away, never benefiting anyone but the student who did it. In Expertiza, students (or teams) sign up for different work Now the best work can be reused, to help others learn. Homework, traditionally … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Expertiza discourages plagiarism Students are not doing the same work. Their work must go through multiple review cycles Expertiza better utilizes scarce resources Students do most of the reviewing. Instructor/TA spend less time grading. With Expertiza, large classes are an advantage! Major advantages Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Teamwork mimics the work environment Teaming skills are important to success Teams can tackle larger projects, which diminishes the effort of integration Why team assignments? Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

All team members have access to a common submission area. Any member can revise the submission. Individuals review teams. This simplifies reviewing, and provides for more reviews. Teammates assess each other’s contribution to the team. This score can be factored into the student’s grade. How does Expertiza support teams? Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Team formation By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations Reviewing Feedback from author to reviewer Teammate review “Virtual” demo Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Let’s log in as an instructor … The login screen Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

The instructor’s homepage Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Setting up a wiki assignment Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Let’s create some teams … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

In the beginning, there are no teams Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

But let’s create one … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Team created; let’s add members Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

1st member is added; now for the 2nd … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Team now has two members Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Importing teams Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Here’s the file that’ll be imported Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Here’s how we import it Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Now there are five teams … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Students can create teams too … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Click on this assignment, Team test 2 Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Now, click on “Your team” Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

This user needs to set up a team Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Let’s create a team Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Invite another member to join … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Invitation has been sent Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Now the invited user logs in Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

… and goes to Team test 2 Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Then accepts the invitation Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

… and is placed on the team Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Instructor-assigned teams using class rank using demographics Student-selected teams Forthcoming: Schedule-based team formation Advantages of various approaches Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Let’s review a wiki page Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Click on the assignment … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

… then on “Others’ work” Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Choose a review Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Read the submitted wiki page Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Then fill out the review template Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Save and view the review Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

After the Initial Review Resubmission phase. 2–7 days to revise work in response to reviewer comments. Final review. 3–7 days to make final comments and assign scores. Metareview phase. Students review each other’s reviews. 10/29/08 Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu Gehringer: Expertiza: A Peer-Review System for Collaborative Learning, efg@ncsu.edu

Now the reviewee logs in … Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

… and views the scores Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Click on “View” to expand review Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Notice the link down at the bottom Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Use it to give feedback to the reviewer Gehringer, Rubric-based peer assessment of team projects, efg@ncsu.edu

Expertiza : Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer