designing self moderating online communities l.
Skip this Video
Loading SlideShow in 5 Seconds..
Designing self-moderating online communities PowerPoint Presentation
Download Presentation
Designing self-moderating online communities

Loading in 2 Seconds...

play fullscreen
1 / 20

Designing self-moderating online communities - PowerPoint PPT Presentation

  • Uploaded on

Designing self-moderating online communities. Julita Vassileva Computer Science Department University of Saskatchewan. Outline. Why do we need self-moderating online communities? Existing self-organizing communities How do successful communities work? Case study: the Comtella community

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'Designing self-moderating online communities' - KeelyKia

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
designing self moderating online communities

Designing self-moderating online communities

Julita Vassileva

Computer Science Department

University of Saskatchewan

  • Why do we need self-moderating online communities?
  • Existing self-organizing communities
  • How do successful communities work?
  • Case study: the Comtella community
    • Motivating participation
    • Self-regulating the quality of contributions
online communities
Online communities
  • Formerly: “newsgroups”, “forums” or “message boards”, “blogs”
  • Now: “virtual / online communities”, “social software”, even “social computing”
  • People send messages, questions, answers.
  • Anyone is free to sent anything
  • Everyone can see the all the postings.
too much stuff
Too much stuff…
  • And sometimes bad stuff
  • How to find what you want?
    • need to organize the postings
    • a moderator of the newsgroup
    • worked well with small groups
  • It is important to design software and “the rules of the game” for self-organization by the participants.
    • For example, Orkut allows joining only by invitation from insider.
    • A classical example –
self organizing online communities
Self-organizing online communities
    • A Linux-geek newsgroup/discussion forum
    • Users can ask questions and give answers to others’ questions
    • Users can rate the answers and the questions
    • Users who ask good questions or give good answers earn “karma”
    • Ratings by users with high karma have more weight
    • Every user has only a limited amount of ratings to give (depends on the karma-level)
    • Users with high-karma have the privilege to be a moderator for some time
    • Result: excellent forum, good quality postings are visible, low quality postings are not easy to find. Everyone has a chance to build up his/her karma. A form of democracy, people-ruled. Maintenance costs – close to zero (self-organizing).
the eps game from cmu louis von ahn laura dabbish http www 2 cs cmu edu biglou esp pdf
The EPS Game (from CMU)Louis von Ahn, Laura Dabbish
  • Goal: to label web images
  • Why? Try to Google image with a car
  • Two players (random) are shown the same image
  • Each player has to guess how the other player will label the image (have 2.5 minutes per image)
  • If their guesses are correct, both score and move to next image
  • Players can not communicate (otherwise they can cheat)

Player 1 guesses: Handbag

Player 1 guesses: Purse

Success! Agreement on “Purse”

Player 2 guesses: Purse

Player 2 guesses: Brown

Player 2 guesses: Bag

Success! Agreement on “Purse”

After agreeing on 15 images – big bonus of points for both players.

Example from

features of successful online communities
Features of successful online communities
  • Need to serve some real users needs
  • Need to have a critical number of users (“critical mass”)
  • Need to have a constant stream of new information
  • Examples: KaZaA, Blogs, Orkut
how to achieve this
How to achieve this
  • Need to cultivate in the user the feeling of being a member of the community
  • Contribution to the community should be rewarded
    • With reputation (ranking)
    • With visibility
    • With more rights / privileges
    • With cash…
  • Harmful behaviours (cheating) should be punished

The success of every social system depends on having the right motivators and the right inhibitors to stimulate and regulate individual behaviour!

first deployment in cs department fall of 2003
First deployment in CS DepartmentFall of 2003
  • Main problems:
    • Ensuring participation - unable reach critical mass
    • Motivating users to contribute new papers
  • If there is no one on-line, you can’t find anything
  • If no one contributes new papers, very soon everyone will have the same papers, so no point in using the system
new deployment 4 th year ethics class 35 students
New deployment: 4th year Ethics class, 35 students
  • Users earn “status” by participating. They need to:
      • bring new resources in the system
      • comment on the resources they have seen
      • keep online
      • log on the system frequently
      • download resources (share them with others)




  • High-status users are rewarded with
    • Visibility in the Community (visualization)
    • Better search options
  • Low-status users (free riders) are punished
    • Visibility in the Community (“Hall of shame”)
    • Not so comfortable search options.




community visualization

Sorting Criteria Bar ->

List of all the available

interest areas :

Community visualization

Hall of Fame

Hall of Shame


The total number of the original contributions

The average number of the original contributions per participant

Table 1. The number of comments and the total number of the shared links.







6 & 7

9 *


The number of Comments









The number of links shared









* Week 9 in this table is the first week when the visualization was introduced.


BUT, also some poor contributions

- not really relevant links

- links similar to other contributions

 clearly, many students were trying to submit as much as possible to get a higher status (a form of cheating)

how to deal with the decrease in quality of contributions
How to deal with the decrease in quality of contributions?
  • Measure quality
    • Track how many people download a contribution and how they rate it (like “Impact factor”)
    • Reward users for rating contributions
    • Track “cheaters”
    • Compute a reputation of a user as a contributor and as a rater
  • Reward quality – good users become moderators
    • Give status points
    • Give more rates to give away and higher weight of these weights (like Slashdot)
  • Punish poor quality
    • Lower status, lower weight of ratings, less ratings to give
    • Less visible contributions