cpsc 699 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
CPSC 699 PowerPoint Presentation
Download Presentation
CPSC 699

Loading in 2 Seconds...

play fullscreen
1 / 18

CPSC 699 - PowerPoint PPT Presentation


  • 149 Views
  • Uploaded on

CPSC 699. Templates for refereeing. A Template for Reviewing. Paper Title Author(s) Manuscript Number. A Template for Reviewing. Briefly summarize the paper (2-3 lines) can you extract a main message from your paper? lets author know if you understood the main message

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'CPSC 699' - ila-ross


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
cpsc 699

CPSC 699

Templates for refereeing

a template for reviewing
A Template for Reviewing
  • Paper Title
  • Author(s)
  • Manuscript Number
a template for reviewing1
A Template for Reviewing
  • Briefly summarize the paper (2-3 lines)
    • can you extract a main message from your paper?
      • lets author know if you understood the main message
    • “If you can’t, there is probably something wrong with the paper”
        • --- CHI FAQ
a template for reviewing2
A Template for Reviewing
  • What is NEW and SIGNIFICANT in the work reported?
    • New:
      • has it been done before?
      • is it a rehash / republication of old stuff (yours or others)?
    • Significance
      • in five years time, would the work have an identifiable impact? (rare)
a template for reviewing3
A Template for Reviewing
  • ...What is NEW and SIGNIFICANT
    • Survey/discussion piece
      • does it add value?
    • Would it stimulate further work in this area?
      • is it a reasonable increment that keeps the research area going (frequent)?
      • does it have innovations?
      • is it interesting?
      • is it timely to the community?
a template for reviewing4
A Template for Reviewing
  • Describe the QUALITY of the RESEARCH
    • How sound is the work?
      • quality of algorithms, analyses, evaluation methods, etc.
    • How appropriate/reliable are the methods used?
      • are they adequate to support the conclusions
      • is it correct?
a template for reviewing5
A Template for Reviewing
  • Describe the QUALITY of the RESEARCH
    • How reasonable are the interpretations?
      • good arguments
      • alternative interpretations explored/left out
    • How does it relate to existing work?
      • bibliographies, background, important omissions…
a template for reviewing6
A Template for Reviewing
  • Describe the QUALITY of the RESEARCH
    • Can an experienced practitioner in the field duplicate the results from the paper and the references?
      • are there details sufficient?
a template for reviewing7
A Template for Reviewing
  • Describe the QUALITY of the WRITING
    • is the message clear?
    • is the paper easy to follow and understand?
    • is its style exciting or boring?
    • is it well organized?
    • is there a good flow of logic/argumentation?
a template for reviewing8
A Template for Reviewing
  • Describe the QUALITY of the WRITING
    • is it grammatically correct?
    • are figures and tables used well and integrated into the text?
    • if it is a foreign writer, how can it be improved?
a template for reviewing9
A Template for Reviewing
  • How RELEVANT is the work to the expected readers?
    • domain
    • depth of treatment
    • degree of specialization
    • accessible to expected range of expertise of readership
a template for reviewing10
A Template for Reviewing
  • Provide any OTHER COMMENTS you believe would be useful to the author
    • constructive suggestions on repairing problems
    • pointers to missing / relevant work
    • minor typos/flaws
a template for reviewing11
A Template for Reviewing
  • Provide any OTHER COMMENTS
    • If revisions were possible, what should the author do to make this paper publishable?
      • concrete, very specific suggestions on what
        • must be done
        • optional work
a template for reviewing12
A Template for Reviewing.
  • Rate the papers ACCEPTABILITY andsummarize why you gave this rating

Conference:

Definitely reject

Probably reject

Could go either way Note: equivalence class!

Probably accept

Definitely accept

a template for reviewing13
A Template for Reviewing
  • Rate the papers ACCEPTABILITY
    • Journal:

Definitely reject

Major revisions

        • additional work, major reworking of arguments
        • subject to a careful check by editor/reviewers

Minor revisions

        • typos, minor changes

Accept as is

a template for reviewing14
A Template for Reviewing
  • Using the scale

1 = Know virtually nothing about this area

2 = Not too knowledgeable, but I know a bit

3 = Know a moderate amount, about average

4 = Not my main area of work, but I know a lot about it

5 = My area of work, I know it well

  • rate your EXPERTISE in the area addressed by the paper
a template for reviewing15
A Template for Reviewing
  • Provide comments that you feel are relevant to the review process but that you do NOT want forwarded to the author(s)
    • try to avoid using this
    • conflict of interests
    • pointers to things that would reveal identity
    • harsher things that would be mis-interpreted
    • suggestions on how to phrase acceptance/rejection letters...
summary
Summary

Refereeing is excellent practice for

  • developing critical appraisal skills
    • templates, typical flaws
  • understanding how good (and bad) papers are written
    • apply understanding to your own work