reviewing papers what reviewers look for n.
Skip this Video
Loading SlideShow in 5 Seconds..
Reviewing Papers: What Reviewers Look For PowerPoint Presentation
Download Presentation
Reviewing Papers: What Reviewers Look For

Loading in 2 Seconds...

play fullscreen
1 / 26

Reviewing Papers: What Reviewers Look For - PowerPoint PPT Presentation

  • Uploaded on

Reviewing Papers: What Reviewers Look For. Session 19 C507 Scientific Writing. Are Referees really Necessary?. Some look at reviewers (referees) solely as biased adversaries whose objectives are solely to reject, delay or scoop all papers submitted to them

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'Reviewing Papers: What Reviewers Look For' - milos

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
reviewing papers what reviewers look for

Reviewing Papers: What Reviewers Look For

Session 19


Scientific Writing

are referees really necessary
Are Referees really Necessary?
  • Some look at reviewers (referees) solely as biased adversaries whose objectives are solely to reject, delay or scoop all papers submitted to them
  • Some feel that science would do quite well without reviewers at all, that we could publish all readable papers without delay and let the community at large sort the bad from good
are referees really necessary1
Are Referees really Necessary?
  • For those that argue against the review process and for unrestricted access, they fail to distinguish between the formal and informal systems of communication in science
price says
Price Says
  • “The scientist is more frequently than not passionate, biased, illogical, resistant to proof and to change, and beset by other similar human failings. It is, today, better to let this show and be understood than to pretend that it is not there.”
an overlooked function
An Overlooked Function
  • One function of the peer review system that is often overlooked is its indirect influence on the initial preparation of a paper
  • Established scientists write their papers with a critical sense that anticipates peer reviewer questions
does the system work
Does the System Work?
  • The answer to this question seems to be a resounding “Yes.”
  • All editors, and most authors will affirm that there is hardly a paper published that has not been improved, often substantially, by the reviewers
  • These same editors will also attest that examples of intentional delay, biased reporting or unethical behavior is rare
the different processes of peer review
The Different Processes of Peer Review
  • Evaluations of papers for publication
  • Assessment of grant proposals
  • Recommendations for positions or tenure
two kinds of consensus
Two Kinds of Consensus
  • There are times when referees will disagree about the suitability of a paper for publication, and so will the journal editor
  • Not infrequently, a paper rejected by one journal is accepted by another
  • These disagreements do not indicate a breakdown of the referee system; rather, they arise from differing views of two kinds of consensus
consensus 1
Consensus #1
  • First, there is the consensus that develops within an editorial board on what constitutes an acceptable paper for that journal
consensus 2
Consensus #2
  • The second consensus that enters into the evaluation of a scientific paper is the one that develops within a field of research
  • In some areas of science the fundamental algorithms and paradigms are well established, tested, verified and accepted
possible solutions
Possible Solutions
  • You could publish the paper and include the reviewer’s comments as a comment or addendum to the paper
  • Or you could consider open review- here, you seek comments from several referees to be published concurrently with the paper
does reviewer anonymity matter
Does Reviewer Anonymity Matter?
  • This remains controversial
  • But, by and large, reviewers really do try their best to offer useful comments to authors.
  • Reviewers need to report with candor and honesty; keep them anonymous is often believed to help do just that
blind review
Blind Review
  • We also remove the author’s name from a paper sent out for review
  • This is supposed to reduce bias
  • But this really does not work too well, just in terms of keeping identity confidential; we have too small a population of researchers in our profession
  • In general, journals send papers to at least 2 reviewers, but may at times use more
  • Reviewers are selected because:
    • They have expertise of use to the journal
    • They support the goals and mission of the journal
general questions reviewers need to answer
General Questions Reviewers Need to Answer
  • Does this paper report a specific, identifiable advance in knowledge?
  • Has the work reported in this paper been published before?
  • Are the conclusions justified, soundly based and logically consistent?
general questions reviewers need to answer1
General Questions Reviewers Need to Answer
  • Are the procedures and methods sufficiently clear that the work could be repeated by anyone knowledgeable in the field?
  • Are the references to previous work pertinent and complete?
general questions reviewers need to answer2
General Questions Reviewers Need to Answer
  • Is the paper as concise as it could be, consistent with clarity?
  • Referees are not required to comment on writing style. However, they are invited to suggest changes that would remove ambiguity or clarify meaning
general questions reviewers need to answer3
General Questions Reviewers Need to Answer
  • Are the figures and tables relevant and properly prepared?
  • Are the title and abstract truly descriptive of the contents?
ethics for reviewers
Ethics for Reviewers
  • We remind reviewers that the paper under consideration is a confidential document that should not be discusses or shown to others without the express permission of the editor
  • As the reviewer’s detailed report may be relayed to the author as a guide for revising their paper, we request that you avoid harsh or abrasive statements (comments specifically to the editor should be sent as a separate written letter)
ethics for reviewers1
Ethics for Reviewers
  • Your anonymity as a reviewer will be preserved and you are asked not to identify yourself to the authors without the permission of the editor
  • The paper must be returned within a specified period of time
the jmpt
  • Let us say that a new paper is submitted to the JMPT
  • We acknowledge receipt of the paper on the day it is received, and a letter that “accepts the paper for consideration to publish” is sent to the principal author
the jmpt1
  • Then, we ready two copies to go out for review
  • The paper is blinded
  • Two reviewers, with expertise in the subject are and for whom we believe to have no bias, are selected
  • Appropriate forms are sent with the paper
the jmpt2
  • Reviewers then provide their critique
  • They are asked to return their review within 2 weeks. 10% might actually do so
  • The editor uses those reviews as a guide to his or her decision
  • Most frequently, the paper is returned for revision
the jmpt3
  • On the review form, the reviewer can check off a set of good points, bad points, and then offer a comment on publishability and/or recommendations for improvement
the jmpt4
  • Good Points
    • Original
    • Timely
    • Interesting to read
    • Practical
    • Information important to document
    • Well suited to journal’s objectives
    • Good research
    • Good review of literature
    • Well written/edited
    • Other good points
Bad Points
    • Too preliminary
    • Duplicates other published research- no new insight
    • Not well suited to journal’s objectives
    • Faulty research design
    • Poorly supported by references
    • Highly speculative
    • Plagiarized material
    • Not well written/edited
    • Other bad points