The Importance of Peer Review

Peer review is the process where an academic author’s work is subjected to the examination of other experts in the same field as part of the journal publication process. 

Complements but is entirely different from, editorial review

Technically speaking, an editorial review is the first and third stage of review of manuscripts submitted by researchers to scholarly journals, and peer review is, as a rule, the second stage of this process. Peer review is different, because, instead of a faculty reading carefully the arguments and research findings that form a scholarly article of a researcher, and giving their opinion as to its scientific quality, they will today outsource it to (usually, two anonymous) peer reviewers.

Peer review is complementary to editorial review, because today, editorial review screens the overall compatibility of the article with the editorial guidelines of the scholarly journal in question. If a journal is large or leading in a given scientific field, and, especially, if a journal is multi-disciplinary, a manuscript is usually assigned to one of its sections’ editor. If a journal’s scope and reach are narrower and / or the journal is rather ‘young’, a manuscript can go directly to its general editors or editors-in-chief. In both cases, a preliminary editorial review generally aims at identifying whether the manuscript:

  1. sufficiently satisfies the editorial guidelines of that journal;
  2. is likely to provide clear scientific contribution and implications for the domain in question; and 
  3. has some likelihood to be favourably evaluated by the journal’s peer reviewers.

Note that, while the quality of the manuscript is a decisive criterion for its screening in / out at the pre-peer review stage, a manuscript may be rejected by the editors for a variety of reasons, including subject matter interest, and sometimes even simply pipeline management—namely, too many articles on the same topic. When a submitted manuscript fails to satisfy one or more of these criteria, a decision is made to return the manuscript instead of sending it to peer reviewers as a part of the journal’s (typically, double-blind) peer review process.

May provide some guarantee of scholarly excellence

Indeed, the term ‘peer review’ means the review, mostly blind, of researchers’ manuscripts by their peers who are experts in the field in question. The criteria that peer reviewers use are quite common for any discipline: the choice of topic, the originality of the principal argument, the novelty of empirical data, coherent approach, method, and the structure of the paper, and the like. However, there are a few nuances here, too.

At this—second—stage of scholarly review, peer reviewers assess much more thoroughly than the journal editors at the previous stage whether the submission provides clear scientific contribution and implications for the scientific area in question. However, the results of the review by peers are recommendations to the journal editors instead of a categorical Yes / No verdict. Also, most scholarly journals in any scientific discipline classify article submissions into at least three general categories:

  1. Accept, 
  2. Revise & Resubmit, and 
  3. Reject.

Moreover, the ‘Accept’ category is most commonly divided into ‘Accept in its current form’ and ‘Accept with minor revisions’. Note that in most cases, the authors must carry out at least some revisions. After the first (and often the only) round of peer review and taking into account the peer reviewers’ recommendations, the journal editors decide to accept, revise, or reject the manuscript. After revisions, except when the article was accepted in its current form, the journal editors then send the revised manuscript back to the same peer reviewers. However, a very average rate of refusal to peer review the original manuscripts in any discipline is as high as 50 per cent. So, the refusal rate (or only the problem of tardiness) to peer review the revised articles is even higher (except in the case of ‘Revise & Resubmit’, when the same peer reviewers must, in principle, read the revised paper). Indeed, there is only so much peer-reviewing that one can do, as peer reviewers are commonly unpaid in the case of most scientific journals, and surely, in the most reputed ones.

Consequently, once a paper is revised following the peer reviewers’ recommendations on the original manuscript, in at least half of the cases, it is the journal editors who make the final decision on some additional revisions and updates, and, ultimately, publication.

To sum up, both the first stage (preliminary editorial review or screening) and second stage (peer review) are essential. But the most critical test for a manuscript to pass is, of course, peer review. If peer reviewers recommended accepting the manuscript in its current form, accepting with minor revisions, or at least revising and resubmitting it, this means that generally, the submission passed the most challenging stage successfully. The third stage (second editorial review or ‘review of peer review’) depends on each particular journal but is commonly more comfortable to deal with.

The question that naturally follows the above is:

How do you maximize the chances of the manuscript being screened by the journal editors, and especially positively evaluated and recommended to at least revise and resubmit, by peer reviewers?’

We address this question below.

Back to basics: Methodology and overall form

The abstract and introduction of a manuscript are crucial, as they make the first fundamental impression and pave the groundwork for the analysis, and hence, also for peer review.

While it depends on the scientific field and even the journal in question, the introduction of a research article today should, in principle, address the following:  

  1. Why the topic is vital from the societal—political, social, economic—and only then the researcher’s discipline point of view (Importance);
  2. A (brief!) overview of existing literature and / or state-of-the-art (Gaps);
  3. Why this study is necessary today, what will it do—for the discipline, and, if possible, for the society as a whole (Contribution);
  4. The fundamental theoretical approach (Approach);
  5. A detailed methodology (Research question, methods and analysis); and 
  6. A very clear structure of the article (Structure).

 

Regarding the methodology, which is most of the time the most criticised item by peer reviewers, the following structure may be of help:

  1. Theoretical framework: depends on the discipline.
  2. Data: could be textual (texts, typically used in humanities), empirical (experimentation, observations, interviews, statistics—widely used in natural and social sciences), or mixed. 
  3. Analysis: is the way(s) you analyse your data. The analysis of texts is mostly theoretical, as opposed to empirical data, which is most typically analysed qualitatively and /or quantitatively.
  4. Results: are the results of your analysis of the data chosen according to your theoretical framework.

 

NOTE: 1) and 2) typically belong to Approach (the way of asking the research question), 3) belongs to Method(s) (the way(s) of answering the research question).

 

Maximise your publication success with Charlesworth Author Services.

Charlesworth Author Services, a trusted brand supporting the world’s leading academic publishers, institutions and authors since 1928. 

To know more about our services, visit: Our Services

Share with your colleagues