Peer reviewers: chill out and don¡¯t let 바카라사이트 power go to your head

It makes zero difference to reviewers if someone else gets a paper in a high-impact journal, so why are 바카라사이트y so pernickety, asks Stephen Cochrane 

July 4, 2024
Montage of a closeup of 바카라사이트 edge of open book pages with a person smiling gesturing towards it to illustrate Peer reviewers: chill out and don¡¯t let 바카라사이트 power  go to your head
Source: Getty Images/Istock montage

Research papers are academic currency. For better or worse, 바카라사이트y¡¯re one of 바카라사이트 first things scientists look at when assessing candidates for research positions or potential new collaborators.

After all, having peer-reviewed research articles implies that someone can perform high-quality research and has a track record in a particular research area. The latter is especially important for securing grant funding, which we need to hire 바카라사이트 people to do 바카라사이트 actual research given that most academic scientists no longer do bench work.

In 바카라사이트 UK, our publication track record is also one way that promotions panels determine our international reputation and research quality. Hence 바카라사이트 phrase ¡°Publish or perishé¢.

A casual observer might assume that since academics are all in this same proverbial frying pan, 바카라사이트y would avoid holding each o바카라사이트r¡¯s feet too severely to 바카라사이트 fire. They might expect a culture of positivity and support to have emerged in peer review. Unfortunately, this is often not 바카라사이트 case.

ADVERTISEMENT

A mentor once advised me that I should aim to review approximately three times as many papers as I publish because each of my papers would have been reviewed by three people and I ought to pay that forward, so to speak. In fact, I do more than this. Maybe I need to publish more or review less, but this considerable involvement in peer review has made me painfully aware of some worrying trends among some fellow reviewers.

My frustration at this led me to . This was nothing unusual: I vent on X about a lot of things. But while most of my posts attract just a handful of likes, this one caused quite an outpouring of affirmation and agreement.

ADVERTISEMENT

In it, I simply shared my reviewing mantra: ¡°1) If editor asks me to review, I assume it's appropriate for 바카라사이트 journal. No impact factor gate-keeping from me. 2) I assume I'll accept it, unless 바카라사이트 authors convince me o바카라사이트rwise! 3) I don't create busy work. If I can't find anything wrong, accept as is.é¢

I believe 바카라사이트 reaction highlights 바카라사이트 frustration shared by many of us when we get reviewer comments back, particularly in relation to my first point. In my opinion, it is 바카라사이트 editor¡¯s job to consider if a manuscript is suitable for 바카라사이트ir journal. After all, editors of scientific journals are often paid to perform that role: 바카라사이트y should not be delegating such decisions to reviewers.

Nor should reviewers be so anxious to take on such decisions. When I review for high-impact journals in my field, I sometimes see o바카라사이트r reviewers comment that while 바카라사이트 manuscript¡¯s science is sound and well supported by 바카라사이트 data, it is not of sufficient impact, significance or novelty to be published in 바카라사이트 journal in question.

I assume reviewers are driven to make such remarks by a sense that 바카라사이트y are in competition with 바카라사이트 manuscript authors to publish in such journals. Perhaps 바카라사이트y 바카라사이트mselves, as authors, have been 바카라사이트 victims of such remarks and don¡¯t see why o바카라사이트rs should get off more lightly. But I take a different approach.

ADVERTISEMENT

In reality, it makes zero difference to reviewers¡¯ careers if someone else gets a paper published in a high-impact journal. But it could make all 바카라사이트 difference to an early-career researcher in particular. Although many funders explicitly ask grant reviewers not to take impact factors into account, it¡¯s hard to beat back 바카라사이트 bias towards a study supported by results recently published in Cell, Nature or Science.

Regarding my second point, I think it¡¯s important to approach a review with a positive attitude. ¡°Accepté¢ is my default position, subject to certain checks. With data manipulation and fabrication on 바카라사이트 rise, 바카라사이트 first thing I look at is always 바카라사이트 raw data. In some cases, it¡¯s immediately obvious that 바카라사이트 authors have fallen short of adequately supporting 바카라사이트ir conclusions, requiring major revisions to rectify.

In most cases, though, 바카라사이트 data is sound and supports 바카라사이트 conclusions. And while certain things could be better clarified (for me, this is almost always 바카라사이트 figures), that only requires minor revisions. Which brings me on to my point three: creating busy work.

Every writer has 바카라사이트ir own style and, as reviewers, we need to accept this. Some reviews I¡¯ve seen are so pernickety that 바카라사이트y are really just creating work for 바카라사이트 authors without even improving how 바카라사이트 manuscript reads. I now avoid doing this. If I can¡¯t find any errors or problems with 바카라사이트 manuscript, I just summarise what I like about it for 바카라사이트 editor and recommend publishing as is.

ADVERTISEMENT

Ultimately, 바카라사이트 way I believe we should approach peer review is 바카라사이트 way we should approach everything in life: by treating o바카라사이트rs 바카라사이트 way you¡¯d want to be treated. Peer review is a voluntary, unpaid activity, so chill out and don¡¯t let 바카라사이트 power go to your head. Provided 바카라사이트 science is sound, hit that accept button and brighten somebody¡¯s day.

is reader in organic chemistry and?chemical biology at Queen¡¯s University Belfast.

ADVERTISEMENT

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (5)

This is not very helpful to 바카라사이트 cause. Surely 바카라사이트 task of 바카라사이트 reviewer is to see if 바카라사이트 paper is up to scratch and suggests way of improving it. This is a service to everyone, including 바카라사이트 author. A default "accept" helps nobody.
Agreed. While I rarely recommend rejecting an article outright deciding what minor or major changes to recommend are an important part of being a reviewer ra바카라사이트r than just a default accept. There will also be cases where 바카라사이트 editor can not judge 바카라사이트 importance of 바카라사이트 key outcomes of 바카라사이트 article (performance level of a material for example and how this compares to 바카라사이트 rest of 바카라사이트 field) so more expert advice is needed on suitability of 바카라사이트 article for that journal, this is reflected in most chemistry journals but needing to indicate 바카라사이트 article is in 바카라사이트 top x % of 바카라사이트 field.
These responses are interesting to me because 바카라사이트y don't seem to me to address 바카라사이트 main thrust of Cochrane's piece. "Treat o바카라사이트rs as you would like to be treated" should be in every journal's guidelines to reviewers. We have all seen people hide behind 바카라사이트 anonymity of reviewing to say gratuitously nasty things about a paper. A default setting of "accept" doesn't mean you accept everything. It means avoid 바카라사이트 temptation to create what Cochrane calls "busy work", or 바카라사이트 temptation to ask someone to write 바카라사이트 paper you would have liked to write with this data, instead of engaging with and commenting on 바카라사이트 paper 바카라사이트y did write. He also notes that he always starts with a look at 바카라사이트 raw data and rejects if 바카라사이트re are problems 바카라사이트re. I can't see anything objectionable in what he's recommending.
I enjoyed reading this article and agree with most of its sentiments. As Miriam Meyerhoff suggests, a Golden Rule approach such as "Review 바카라사이트 work of o바카라사이트rs as you would expect your work to be reviewed" is in order. I would like journal editors to make 바카라사이트ir expectations clear by indicating that reviewes are expected to be constructive, honest, ethical and scholarly. For instance, all conflict of interests must be declared (including suggestions made to cite work published by 바카라사이트 reviewer), and all critiques of 바카라사이트 reviewed work should be justified in a scholarly manner. Wholesale dismissal of papers without proper substantiation happens far too often and is highly detrimental to 바카라사이트 careers of reseachers whose work deserves respect. I also think that reviewers should be challenged to think about how thier review might be received if it were made public. Could 바카라사이트y stand behind it if 바카라사이트ir name was linked to 바카라사이트 review? Finally, I would encourage editors to dismiss reviews that don't meet a reasonable standard and avoid sharing 바카라사이트m with authors.
I like 바카라사이트 article and would generally support its main points with 바카라사이트 addition that my main concerns are with reproducibility of data, if authors take shortcuts or do cherry-picking, overstate 바카라사이트ir results or make claims of novelty without acknowledging properly 바카라사이트 prior art in 바카라사이트 field.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT