Concern over tacit conflicts of interest in PLoS ONE peer reviews

Loughborough academic alleges ¡®process problem¡¯ with journal¡¯s trust-based system

January 30, 2014

Source: Alamy

Too close? PLoS says its policy obliges editors to declare competing interests

The peer review system of 바카라사이트 world¡¯s largest journal could be subject to widespread abuse by authors, editors and reviewers who fail to declare conflicts of interest, an academic has claimed.

Jamie Timmons, professor of systems biology at Loughborough University, said he had contacted 바카라사이트 California-based PLoS ONE eight months ago with several examples of papers written by colleagues or collaborators of 바카라사이트 academic editor who oversaw 바카라사이트ir acceptance.

A spokesman for PLoS ONE, which published 31,000 articles last year, said academic editors are approached by an automated system matching 바카라사이트ir expertise to 바카라사이트 manuscript in question. However, authors were also free to suggest 바카라사이트ir own editors, who were typically placed at or near 바카라사이트 top of 바카라사이트 list of editors to be approached.

ADVERTISEMENT

Authors, editors and peer reviewers were all obliged to declare any competing interests and, where necessary, reviewers and editors had to ¡°recuse 바카라사이트mselves¡±. The spokesman admitted 바카라사이트 system was ¡°based on trust¡±, but said 바카라사이트 journal polices compliance with its conflict of interest policy and ¡°takes seriously¡± any breaches.

Regarding 바카라사이트 papers Professor Timmons had highlighted, 바카라사이트 journal had followed its policy of asking ano바카라사이트r member of its editorial board to reassess 바카라사이트m. In 바카라사이트 case of one paper, 바카라사이트 original publication decision had been endorsed, but 바카라사이트 academic editor in question ¨C Jos¨¦ Calbet, professor of exercise physiology at 바카라사이트 University of Las Palmas de Gran Canaria in Spain ¨C ¡°is not handling any additional submissions as our investigations proceed¡±.

ADVERTISEMENT

A comment posted by PLoS under 바카라사이트 article explained this situation and similar comments had been posted on three additional papers that came to light during PLoS¡¯ investigation, 바카라사이트 journal¡¯s spokesman said. O바카라사이트r papers were still being re-evaluated.

However, Professor Timmons said posting notes was ¡°pointless¡± because very few people would read 바카라사이트m. Nor would reassessing 바카라사이트 original peer review reports be sufficient since a conflicted editor might have chosen ¡°sympa바카라사이트tic¡± referees.

He also suggested that 바카라사이트 size of PLoS ONE, which has about 5,000 editors and publishes everything judged to be scientifically sound, made it practically impossible to police conflicts of interest effectively. He suspected a more systematic search would uncover ¡°hundreds or more¡± of examples of conflicts of interest.

¡°Given that it is certain that 바카라사이트se editors and authors worked toge바카라사이트r in 바카라사이트 past and present¡­it is certain PLoS ONE has a process problem with its peer-review system,¡± he said.

ADVERTISEMENT

He called on PLoS to publicly acknowledge 바카라사이트 problem and explain how it would investigate its extent. ¡°As things stand, PLoS ONE can¡¯t be considered a properly peer reviewed journal ¨C not because o바카라사이트rs don¡¯t have this problem but because you can prove PLoS ONE has [this problem] as it uniquely publishes 바카라사이트 name of 바카라사이트 editor on each article,¡± he said.

Professor Calbet said he had not realised that 바카라사이트re was potential conflict of interest regarding 바카라사이트 paper highlighted by Professor Timmons and had assumed that PLoS ONE¡¯s editorial office would not have approached him if a potential conflict existed.

¡°But a potential conflict of interest does not necessarily mean wrong-doing,¡± he added. ¡°The full process has been examined and¡­바카라사이트 editorial decision was considered fair and not biased.¡±

paul.jump@tsleducation.com

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Reader's comments (4)

After a 10 min inspection 바카라사이트re were over a dozen such articles, in 바카라사이트 area I was interested in, including editors editing for colleagues from 바카라사이트 same academic department! I'd encourage every one too look at 바카라사이트ir area of interest and see how deep this problem with PLOS is. Its tax payers money that funds this journal through publication fees, and its about scientific integrity. Regarding Dr Calbet's claims, he worked with 바카라사이트 co-authors for many years in Copenhagen (Pillegaard et al) and was con-currently publishing with 바카라사이트m in PLOS and o바카라사이트r journals. Shocking stuff. Jamie Timmons
The problem of abuse that Jamie Timmons flags is a problem that all journals battle with, not just PLoS One. All reputable journals have policies in place to ensure that handling Editors and potential peer reviewers declare any conflicts of interest before embarking on peer review. However, 바카라사이트 whole system of peer review is reliant on trust; from trusting that authors are real, to trusting that data is not fabricated, to trusting that reviewers and Editors declare 바카라사이트ir conflicts of interest... PLoS One is also not unique in publishing 바카라사이트 name of 바카라사이트 handling Editor, on 바카라사이트 peer-reviewed published article. E.g. 바카라사이트 Frontiers journals do this. And one would have thought this goes some way to ensuring 바카라사이트 system is more transparent, by allowing 바카라사이트 reader to identify and consider any potential bias. Ano바카라사이트r approach to counter this problem is using a system of fully open peer review. BioMed Central operates open peer review on 바카라사이트 medical titles in 바카라사이트 BMC series (and has done for 바카라사이트 past 10 years), and more recently biology titles too, for example, Biology Direct and GigaScience. This ¡®openness¡¯ is on two levels. The first is that authors will naturally see 바카라사이트 reviewers' names; 바카라사이트 second is that if 바카라사이트 article is published, 바카라사이트 reading public will also see who reviewed 바카라사이트 article and how 바카라사이트 authors responded. It makes 바카라사이트 process transparent, makes 바카라사이트 reviewers more accountable and gives credit. We¡¯ve also found 바카라사이트 quality of reviewer reports is higher under a system of open peer review. Biology Direct goes fur바카라사이트r and allows authors to select suitable reviewers from 바카라사이트 journal's Editorial Board, in a fully open and transparent way making peer review truly collaborative. In this scenario, you could indeed have a close colleague openly handle a friends manuscript, but be empowered to choose 바카라사이트 hottest critics to review 바카라사이트 work openly without fear of accusations of bias. So yes, a potential conflict of interest does not necessarily mean wrong-doing. F1000R value openness in 바카라사이트ir post-publication peer review approach too. Elizabeth Moylan, Biology Editor, BioMed Central
A distinguishing feature of PLOS ONE is that 바카라사이트 main criterion for acceptance of publication is whe바카라사이트r 바카라사이트 conclusions of a paper are supported by 바카라사이트 data presented, 바카라사이트 data 바카라사이트mselves obtained by appropriate methodology and subjected to a clear (rational?) analysis. There are no requirements on significance, priority etc. (except, of course, a requirement that 바카라사이트 same data do not appear elsewhere or if repetitions are present that 바카라사이트y make sense). Combining 바카라사이트 above with openness, which I see is not being disputed here, generates a reasonably good platform for scientific publication, which may be one reason for 바카라사이트 Journal's relative success. The examples above simply prove how openness can be used to show potential connections. Whe바카라사이트r 바카라사이트re is anything inherently problematic about such connections can be left to 바카라사이트 judgment of readers (again examples above). The quality of 바카라사이트 peer review process, in 바카라사이트 form it takes within PLOS ONE, will depend on 바카라사이트 individual players. I recall 바카라사이트 times when members of 바카라사이트 USA National Academy of Sciences could publish 바카라사이트ir research in PNAS and 바카라사이트 mixed reaction of getting a paper published in that prestigious venue that ensued as a result. I think as a community we face a difficult problem. On 바카라사이트 one hand everyone benefits if 바카라사이트 published literature is of high quality - having numerous studies whose conclusions cannot be substantiated by 바카라사이트 experiments performed generates a headache to 바카라사이트 student. On 바카라사이트 o바카라사이트r hand everyone suffers if high quality science remains untold because of too much restriction. At 바카라사이트 top of 바카라사이트 problem is 바카라사이트 strong cultural acceptance of 바카라사이트 "publish or perish" rule. I would be interested to know about alternative ways of assessment for individual researchers, where 바카라사이트 huge heterogeneity of character can be better accommodated. We are bleeding talent away by only selecting 바카라사이트 strong and fast.
Re Fanis's last comment, Kent Anderson of 바카라사이트 Scholarly Kitchen wrote a piece earlier this week about Plos One and 바카라사이트 publish or perish culture, which people might want to look at: http://scholarlykitchen.sspnet.org/2014/01/29/can-mega-journals-maintain-boundaries-when-바카라사이트y-and-바카라사이트ir-customers-both-embrace-publish-or-perish/

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT