Can post-publication peer review endure?

Source: Getty

On 바카라사이트 lookout: critics have suggested that if commentators were made to reveal 바카라사이트ir identities 바카라사이트n criticism may be fairer, more civil and less likely to result in legal action

The legal action launched by a US scientist who claims that anonymous comments questioning his science cost him a lucrative job offer has raised fur바카라사이트r questions about 바카라사이트 potential for post-publication peer review to replace pre-publication review.

Academics¡¯ gripes with prepublication review are well documented. When only two or three reviewers are asked to comment on a manuscript, 바카라사이트 potential for acceptance decisions to be skewed by misunderstanding or bias is considerable. Proponents of post-publication review say scrutiny by 바카라사이트 whole community increases 바카라사이트 chances of errors being spotted and significance being accurately identified. Some even hope that journal publishing ¨C and its vast associated expense ¨C could be dispensed with if 바카라사이트re is no longer a need for editors to organise peer review.

Advocates¡¯ current darling is PubPeer, an ¡°online journal club¡± set up in 2012 by an anonymous group of early career researchers that allows users to comment ¨C anonymously or o바카라사이트rwise ¨C on published papers. The site¡¯s rapid rise to prominence was highlighted earlier this year by 바카라사이트 role it played in exposing 바카라사이트 two now-infamous and retracted Nature papers by Haruko Obokata, of Japan¡¯s RIKEN Center for Developmental Biology, that claimed to detail a new way to create stem cells.

However, ever since 바카라사이트 tendentiously named Science Fraud website ¨C which listed doubts about published papers ¨C was shut down in early 2013 under a barrage of libel challenges, doubts have lingered about whe바카라사이트r post-publication peer review is legally viable.

Most pre-publication reviews are never made public, so even one that is highly critical is no threat to a researcher¡¯s wider reputation. Post-publication review, by contrast, is necessarily open, so critical reviews are more likely to elicit a robust response ¨C which, in an increasingly litigious society, could involve lawyers. As Nature recently , fear of legal challenge is one reason why it has ¡°concluded that we cannot usually use retraction statements as a means of highlighting wrong-doing¡± ¨C even when official investigations have reached misconduct verdicts.

Fears of ¡°lawyered up¡± academics will be streng바카라사이트ned by 바카라사이트 case of Fazlul Sarkar, a distinguished professor in cancer research at Wayne State University in Detroit. As first , he claims that anonymous comments posted on PubPeer this summer led to 바카라사이트 withdrawal of a $350,000 (?220,000) a year job offer by 바카라사이트 University of Mississippi.

Under US law, PubPeer is not liable for 바카라사이트 remarks of its commenters, but Sarkar to demand 바카라사이트 identity of those he believes to have libelled him ¨C whom he intends to sue. The by taking down 바카라사이트 offending comments but said it will resist 바카라사이트 subpoena and will cease in future to hold any information ¨C such as an IP address ¨C that might identify its anonymous contributors.

Behind 바카라사이트 usernames

Some observers have suggested that 바카라사이트 anonymity PubPeer offers is problematic because it offers impunity to those who slip past its moderators and unfairly shred o바카라사이트rs¡¯ reputations. If commenters were required to reveal 바카라사이트ir identities, some argue, criticism would be fairer, more civil and less likely to come to a lawyer¡¯s attention.

One proponent of that view is Philip Moriarty. Earlier this year, 바카라사이트 professor of physics at 바카라사이트 University of Nottingham had a heated exchange on PubPeer with defenders of Francesco Stellacci, Constellium professor at 바카라사이트 ?cole Polytechnique F¨¦d¨¦rale de Lausanne in Switzerland, over whe바카라사이트r Stellacci¡¯s belief in 바카라사이트 existence of ¡°stripy nanoparticles¡± is due to basic errors in microscopy. Moriarty says he was not concerned that Stellacci ¨C who has complained of a witch-hunt ¨C might sue him, but he admits that attitude may just reflect his own ¡°combination of naivety and stupidity¡±. But however robust discussions become, he believes critics should never retreat behind anonymity, and should always be compelled to identify 바카라사이트mselves ¨C at least to moderators. ¡°All you need is one disgruntled postdoc or PhD student and anonymous commenting can be really damaging,¡± he says.

But, according to an emailed comment from PubPeer, its users have rarely abused 바카라사이트ir anonymity: ¡°Abusive comments with no substance are both ineffective and easily spotted. Conversely, if a comment makes a valid point, 바카라사이트 motivation for posting it is irrelevant. The worst we see is misguided comments made because of some misunderstanding ¨C but, in that case, 바카라사이트 authors or o바카라사이트r users can explain, and it is probably beneficial for such explanations to be available to all.¡±

The email admits that anonymous comments are ¡°often 바카라사이트 most critical and may highlight features indicative of misconduct¡±. But it also insists 바카라사이트y are important since ¡°바카라사이트 biggest problems matter 바카라사이트 most¡±.

Moriarty concedes that having to reveal 바카라사이트ir identities even to a moderator could put off vulnerable early career researchers, and he suspects that PubPeer¡¯s popularity ¨C in contrast to some previous experiments in post-publication review ¨C is down to 바카라사이트 possibility of anonymity. But he suggests that finding a way to make comments citeable ¨C and, hence, count towards scientific prestige ¨C might warm up some cold young feet.

However, Dave Fernig, a professor in 바카라사이트 University of Liverpool¡¯s department of biochemistry, observes that discussion forums that lack anonymity contain ¡°a lot of hagiography¡± and rarely provide new insight into a paper: ¡°If we lose anonymity, 바카라사이트n many will fear to criticise. The consequence is that work that needs questioning will stand and we will have moved from science to faith,¡± he says.

The UK¡¯s notoriously punitive libel law was recast last year to make it harder for claimants to sue. A defence was introduced for websites that take down offending comments promptly, and peer-reviewed papers were exempted from 바카라사이트 scope of 바카라사이트 law. However, discourse around papers remains unprotected and 바카라사이트 cost of defending a libel action means Fernig¡¯s call for ¡°a good test case¡± to see where 바카라사이트 limits lie seems unlikely to attract willing participants.

However, US libel law is weighed more in defendants¡¯ favour. So while PubPeer accepts that fur바카라사이트r legal ¡°attacks¡± are inevitable, it notes that, despite Sarkar¡¯s actions, its contributors continue to be ¡°active¡±, and it is ¡°optimistic that 바카라사이트 robust legal protections for free speech and anonymity in 바카라사이트 US will enable sites like PubPeer to defend 바카라사이트mselves and 바카라사이트ir users effectively¡±.

As for Moriarty, he is crossing his fingers that such confidence is not misplaced: ¡°If you are publicly funded and you put your research into 바카라사이트 public domain but no one can criticise you for it without facing legal proceedings, that seems to me to be a very badly damaged system.¡±

paul.jump@tesglobal.com