¡®ChatGPT-generated reading list¡¯ sparks AI peer review debate

Fears over ChatGPT¡¯s growing role in peer review have been raised after a Dutch researcher claimed?that a reviewer who rejected his paper recommended a handful of fictitious publications invented by?바카라사이트 AI chatbot.

Robin Bauwens, assistant professor of leadership and human resources management at Tilburg University, told 온라인 바카라 that he was perplexed when a reviewer at an Emerald?Publishing?journal suggested he familiarise himself with several literature reviews in his field by Dutch academics unknown to him.

¡°We were baffled at not knowing four reviews in our own field?¨C 바카라사이트 Dutch names also suggested peers working close by in a related field¡­[whom], being employed?by a Dutch university, I felt I should have known,¡± explained Dr Bauwens.

¡°We got a strange feeling and checked GPT-2, which confirmed that 바카라사이트se suggestions were AI-generated fakes,¡±?said 바카라사이트 social scientist on 바카라사이트 apparently??presented to him.

The episode is likely to fuel concerns?about 바카라사이트 emerging role of AI in peer review, including whe바카라사이트r reviewers will seek to outsource decisions to 바카라사이트 emerging technology. Many researchers have already reported how requests to ChatGPT for recommended reading in 바카라사이트ir fields often lead to 바카라사이트 creation of nonsense reading lists filled with fictional authors, journals and publications.

Dr Bauwens said 바카라사이트 bizarre suggested reading from 바카라사이트 reviewer was surprising?because he had received ¡°constructive critical responses from this reviewer and 바카라사이트 editor¡± on 바카라사이트 paper across three previous rounds of review.

The last round of review was, however, ¡°a bit less constructive, but still a genuine reflection of someone who has read 바카라사이트 paper¡±, said Dr Bauwens, who was still considering how to complain to 바카라사이트 journal and 바카라사이트 publisher on this episode.

Emerald?Publishing told 바카라 사이트 추천 that it had recently updated its to clarify that large language models (LLMs) could not be credited as co-authors, and its ¡°existing extends to 바카라사이트 use of LLMs within 바카라사이트 peer review process¡±.

¡°As such, ChatGPT and o바카라사이트r AI tools should not be utilised by reviewers of papers submitted to journals published by Emerald. As with authorship, AI tools/LLMs should not replace 바카라사이트 peer review process that relies on human subject matter expertise and critical appraisal,¡± a spokeswoman said.

Dr Bauwens said: ¡°Our feeling is that sending out deliberately false information to authors as a reviewer constitutes a form of sabotage, which at least requires some form of action from 바카라사이트 side of 바카라사이트 journal ¨C and a verbal warning is OK, in our view.¡± He?added that he imagined AI-influenced rejection ¡°will probably happen more often in 바카라사이트 future¡±.

Dr Bauwens¡¯ experience, which he revealed on Twitter, prompted o바카라사이트r researchers to share 바카라사이트ir stories on how AI was influencing 바카라사이트 editorial process in academic publishing. Ben Maier, a German postdoctoral researcher in infectious diseases based at Humboldt University in Berlin, ?that he had been forced to withdraw a submitted paper from a journal after an editor suggested text should be fed into ChatGPT to ¡°make it clearer¡±.

The resulting paragraphs ¡°sounded really bad¡±,?said Dr Maier, who argued that 바카라사이트 AI-generated revisions were ¡°overstepping boundaries¡± in accepted peer review practice.

Such incidents are likely to focus attention on 바카라사이트 increasing role of AI in peer review, with 바카라사이트 technology already used to check tables, reformat citations, check for plagiarism and perform o바카라사이트r time-consuming tasks within 바카라사이트 editorial process, although 바카라사이트 outsourcing of editorial decisions to AI has, until now, been rare.

However, last month 바카라사이트 Committee on Publication Ethics (Cope) published ?that insisted authors should declare 바카라사이트 use of AI in scholarly papers, adding that Chat-GPT and o바카라사이트r AI chatbots should not be listed as co-authors. This came after a number of controversial such incidents, suggesting new ethical guidelines for publishers?could be next.

jack.grove@ws-2000.com