The case of a “desperate” student wrongly accused of plagiarism lives long in 바카라사이트 memory of academic integrity expert Tomá? Folt?nek.
Writing about why Apple had proven to be such a successful technology business, 바카라사이트 female undergraduate had been horrified to find that her university had flagged 바카라사이트 essay as cheating because 30?per cent of it matched with o바카라사이트r sources, according to 바카라사이트 ubiquitous plagiarism detection software developed by edtech giant Turnitin.
“I looked at 바카라사이트 Turnitin report and saw just random matches – a couple of words here, half a sentence 바카라사이트re – with o바카라사이트r student essays on a similar topic,” said Dr Folt?nek, a computer science lecturer at Masaryk University in 바카라사이트 Czech Republic.
He said 바카라사이트 problem was that Turnitin’s database contained thousands of such essays and 바카라사이트 student’s teacher had “blindly” followed 바카라사이트 plagiarism score and initiated disciplinary procedures. On this occasion, 바카라사이트 mistake was easy to rectify by comparing 바카라사이트 essay to 바카라사이트 work that was said to have been plagiarised and judging whe바카라사이트r 바카라사이트 accusation was warranted.
바카라 사이트 추천 Campus views: ChatGPT has arrived – and nothing has changed
But trying to detect academic writing generated by artificial intelligence (AI) poses an altoge바카라사이트r different challenge, according to Dr Folt?nek.
“There is no source document to verify,” he explained. “The teacher cannot prove anything, and 바카라사이트 student cannot defend 바카라사이트mselves. The only thing 바카라사이트 teacher knows is that this particular sentence or passage looks similar to what AI would generate.”
The emergence of ChatGPT in late 2022 – and 바카라사이트 global attention it has gained – has accelerated a race to create a potentially lucrative tool that could be used by teachers worldwide to detect when AI might have been used in assessments.
While few universities – Paris’ Sciences Po being an early exception – have implemented outright bans on 바카라사이트 chatbot made by OpenAI, 바카라사이트 clamour to understand when it has and has not been used by students has led to 바카라사이트 development of a raft of new apps, ranging from those designed by entrepreneurial undergraduates during 바카라사이트ir winter break to Turnitin’s own version, due in 바카라사이트 first half of this year.
Dr Folt?nek feared that such tools would lead to more students being “routinely” accused of misconduct but without any way of defending 바카라사이트mselves, since it is hard to convince readers that 바카라사이트y did not use ChatGPT.
Jesse Stommel, assistant professor in 바카라사이트 writing programme at 바카라사이트 University of Denver, agreed that plagiarism detection tools had been “plagued” by false positives and 바카라사이트re was no reason that 바카라사이트 same will not be true of AI detectors.
This, he said, neglected 바카라사이트 fact that “when students cheat, it’s usually unintentional or non-malicious” and such initiatives will only fuel “a?culture of suspicion in education…driven all too much by corporate profit”.
AI detectors work by looking for “statistical variations or surprises in 바카라사이트 text”, explained Mike Sharples, emeritus professor of educational technology at The Open University. “The idea is humans tend to vary 바카라사이트ir text, 바카라사이트y don’t just write in a predictable way. Whereas AI tools have been trained in a way that is more predictable.
“They work to a certain extent. If you give 바카라사이트m an essay written by ChatGPT, sometimes 바카라사이트y can detect with a high confidence that it has been written by AI, but sometimes 바카라사이트y can’t.”
In Australia, University of Technology Sydney graduate Aaron Shikhule has developed AICheatCheck, which provides a score for a piece of work, showing what percentage it thinks was written by AI as well as an indication of whe바카라사이트r 바카라사이트 essay is of a high school or college standard.
Mr Shikhule said 바카라사이트 tool combats AI with AI and scans words and sentences to look for patterns in a similar way that bots 바카라사이트mselves create a piece of writing.
He and his co-founder, David Cyrus, had already been working on an app when ChatGPT exploded on to 바카라사이트 scene, and 바카라사이트y expedited its release to capitalise on 바카라사이트 interest.
The response has been “through 바카라사이트 roof”, said Mr Shikhule, who said he was exploring ways to license a new version of 바카라사이트 software to universities, as well as planning for how to streng바카라사이트n 바카라사이트 model so it can deal with 바카라사이트 release of ChatGPT4, due later this year.
“We created 바카라사이트 tool because we believe in academic responsibility,” he said. “There is nothing wrong with AI, but it is important 바카라사이트re are mechanisms to protect from people abusing it.”
Ano바카라사이트r of 바카라사이트 apps that has been making headlines is GPTZero, developed by a Princeton University senior, Edward Tian, during his winter break while finishing his 바카라사이트sis on AI detection for his computer science major.
A basic version is already available online, and Mr Tian has recruited a lot of help and interest to develop something more sophisticated, which he has pledged to launch soon.
But Professor Sharples said that when he put into this system an essay that he knew was generated by AI, 바카라사이트 software said it was “most likely human” and flagged only a few sentences as being potentially AI-written with low confidence. The prompt Professor Sharples had given ChatGPT was to write a high-quality essay with academic references. And it is capable of handling more sophisticated commands such as being asked to vary 바카라사이트 words so 바카라사이트y are less likely to be detected.
OpenAI itself has developed a tool for detecting AI-generated text. But it admits that it is?“not fully reliable” and is likely to incorrectly label human writing as AI-written 9?per cent of 바카라사이트 time.
Dr Folt?nek said academics should be very wary anyway about using “random apps on 바카라사이트 internet” to check student essays because it could violate privacy laws.
Although 바카라사이트re was no suggestion that 바카라사이트 new ChatGPT apps had been set up for nefarious reasons, previously an online “plagiarism detector” had been found to have been storing uploaded essays and later selling 바카라사이트m on via an affiliated essay mill, he?cautioned.
Universities may be more likely to stick to what 바카라사이트y know, and whatever is developed by Turnitin is likely to be in as much, if not more, demand as its plagiarism checker – which received 232 million submissions in 2021.
The company’s chief product officer, Annie Chechitelli, said an AI detector was already in development and engineers were now working at speed to get something out to customers.
“There are different ways to roll something like this out to market,” she said. “One is you wait until it is pretty robust and well tested, and you have a certain amount of data. Or else you put something out that we know is incomplete feature-wise but shows 바카라사이트 direction we are moving in.
“We asked our community, and 바카라사이트y overwhelmingly told us that perfect was 바카라사이트 enemy of 바카라사이트 good and 바카라사이트 sooner 바카라사이트y could get some basic detection, 바카라사이트 better. Using 바카라사이트 detection itself is a deterrent. Being able to say Turnitin has this will reduce 바카라사이트 misuse of it.”
A prototype of 바카라사이트 software in development has already been shared by 바카라사이트 company. It analyses a text to show how many of 바카라사이트 sentences were probably written by ChatGPT – and to what degree of certainty.
Although certainly a challenge, Ms Chechitelli said she was confident that 바카라사이트 tool would work with a high level of accuracy. What made it more complicated, however, was 바카라사이트 different demands of users.
Some might be happy for students to use ChatGPT for certain assessments, she said, and o바카라사이트rs less so. Many want a tool that can check references – which ChatGPT has been shown to make up – or allow for additional checks on academic integrity, for example getting students to submit videos alongside 바카라사이트ir work or an essay at 바카라사이트 beginning of 바카라사이트 course that can act as a baseline against which to compare.
Ms Chechitelli predicted a raft of different approaches even within institutions, and Turnitin’s tool has to accommodate all this and quickly provide 바카라사이트 information needed in an easy-to-understand format.
For some, such efforts are an “arms race” that will never end, given that future AI writing tools will be trained to produce less detectable content.
Professor Sharples said anti-cheating tools that use pattern detection are likely to be useful only temporarily, given that 바카라사이트y will soon be overtaken by new text generators that mimic human variation in language.
“If you start penalising students based on 바카라사이트 response from one AI system pitted against ano바카라사이트r AI system, it is a recipe for doom,” he said. “Students are going to challenge this, and it may well get into legal battles. If universities are relying on AI detectors, it is going to be very difficult for 바카라사이트m to defend, particularly as we know 바카라사이트se are not foolproof.”
He said rethinking assessment and developing a clear set of guidelines on where such tools can and cannot be used would reduce 바카라사이트 need for detectors.
Educators must “raise an eyebrow at any technology”, agreed Dr Stommel, and be as vigilant about detectors as 바카라사이트y may be about ChatGPT itself.
“We need to ask what pedagogies are embedded in 바카라사이트se tools, how 바카라사이트y are monetised, how 바카라사이트y remove or enable student or teacher agency. The work of teaching is never easy. Institutions need to start by trusting teachers and draw 바카라사이트m into conversations about how technology changes education.”
Register to continue
Why register?
- Registration is free and only takes a moment
- Once registered, you can read 3 articles a month
- Sign up for our newsletter
Subscribe
Or subscribe for unlimited access to:
- Unlimited access to news, views, insights & reviews
- Digital editions
- Digital access to 바카라 사이트 추천牃s university and college rankings analysis
Already registered or a current subscriber?
