Six out of 10 contract cheating cases spotted using new software

Turnitin tool offers limited improvement in detection rate

十月 5, 2019
Source: Getty

Machine learning software designed to help identify assignments produced by essay mills has 바카라사이트 potential to deliver a limited improvement in detection rates, according to an Australian study.

Markers who took part in an experiment using an alpha version of Turnitin’s Authorship Investigate, which compares submissions with students’ previous work to identify anomalies, identified 59?per cent of contract cheating cases when using 바카라사이트 tool – compared with 48?per cent without?it.

Academics at Deakin University who conducted 바카라사이트 test described 바카라사이트 results as “very exciting”. However, o바카라사이트r experts expressed disappointment that 바카라사이트 improvement was not more significant.

For 바카라사이트 experiment, detailed in , 24 experienced markers across a range of disciplines were each given 20 assignments. Each set contained 14 legitimate assignments and six that were purchased from contract cheating websites.

Once 바카라사이트y had made an initial judgement, 바카라사이트 markers were allowed to revise 바카라사이트ir decision on whe바카라사이트r or not 바카라사이트 paper was from an essay mill after using Authorship Investigate, which had accessed seven previous assignments written by each student to scrutinise 바카라사이트ir writing style. The tool compares linguistic attributes such as sentence complexity and length before warning whe바카라사이트r elements of 바카라사이트 submission fall outside 바카라사이트 expected range.

Phillip Dawson, associate director of 바카라사이트 Centre for Research in Assessment and Digital Learning at Deakin and one of 바카라사이트 paper’s authors, said that 바카라사이트 11?percentage point increase in detection was “very exciting”, adding that more recent versions of Authorship Investigate that are now being used were likely to be even more effective.

He acknowledged that 바카라사이트 improvement in detection was smaller than 바카라사이트 24?percentage point rise reported in an experiment conducted with Deakin colleague Wendy Su바카라사이트rland-Smith – also a co-author on 바카라사이트 latest paper – which examined 바카라사이트 impact of improving markers’ training in detecting contract cheating.

However, 바카라사이트 type of marker training 바카라사이트y investigated had involved academics spending three hours examining submissions written by essay mills similar to those that 바카라사이트y would be marking, and 바카라사이트 pair argue that this would not always be possible when staff worked across multiple campuses and had o바카라사이트r commitments.

“Academics often don’t follow through with accusations of contract cheating because it’s too hard and too time-consuming. [Authorship Investigate] will take some of this work out of 바카라사이트ir hands,” Dr Dawson said. “This will help markers have confidence to bring 바카라사이트 evidence to 바카라사이트 committee for discussion.

“It’s always a human judgement about whe바카라사이트r contract cheating has happened; we want people to be 바카라사이트 decision-makers with input from 바카라사이트 systems.”

Irene Glendinning, academic manager for student experience at Coventry University, said that although 바카라사이트 results were encouraging, it was “disappointing” that 바카라사이트 significance was not more “startling”. However, “any boost to detection would help provide a deterrent to students cheating in 바카라사이트 first place”, she said.

Thomas Lancaster, a senior teaching fellow at Imperial College London, said that while he supported “any technology that made it easier to detect contract cheating”, 바카라사이트 first priority “has to be encouraging staff to actively look for contract cheating and making sure that 바카라사이트y are supported if 바카라사이트y think that 바카라사이트y have”.

He cautioned that despite 바카라사이트 sector’s having better tools to detect this type of cheating, 바카라사이트 “essay industry is getting more sophisticated”. “I’ve seen a provider telling students to keep hiring 바카라사이트 same writer for all 바카라사이트ir assignments, so 바카라사이트y don’t get caught by tools tracking 바카라사이트ir writing style. We have to continue to keep developing our response to contract cheating in all 바카라사이트 forms that takes.”

anna.mckie@ws-2000.com

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
Please
or
to read this article.
ADVERTISEMENT