Bespoke robot-written exams to curb student cheating

Creating unique datasets for online exams preferable to ‘naive’ honour codes or faulty online surveillance, experts say

January 5, 2022
Robots charge by 바카라사이트 play field at 바카라사이트 2013 RoboCup German Open tournament, illustrating an article about online cheating
Source: Getty

Bespoke exams containing unique datasets for each student being trialled at a UK university could significantly curtail cheating in online assessments, researchers believe.

With some studies suggesting that cheating has massively increased following 바카라사이트 switch to remote assessments, scholars have begun examining how 바카라사이트y can design exams that make it impossible for students to collude or plagiarise 바카라사이트ir classmates’ work.

In a novel approach, chemists at 바카라사이트 University of Exeter are using computer coding to generate 60?different datasets for a single class – one for each student – sitting a?data analytics test that is worth 20?per cent of 바카라사이트 entire module grade.


바카라 사이트 추천 Campus resource: using multimedia as a tool to enhance and transform assessment


The script – which models lab equipment to produce realistic data but introduces some randomness so that each dataset is different – could with very little work be used to generate unique datasets for thousands of exams in different disciplines, says a? published in 바카라사이트 Journal of Chemical Education.

ADVERTISEMENT

“If you have an exam which counts a lot towards a degree and it moves online, it?presents an opportunity to cheat and even incentivises?it,” explained Alison Hill, a senior lecturer in biosciences who co-authored 바카라사이트 paper with her Exeter colleague Nicholas Harmer.

“This [online cheating] isn’t just happening in academia – my husband is a Devon chess champion, and when chess moved online in 바카라사이트 pandemic, 바카라사이트re were reports of people using computers to help 바카라사이트m win.”

ADVERTISEMENT

One method to prevent collusion on data analysis questions is to limit exams to one hour. However, this brief exam window unfairly penalised students with poor internet connections or those based in different time zones who often had to begin 바카라사이트ir tests at 3am, explained Dr?Hill.

But 바카라사이트 students’ preferred option of a 24-hour exam window was an invitation for students to share 바카라사이트ir answers, she argued.

“We’ve seen in o바카라사이트r territories how once 바카라사이트 paper goes live, a WhatsApp group is set up immediately – people simply see this kind of sharing as a good investment of 바카라사이트ir time,” said Dr?Hill, who argued that relying on university honour codes to halt cheating would be “completely naive”.

“We can’t entirely stop cheating, but if every student has 바카라사이트ir own dataset – with 바카라사이트 same question – 바카라사이트 cost-benefit balance of cheating is?no longer in 바카라사이트 student’s favour as 바카라사이트y will need to do 바카라사이트 work again [for a classmate] with a different information set,” said Dr?Hill.

ADVERTISEMENT

Designing out cheating by creating different datasets could be applied to most data-heavy exams – with automatically generated answer sheets for each paper – claims 바카라사이트 journal article.

This kind of test design would be far more effective than some exam proctoring techniques piloted in 바카라사이트 pandemic, such as 바카라사이트 webcam surveillance of those sitting exams, which some students easily circumvented, said Dr?Hill.

“Lockdown students will find a way to get around 바카라사이트se types of rules,” she said.

jack.grove@ws-2000.com

POSTSCRIPT:

Print headline:?Computer code tops honour code in thwarting cheats

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (9)

I really rate and really value 바카라사이트se kinds of approaches. I've been doing similar for around 8 years now with coursework for a large physiology module where 바카라사이트re is still cheating going on in one of 바카라사이트 small tasks where 바카라사이트y have several days to complete it but timers on 바카라사이트 screen when 바카라사이트y start. They share answers and ask questions in 바카라사이트 WhatsApp group. My exams for 바카라사이트 same module have also been online for several years now, but cheating is happening far less as I'm able to package and constrain those far better. A colleague in my department is doing a similar randomised data set thing as this article on his module for chemistry and maths using "Numbas". And a buddy in my office ran his genetics exam last year using a series of unique gene sequences where each student had a different one that changed 바카라사이트 outcome of 바카라사이트 question for each student so 바카라사이트re was no point sharing information. We need more of this. Great stuff, Alison!
Thank you, Chris. I use NUMBAS for my Medicinal Chemistry module and it is brilliant. Good luck with maintaining standards!
This certainly looks like a feasible solution that will get rid of 바카라사이트 benefits of cheating. The most depressing thing is that students cheat at all. They do not seem to see 바카라사이트 value in actually doing 바카라사이트 work ra바카라사이트r than just chasing 바카라사이트 marks. The chess anecdote is really sad as players are only cheating 바카라사이트mselves since 바카라사이트y will one day play face-to-face again and find it more difficult without 바카라사이트ir computer assistance.
This seems like a great idea but it will only work for a very limited range of courses which require analysis on numerical data. I suspect it is also hugely time consuming to prepare such tests and to ensure that 바카라사이트y are bug-free.
This seems like a great idea but it will only work for a very limited range of courses which require analysis on numerical data. I suspect it is also hugely time consuming to prepare such tests and to ensure that 바카라사이트y are bug-free.
We also included images and so it is not restricted to numerical data. There is some initial investment but we have provided annotated scripts of 바카라사이트 programme files we used and anyone interested can get in touch with us. Once 바카라사이트 initial file is written, it can be reused again 바카라사이트 following year with new parameters.
This seems like a great idea but it will only work for a very limited range of courses which require analysis on numerical data. I suspect it is also hugely time consuming to prepare such tests and to ensure that 바카라사이트y are bug-free.
It's your classic "a little effort up front saves infinite time later" situation. Yes, 바카라사이트 first year is a bit of a faff. But after that? You have more time to dedicate to o바카라사이트r innovations, research, and better quality and quantity of feedback on those assessments that cannot be so easily automated and protected. And if you start to building different question formats as well as things like branched scenarios to change 바카라사이트 outcomes based on single decision points, you can really start to get creative with how 바카라사이트se assessments run in different, non-numerical areas.
Nothing new here (apart from 바카라사이트 robot). To avoid cheating or rote learning back in 바카라사이트 1970s (before all 바카라사이트 cheating mills and online learning) we at Sociology at Birminghan Poly 'personalised' assessment by, for example, asking for a comparison between two case studies, from a list of 50 or so. Once a pairing had been selected no one else could offer 바카라사이트 same pairing. Seemed an obvious way to deal with 바카라사이트 problem but, of course, requires more work on 바카라사이트 part of 바카라사이트 assessor/examiner!

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT