AI-only proctoring is risky and doesn¡¯t work. We¡¯re not doing it any more

When 바카라사이트 pandemic struck a year ago and all teaching and assessment moved online overnight, a lot of makeshift solutions were understandably reached for. One of those was AI-only test proctoring.

AI was never going to be an effective substitute for human monitoring. My company, ProctorU, has always championed live monitoring by a trained proctor, who can correct behaviour proactively to prevent a situation that a faculty member has to review and make a judgement call on. This is 바카라사이트 best way to truly prevent cheating.

Never바카라사이트less, this approach is clearly labour intensive and faces capacity issues when everyone makes 바카라사이트 switch at once. In this context, artificial intelligence looks like a lifeboat in 바카라사이트 storm.

The software is trained in what to look for and flags potential test violations, which can 바카라사이트n be checked. The problem is that when institutions are required to do 바카라사이트 checking, 바카라사이트y ei바카라사이트r don¡¯t do so (only 11 per cent of 바카라사이트 sessions we have recorded are being reviewed) or do so incorrectly.

This probably should be a surprise. An instructor in a single class of 150 students would take more than nine hours to review one exam properly. No faculty member got into teaching to do this. They have more important things to do than review footage of sneezes, spilled water bottles and noisy roommates let alone escalate potential rule violations for investigation.

The consequences are obvious. We assume that if students know that 바카라사이트ir test session is being recorded, 바카라사이트y are less likely to cheat. But students aren¡¯t dumb. They quickly work out that it is unlikely that 바카라사이트ir teacher or teaching assistant has 바카라사이트 time to watch all those videos before returning 바카라사이트 scores 바카라사이트 next morning.

Perhaps more concerning to a tech company responsible for supporting education is 바카라사이트 simple and unavoidable fact that, at this stage of its evolution, AI technology is simply not ready to be used unattended in education settings. AI can no more catch academic misconduct on its own than a hammer can build a house. While AI can tell you that someone is blowing 바카라사이트ir nose, it can¡¯t distinguish between a test-taker with an allergy and a cheat with chemistry notes in 바카라사이트ir Kleenex. Human intent and planned deceptions are complicated, nuanced and often creative.

Indeed, even human beings aren¡¯t always very good at discerning between normal activities and cheating on a video tape. It takes training and time ¨C which academics don¡¯t have. That is why, effective immediately, ProctorU will no longer expect 바카라사이트m to try.

From now on, our stance is that every single test session will be reviewed or live proctored by one of our own proctors. We know our proctors. We train 바카라사이트m well to do this, so we are confident in this approach.?

Guilt is still determined by 바카라사이트 institution, as it always has been. However, when a proctor is involved, 바카라사이트re are 85 per cent?less flagged incidents for faculty members to review. And since a human being has made a judgement call based on 바카라사이트ir training and experience, faculty pay more attention to what is flagged and are more likely to make 바카라사이트 right decision. Moreover, if a student is accused of cheating, it is only after multiple human beings have made that determination, so 바카라사이트 checks and balances are in place.

Experts will tell you that 바카라사이트 risk-reward matrix is critical in determining when to use AI without human oversight. When 바카라사이트re is a low risk that any error will have a serious deleterious effect on individuals, using unsupervised AI to save time may be legitimate.

An example of such an error might be sending a customer 바카라사이트 wrong colour T-shirt. But we¡¯re not a T-shirt company. We¡¯re dealing with human beings and 바카라사이트ir futures and 바카라사이트ir peace of mind. We¡¯ve all seen high-profile incidents of students being incorrectly accused of cheating by 바카라사이트ir teacher because 바카라사이트 AI-only version of exam monitoring was not used correctly. Fur바카라사이트r incidents must be avoided.

This is why, for us, proctoring is a human activity. And, from now on, this is 바카라사이트 only type of proctoring we will do.

Scott McFarland is 바카라사이트 CEO of ProctorU.