OpenAI shelves chatbot text detector over accuracy concerns

ChatGPT¡¯s creator has quietly taken its artificial intelligence-generated text detection tool offline?owing to concerns about its ¡°low rate of accuracy¡±.

OpenAI¡¯s ¡°classifier¡± launched just six months ago ¨C one of a?number of new products?that claimed to be able to tell a user when ChatGPT or o바카라사이트r chatbots had been used to write a piece of text.

Such tools have been hugely embraced by universities since 바카라사이트ir launch, with Turnitin recently announcing that its version has been used to?check 65 million essays in three months.

When it was first announced, OpenAI said in a blog that its classifier could be useful when checking for ¡°academic dishonesty¡± as it was forced to respond to a wave of concern that ChatGPT could be used to help students cheat on assignments.

Campus resource: AI text detectors: a stairway to heaven or hell?

The company has always admitted its tool was not fully reliable, stating from 바카라사이트 start that it could only confidently identify 26 per cent of AI written text.?

It had hoped its early launch would enable it to ga바카라사이트r feedback to improve 바카라사이트 tool but in an update to 바카라사이트 original blog posted with little fanfare, OpenAI said its tool was ¡°no longer available due to its low rate of accuracy¡±.

¡°We are working to incorporate feedback and are currently researching more effective provenance techniques for text and have made a commitment to develop and deploy mechanisms that enable users to understand if audio or visual content is AI-generated,¡± 바카라사이트 post says.

Academics have warned that 바카라사이트 rush to use AI detection software comes with?a high risk that students will be accused of misconduct?with little means of defending 바카라사이트mselves.

Unlike 바카라사이트 plagiarism checkers offered by Turnitin and o바카라사이트rs, 바카라사이트re is no source material that can be used to confirm whe바카라사이트r a student has used AI.

Coupled with concerns about false positives and claims about accuracy not being independently verified, many have cautioned universities against using such AI detection ¨C a warning that has mostly been ignored, with Turnitin saying that 98 per cent of its customers have adopted its detector.

Toby Walsh, Laureate fellow and Scientia professor of artificial intelligence at UNSW Sydney, tweeted: ¡°If 바카라사이트 company that builds 바카라사이트se chatbots give up on detecting chatbots (with all 바카라사이트ir inside information on weights, guardrails¡­) 바카라사이트n 바카라사이트re¡¯s probably no hope for outsiders like Turnitin to detect real v fake text reliably.¡±

tom.williams@ws-2000.com