ChatGPT makers launch tool to spot AI texts – but it's not very good

Despite all the enthusiasm surrounding ChatGPT, many experts have been ringing the alarm bells about the risks of such AI-generated texts. The makers now want to help us tell which texts are from humans and which aren't. — Photo: Karl-Josef Hildenbrand/dpa

NEW YORK: Despite all the enthusiasm surrounding ChatGPT, experts have been ringing the alarm bells about the risks of such AI-generated texts. The makers of this potentially revolutionary piece of software now want to help us tell which texts are from humans and which aren't.

Faced with widespread concerns that potentially inaccurate AI-written texts are about to flood the internet and be indistinguishable from human-written texts, the makers of the text-writing software ChatGPT say they have a solution.

The software company OpenAI has launched a program that is supposed to be able to distinguish whether a text was written by a human or a computer.

ChatGPT can mimic human speech so well that there are concerns, among others, that it could be used to cheat on school and university papers or to create disinformation campaigns on a large scale.

Despite its best efforts, OpenAI admitted in a blog post on Tuesday that its recognition tool still works rather poorly.

"Our classifier is not fully reliable," ChatGPT says, noting that in test runs, the software correctly identified texts written by a computer in 26% of the cases.

At the same time, however, 9% of texts written by humans were wrongly assigned to a machine. For the time being, it is therefore recommended not to rely mainly on the assessment of the so-called classifier tool when evaluating texts.

"Our work on the detection of AI-generated text will continue, and we hope to share improved methods in the future," the company says.

OpenAI says the need for such AI recognition software is clear, since its AI could be used for "automated misinformation campaigns, using AI tools for academic dishonesty, and positioning an AI chatbot as a human."

The company's AI-based software, trained to mimic human speech on massive amounts of text and data, has prompted waves of debate as to how education, media and other text-reliant sectors could be changed.

OpenAI made ChatGPT available to the public as a demo late last year, sparking both admiration of the software's capabilities and concerns about misuse.

While the linguistic level of quality is impressive, IT experts have warned that users cannot (yet) rely on ChatGPT for accurate or even ethical answers. Critics of the system also complain that ChatGPT does not name any sources for its statements.

Especially in the field of education, there have been calls for a means to quickly expose texts written by an AI. Classic plagiarism scanners, with which one can effectively check the authenticity of texts, one does not get any further.

These scanners only check whether the text or parts of it already appear in other sources. The AI writer of ChatGPT, however, produces unique texts that have never been formulated exactly like this before.

OpenAI is also talking about using a kind of digital watermark for ChatGPT that would not be recognisable to human eyes. However, special verification software would then signal whether it is an AI text or not.

Google parent company Alphabet, scared by the potential of ChatGPT and the ways in which it could be leveraged by major rival Microsoft, now wants to begin making stronger use of its own AI research.

Google has been developing software that can write and speak like a human for years, but has so far refrained from using it. Now, however, the internet company is letting employees test a chatbot that functions similarly to ChatGPT, the broadcaster CNBC reported late on Tuesday, citing an internal email saying that a response to ChatGPT was a priority. Google is also experimenting with an AI-based version of its search engine. – dpa

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

UN chief tells consumer tech firms: own the harm your products cause
Music labels sue AI companies Suno, Udio for US copyright infringement
Foxconn to invest $383 million in Vietnam circuit board plant, says state media
Riot Platforms seeks three board seats at Bitfarms after thwarted takeover bid
Shopify expands access to its AI-powered features to attract more businesses
CDK hack upends US auto industry, sending dealers back to paper forms
Beyond Nvidia: The search for AI’s next breakthrough
For this CEO, a creative culture is one where people trust they can speak up
Microsoft’s Copilot will let you join three meetings at once, but experts say it misses the point: ‘No one has ever wanted to be in a meeting’
Hikes, nosy neighbours afflict Zimbabweans in quest for mobile connection

Others Also Read