Chatbots cannot stop making up fake facts, OpenAI researchers admit


AI chatbots are above all trained to guess – and not to give up even when they aren't certain about what they are do. Researchers say that's why it's unlikely that they will ever stop inventing "false statements". — Photo: Christin Klose/dpa

One of the problems with using artificial intelligence (AI) chatbots is the seemingly insouciant manner in which they "hallucinate" – industry jargon for them making stuff up instead of conceding they aren't sure about what they are writing.

Get used to it, researchers now say, as it appears that the way in which the bots work means that at least two kinds of fibs they tend to churn out cannot be eradicated.

"Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty," a team of OpenAI and Georgia Tech researchers in the US warn in a paper published in September.

The bots hallucinate "because the training and evaluation procedures reward guessing over acknowledging uncertainty," the team said.

According to analysts speaking to the science journal Nature, not only does it seem "impossible" that hallucinations can be stopped, it could be particularly difficult to engineer AI bots in a way that stops them from making up citations seemingly out of thin air.

The researchers believe eliminating "deceptions" – when a bot claims to have carried out an assigned task but has not – could be another hurdle.

According to Purdue University’s Tianyang Xu, the number of hallucinations is down to a level that could be deemed "acceptable to users."

"Hallucinations are a result of the fundamental way in which LLMs work," Nature said, explaining that the bots are "statistical machines" that make their predictions by "generalising on the basis of learnt associations" – a system that causes the machines "to produce answers that are plausible, but sometimes wrong." – 

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

Italian court rules Netflix price-hike clauses are void, orders refunds
Trump administration proposes expanding Chinese tech gear crackdown
Moscow shoppers and travellers hit by payment system problem
Streaming channel for pets launched in China
Samsung Elec likely to report stupendous surge in quarterly profit to record level
AI-generated 'Fruit Love Island' takes TikTok by storm
Kremlin's drive for a state-backed messaging app touches a nerve for some
Chromebook remorse: Tech backlash at schools extends beyond phones
A US$280mil crypto hack exposes a human weak link in DeFi
Doctors couldn’t help them. They rolled the dice with AI.

Others Also Read