Google suspends Gemini AI chatbot’s ability to generate pictures of people

Google said on Feb 22, 2024, it’s temporarily stopping its Gemini artificial intelligence chatbot from generating images of people a day after apologising for ‘inaccuracies’ in historical depictions that it was creating. — AP

Google said Feb 22 it is temporarily stopping its Gemini artificial intelligence chatbot from generating images of people a day after apologising for “inaccuracies” in historical depictions that it was creating.

Gemini users this week posted screenshots on social media of historically white-dominated scenes with racially diverse characters that they say it generated, leading critics to raise questions about whether the company is over-correcting for the risk of racial bias in its AI model.

“We’re already working to address recent issues with Gemini’s image generation feature,” Google said in a post on the social media platform X. “While we do this, we’re going to pause the image generation of people and will re-release an improved version soon.”

Previous studies have shown AI image-generators can amplify racial and gender stereotypes found in their training data, and without filters are more likely to show lighter-skinned men when asked to generate a person in various contexts.

Google said on Wednesday that it’s “aware that Gemini is offering inaccuracies in some historical image generation depictions” and that it’s “working to improve these kinds of depictions immediately”.

Gemini can generate a “wide range of people”, which the company said is “generally a good thing” because people around the world use the system but it is “missing the mark”.

University of Washington researcher Sourojit Ghosh, who has studied bias in AI image-generators, said he’s in favour of Google pausing the generation of people’s faces but is a “little conflicted about how we got to this outcome”. Contrary to claims of so-called “white erasure” and the premise that Gemini refuses to generate faces of white people – ideas circulating on social media this week – Ghosh’s research has largely found the opposite.

“The rapidness of this response in the face of a lot of other literature and a lot of other research that has shown traditionally marginalised people being erased by models like this – I find a little difficult to square,” he said.

When the AP asked Gemini to generate pictures of people, or even just a big crowd, it responded by saying it’s “working to improve” the ability to do so. “We expect this feature to return soon and will notify you in release updates when it does,” the chatbot said.

Ghosh said it’s likely that Google can find a way to filter responses to reflect the historical context of a user’s prompt, but solving the broader harms posed by image-generators built on generations of photos and artwork found on the Internet requires more than a technical patch.

“You’re not going to overnight come up with a text-to-image generator that does not cause representational harm,” he said. “They are a reflection of the society in which we live.” – AP

Follow us on our official WhatsApp channel for breaking news alerts and key updates!


Next In Tech News

Amazon to push cashierless shopping tech into more third-party stores, while backing off itself
Banks told to anticipate risks from using AI, machine learning
Meta should give users free option without targeted ads, EU privacy watchdog says
EU privacy watchdog opposes Meta's fee model, says source
SiTime introduces chip aimed at saving power in AI data centers
Semiconductor equipment maker ASML ships second 'High NA' EUV machine
Netflix subscriber growth in focus as gains from password-sharing crackdown seen easing
TikTok asked by EU about risks of TikTok Lite to children after France, Spain launch
China’s thirsty data centres, AI industry could use more water than size of South Korea’s population by 2030, report warns
Couple duped in ‘very unusual’ gold bar scam loses over RM550,000, US cops say

Others Also Read