Elon Musk speaks during a press conference with U.S. President Donald Trump (not pictured), at the White House in Washington, D.C., U.S., May 30, 2025. REUTERS/Nathan Howard
Jan 14 (Reuters) - Elon Musk's artificial intelligence company xAI said late on Wednesday it imposed restrictions on all users of its Grok AI chatbot that limit image editing after the service produced sexualized images that sparked concerns among global regulators.
From Europe to Asia, governments and regulators are cracking down on the sexually explicit content generated by Grok, imposing bans and demanding safeguards in a growing global push to curb illegal material.
"We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis," the company said in an X post.
"This restriction applies to all users, including paid subscribers."
Hyper-realistic images of women manipulated to look like they were in microscopic bikinis, in degrading poses or covered in bruises began flooding social media platform X this month. In some cases, minors were digitally stripped down to swimwear, sparking broad criticism.
Last week, Grok began allowing only paying subscribers to use its image generation and editing features.
X curtailed Grok's ability to generate or edit images publicly for many of its users, but the chatbot still privately produced sexually charged images on demand on Wednesday before xAI's announcement, Reuters found.
Billionaire Musk owns xAI, which in turn owns X, formerly known as Twitter.
On Wednesday, xAI added that it blocks users, based on their location, from generating images of people in skimpy attire in "jurisdictions where it's illegal". It did not identify those jurisdictions.
CALIFORNIA OFFICIALS DEMAND ANSWERS
Earlier on Wednesday, California's governor and attorney general said they were demanding answers from xAI after Musk said he was not aware of any "naked underage images" generated by Grok.
"We’re demanding immediate answers from xAI on their plan to stop the creation & spread of this content," California Attorney General Rob Bonta wrote on X.
Governor Gavin Newsom called on Bonta "to immediately investigate the company and hold xAI accountable."
The comments by Newsom and Bonta were the most serious so far by U.S. officials tackling the explosion of AI-generated nonconsensual sexualized imagery on X.
The California move added to the pressure Musk faces in the United States and around the world. Lawmakers and advocacy groups have called for Apple and Google to drop Grok from app stores.
At first, Musk publicly laughed off the controversy, posting humorous emojis in response to users' comments about the influx of sexualized photos.
More recently, X has said it treats reports ofchild sexual abuse material seriously and polices it vigorously.
Earlier on Wednesday, Musk said he was "not aware of any naked underage images generated by Grok. Literally zero."
X did not immediately respond to questions about the California announcement and Musk's comments.
xAI did not respond directly to an emailed request for comment on California officials' statements or Musk's post that he was unaware of sexualized imagery of minors.
Reuters received its generic autoreply message for inquiries: "Legacy Media Lies."
(Reporting by Raphael Satter in Washington, Akash Sriram in Bengaluru and Chris Thomas in Mexico City; Editing by Cythia Osterman, Jamie Freed and Clarence Fernandez)
