Germany plans measures to combat harmful AI image manipulation


FILE PHOTO: Elon Musk attends the U.S.-Saudi Investment Forum in Washington, D.C., U.S., November 19, 2025. REUTERS/Evelyn Hockstein/File Photo

BERLIN, Jan 9 (Reuters) - Germany's justice ‌ministry plans to present measures in the near future that would ‌allow authorities to more effectively combat the use of artificial intelligence to ‌manipulate images in ways that violate personal rights, a spokesperson said on Friday.

Grok, the built-in AI chatbot on billionaire Elon Musk's social media site X, has come under investigation in Europe for ‍its so-called "spicy mode", which allows users to generate sexually ‍explicit images.

A Reuters investigation found ‌the chatbot's image generation was being used to create images of women and children ‍in ​minimal clothing, often without the consent of the individuals depicted.

Germany's media minister urged the European Commission earlier this week to take legal action ⁠to stop what he called the "industrialisation of sexual harassment" ‌on X.

Responding to a question about the controversy at a regularly held government press conference, justice ⁠ministry spokesperson Anna-Lena ‍Beckfeld indicated that Germany was preparing to take on the issue in its domestic courts.

"It is unacceptable that manipulation on a large scale is being used for systematic violations ‍of personal rights," she said. "We, therefore, want to ‌ensure that criminal law can be used more effectively to combat this."

The ministry is working to better regulate deepfakes and plans a law against digital violence to support its victims, she told journalists.

"We want to make it easier for them to take direct action against violations of their rights on the internet," Beckfeld said.

The ministry plans to present concrete proposals in the near future, she said, adding that ‌she could not comment in detail on the plans at this point.

After initially dismissing concerns over Grok's image generation, xAI has now restricted the function to paid subscribers. Musk said last ​week that anyone using the chatbot to create illegal content would face the same consequences as uploading such material directly.

(Reporting by Andreas Rinke and Miranda Murray; Editing by Joe Bavier)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

US woman's story of US$1mil loss held up as warning of romance scams
FCC approves SpaceX plan to deploy an additional 7,500 Starlink satellites
Metaverse is out, while AI does the laundry: CES 2026's biggest tech
OpenAI, SoftBank invest $1 billion in SB Energy as Stargate buildout expands
Musk's X sues music publishers over alleged licensing conspiracy
Democratic US senators demand Apple, Google take X and Grok off app stores over sexual images
DeepSeek to launch new AI model focused on coding in February, The Information reports
Factbox-Elon Musk's Grok faces global scrutiny for sexualised AI photos
Stablecoin firm Rain valued at $1.95 billion in latest fundraise
Musk's AI bot Grok limits some image generation on X after backlash

Others Also Read