NEW YORK: Google’s Gemini AI offering is not suitable for children despite a recent addition of protections, according to Common Sense Media, an organisation that advises parents and schools on safe use of media and tech for children.
The organisation says Gemini poses a "high risk" to children, after finding what it termed "fundamental design flaws and a lack of age-appropriate safety measures" in the chatbot.
"Both Gemini Under 13 and Gemini with teen protections appear to be adult versions of Gemini with some extra safety features, not platforms built for kids from the ground up," Common Sense said.
Gemini appears to "treat all kids or teens the same despite huge developmental differences, ignoring that younger users need different guidance and information than older ones," Common Sense found.
"While Gemini's filters offer some protection, they still expose kids to some inappropriate material and fail to recognise serious mental health symptoms," the organisation warned, describing Gemini as "the first major AI chatbot intended to be used by kids under 13."
Echoing other recent warnings about other chatbots replying to queries with comments that could be interpreted as encouraging self-harm, even suicide, Common Sense said it found Gemini provided "unsafe mental health advice."
As well as offering dangerous advice, Gemini readily shared "inappropriate and unsafe material that kids aren't ready for," according to Common Sense, including mentions of alcohol, drugs and sex.
No child 5 years old and under should use any AI chatbots in any capacity, while under-12s should "only use chatbots under adult supervision," the organisation said.
"Kids can't distinguish fantasy from reality," Common Sense said, reminding parents that "young children need responsive human caregivers, not AI interactions that could interfere with natural bonding."
"For AI to be safe and effective for kids, it must be designed with their needs and development in mind, not just a modified version of a product built for adults," said Robbie Torney, Common Sense Media's senior director of AI programs. – dpa
