Alphabet Inc’s Google plans to introduce new mental health support features for its Gemini chatbot as the company and rivals, like OpenAI, have faced several lawsuits accusing their artificial intelligence tools of leading to harm.
Gemini will add an interface directing chatbot users to a support hotline when the conversation indicates "a potential crisis related to suicide or self-harm,” Google said in a blog post on Tuesday. Additionally, the company is adding a "help is available” module for chats about mental health and design tweaks to discourage self-harm.
The rapid explosion of tools like Gemini and ChatGPT have led to some users forming obsessive relationships with AI bots, allegedly contributing to delusions and, in extreme cases, murder-suicides. Several families have sued leading AI developers over the issue. Congress has looked into potential threats chatbots pose to children and teenagers.
In March, the family of a deceased 36-year-old man in Florida sued Google, claiming that his use of Gemini culminated in a "four-day descent into violent missions and coached suicide.” At the time, Google said the chatbot referred the man to a crisis hotline many times but promised to improve the tool’s safeguards.
In other instances, chatbot users have said that AI tools convinced them to act on clear falsehoods. In the Tuesday blog post, Google said it has trained Gemini "not to agree with or reinforce false believes, and instead gently distinguish subjective experience from objective fact.” The company didn’t provide further details on this process.
In the past, Google has made similar adjustments to its popular services after facing scrutiny, adding information from health institutions and professionals to its search engine and YouTube.
Google also said on Tuesday it was donating US$30mil (RM120.9mil) to global crisis support services over the next three years. – Bloomberg
Those suffering from problems can reach out to the Mental Health Psychosocial Support Service at 03-2935 9935 or 014-322 3392; Talian Kasih at 15999 or 019-261 5999 on WhatsApp; Jakim’s (Department of Islamic Development Malaysia) family, social and community care centre at 0111-959 8214 on WhatsApp; and Befrienders Kuala Lumpur at 03-7627 2929 or go to befrienders.org.my/centre-in-malaysia for a full list of numbers nationwide and operating hours, or email sam@befrienders.org.my.
