AI chatbots are supposed to improve health care. But research says some are perpetuating racism


A new study, co-led by Omiye, cautions that popular chatbots are perpetuating racist, debunked medical ideas, prompting concerns that the tools could worsen health disparities for Black patients. — AP

SAN FRANCISCO: As hospitals and health care systems turn to artificial intelligence to help summarise doctors’ notes and analyse health records, a new study led by Stanford School of Medicine researchers cautions that popular chatbots are perpetuating racist, debunked medical ideas, prompting concerns that the tools could worsen health disparities for Black patients.

Powered by AI models trained on troves of text pulled from the Internet, chatbots such as ChatGPT and Google’s Bard responded to the researchers’ questions with a range of misconceptions and falsehoods about Black patients, sometimes including fabricated, race-based equations, according to the study published Friday (Oct 20) in the academic journal Digital Medicine and obtained exclusively by The Associated Press.

The Star Christmas Special Promo: Save 35% OFF Yearly. T&C applies.

Monthly Plan

RM 13.90/month

Best Value

Annual Plan

RM 12.33/month

RM 8.02/month

Billed as RM 96.20 for the 1st year, RM 148 thereafter.

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

Exclusive-Tesla board made $3 billion via stock awards that dwarfed tech peers
Electricity is now holding back growth across the global economy
North Korean leader's sister sports Chinese foldable phone
STMicro has shipped 5 billion chips for Starlink in past decade; that could double by 2027
Tech support scammers stole US$85,000 from him. His bank declined to refund him.
Analysis-Old meets new economy: AI boom to supercharge European banks' rally
Humanoid robots take center stage at Silicon Valley summit, but scepticism remains
Asahi CEO mulls new cybersecurity unit as disruption drags on
China's smaller manufacturers look to catch the automation wave
From Zelda to Civ VI: understanding game complexity

Others Also Read