OpenAI sets up safety committee as it starts training new model


OpenAI logo is seen in this illustration taken May 20, 2024. REUTERS/Dado Ruvic/Illustration

(Reuters) - OpenAI has formed a Safety and Security Committee that will be led by board members, including CEO Sam Altman, as it begins training its next artificial intelligence model, the AI startup said on Tuesday.

Directors Bret Taylor, Adam D'Angelo and Nicole Seligman will also lead the committee, OpenAI said on a company blog.

Microsoft-backed OpenAI's chatbots with generative AI capabilities, such as engaging in human-like conversations and creating images based on text prompts, have stirred safety concerns as AI models become powerful.

The new committee will be responsible for making recommendations to the board on safety and security decisions for OpenAI's projects and operations.

"A new safety committee signifies OpenAI completing a move to becoming a commercial entity, from a more undefined non-profit-like entity," said D.A. Davidson managing director Gil Luria.

"That should help streamline product development while maintaining accountability."

Former Chief Scientist Ilya Sutskever and Jan Leike, who were leaders of OpenAI's Superalignment team, which ensured AI stays aligned to the intended objectives, left the firm earlier this month.

OpenAI had disbanded the Superalignment team, earlier in May, less than a year after the company created it, with some team members being reassigned to other groups, CNBC reported days after the high-profile departures.

The committee's first task will be to evaluate and further develop OpenAI’s existing safety practices over the next 90 days, following which it will share recommendations with the board.

After the board's review, OpenAI will publicly share an update on adopted recommendations, the company said.

Others on the committee include newly appointed Chief Scientist Jakub Pachocki and Matt Knight, head of security.

The company will also consult other experts, including Rob Joyce, a former U.S. National Security Agency cybersecurity director and John Carlin, a former Department of Justice official.

OpenAI did not provide further details on the new "frontier" model it is training, except that it would bring its systems to the "next level of capabilities on our path to AGI."

Earlier in May, it announced a new AI model capable of realistic voice conversation and interaction across text and image.

(Reporting by Arsheeya Bajwa and Akash Sriram in Bengaluru; Editing by Muhammad Tasim Zahid and Vijay Kishore)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

   

Next In Tech News

This humanoid robot can drive a car
‘Pebbling’ is a love language for the digital age
How quantum physics could help lasers perform better in fog and aid communications
This technology could recharge drones wirelessly over long distances
Ferrari says new plant will boost flexibility, shorten car development times
Kremlin says US decision to ban Kaspersky software designed to stifle competition
Exclusive-Amazon mulls $5 to $10 monthly price tag for unprofitable Alexa service, AI revamp
Santander culls WhatsApp from Spanish investment bank phones
A US toddler was trapped in a Tesla after its battery died without warning amid record heat waves – ‘safety comes last’ at Tesla, expert says
Hong Kong police arrest 114 over scamming 163 people out of HK$73mil

Others Also Read