OpenAI sets up safety committee as it starts training new model


OpenAI logo is seen in this illustration taken May 20, 2024. REUTERS/Dado Ruvic/Illustration

(Reuters) - OpenAI has formed a Safety and Security Committee that will be led by board members, including CEO Sam Altman, as it begins training its next artificial intelligence model, the AI startup said on Tuesday.

Directors Bret Taylor, Adam D'Angelo and Nicole Seligman will also lead the committee, OpenAI said on a company blog.

Microsoft-backed OpenAI's chatbots with generative AI capabilities, such as engaging in human-like conversations and creating images based on text prompts, have stirred safety concerns as AI models become powerful.

The new committee will be responsible for making recommendations to the board on safety and security decisions for OpenAI's projects and operations.

"A new safety committee signifies OpenAI completing a move to becoming a commercial entity, from a more undefined non-profit-like entity," said D.A. Davidson managing director Gil Luria.

"That should help streamline product development while maintaining accountability."

Former Chief Scientist Ilya Sutskever and Jan Leike, who were leaders of OpenAI's Superalignment team, which ensured AI stays aligned to the intended objectives, left the firm earlier this month.

OpenAI had disbanded the Superalignment team, earlier in May, less than a year after the company created it, with some team members being reassigned to other groups, CNBC reported days after the high-profile departures.

The committee's first task will be to evaluate and further develop OpenAI’s existing safety practices over the next 90 days, following which it will share recommendations with the board.

After the board's review, OpenAI will publicly share an update on adopted recommendations, the company said.

Others on the committee include newly appointed Chief Scientist Jakub Pachocki and Matt Knight, head of security.

The company will also consult other experts, including Rob Joyce, a former U.S. National Security Agency cybersecurity director and John Carlin, a former Department of Justice official.

OpenAI did not provide further details on the new "frontier" model it is training, except that it would bring its systems to the "next level of capabilities on our path to AGI."

Earlier in May, it announced a new AI model capable of realistic voice conversation and interaction across text and image.

(Reporting by Arsheeya Bajwa and Akash Sriram in Bengaluru; Editing by Muhammad Tasim Zahid and Vijay Kishore)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

US to loosen rules on Tesla, other carmakers taking on China in race for self-driving cars
US seeks India trade deal on e-commerce, crops and data storage, Bloomberg News reports
Grieving parents march to Meta NY headquarters, demanding change
Samsung to invest $117 million in southern Indian facility, minister says
Japan's Advantest expects 6% annual profit growth as AI boosts testing
Apple aims to build most iPhones for US in India by end of 2026
Alphabet Frankfurt-listed shares rise after revenue estimates beat
Thinking of buying a secondhand phone? Some tips on what to look for
Saying ‘thank you’ to ChatGPT is costly, but maybe it’s worth the price
Games maker Ubisoft accused of illegal data collection

Others Also Read