AI labs should pass safety review to get US government contracts, group says


FILE PHOTO: A message reading "AI artificial intelligence", a keyboard, and robot hands are seen in this illustration taken January 27, 2025. REUTERS/Dado Ruvic/Illustration/File Photo

May 11 (Reuters) - ⁠The Trump administration should screen cutting-edge artificial intelligence ⁠models for security threats before they are publicly ‌released and withhold lucrative government contracts from those that fail review, an advocacy group told U.S. officials on Monday.

The White House is ​grappling with the implications of Anthropic's ⁠Mythos, which could make ⁠complex cyberattacks easier and quicker to execute, posing national security ⁠risks.

Americans ‌for Responsible Innovation urged the Trump administration to develop methods to vet upcoming frontier models from ⁠larger developers for cyberattack and weapons development ​capabilities.

Companies should have ‌to pass the review to be eligible for ⁠government contracts, ​the group said in a letter to administration officials.

The U.S. Center for AI Standards and Innovation already reviews some AI ⁠models through voluntary agreements with OpenAI, ​Anthropic, and, more recently, Google, Microsoft and xAI.

CAISI should take the lead on developing mandatory requirements, and Congress should create ⁠a permanent enforcement office within the U.S. Department of Commerce to enforce the requirements, the group said.

The proposed requirements would apply to companies that spend $100 million or ​more a year on compute to ⁠train frontier models, or that make at least $500 million in ​revenue annually from AI products ‌and services.

California has a similar threshold ​for safety reporting requirements enacted last year.

(Reporting by Jody Godoy in New YorkEditing by Rod Nickel)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

EU Commission in talks with OpenAI and Anthropic over AI models
Circle sees revenue boost as stablecoin demand rises amid volatility; shares up
Disneyland rolls out facial recognition at US park's entrances
US prepares AI security order that omits mandatory model tests
Google settles racial discrimination lawsuit for US$50mil
Who are you getting your health advice from?
All those AI notetakers? They’re making lawyers very nervous.
Finding Nintendo adventures after 'Super Mario Galaxy Movie' ends
Can ChatGPT be charged in a murder? Florida wants to find out
Microsoft boss to testify on his role in OpenAI's founding

Others Also Read