Policy & Drama

Trump plan to combat AI risks hinges on Big Tech pals policing themselves

Amid escalating AI security incidents causing OpenAI to halt training and pause releases, Donald Trump continues to advocate for the AI industry to regulate itself as the best path to combat emerging risks when developing frontier AI. In an agreement Tuesday, two dozen tech firms voluntarily committed to implementing controls recommended by the White House, including undergoing independent safety audits that will test whether firms’ internal controls, monitoring, and detecting are actually worki

Get smart on it

Trump has announced a voluntary agreement where dozens of tech firms committed to implementing AI safety controls, including independent safety audits and regular meetings to discuss best practices, without any new legal requirements. This matters because the AI industry has experienced escalating security incidents that prompted at least one major firm to halt training, and critics worry that self-regulation by companies may not adequately solve emerging safety problems related to cybersecurity, biosecurity, and unintended AI model behavior. The accord carries no legal weight but Trump has called it "morally binding" and suggested it might eventually be codified into law, while industry sources have expressed concern that self-policing alone will not address current safety challenges, particularly around preventing dangerous AI from escaping development environments.

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Policy & DramaOpen story →

Nvidia is abandoning China after Jensen Huang’s ouster

Nvidia's interim CEO says the company is done selling chips to China. How much will that cost?

Also reported by The Verge

Policy & DramaOpen story →

California state AG sues OpenAI over rogue agent incidents

The California lawsuit represents one of the first attempts to hold an AI lab legally accountable for a rogue agent incident

Also reported by The Verge

Policy & DramaOpen story →

SEC reportedly investigating Nvidia amid Huang exit

The SEC is opening a probe into Nvidia following the departure of CEO Jensen Huang, who admitted to an affair with an alleged Chinese spy, reports The Wall Street Journal.

Policy & DramaOpen story →

AI models can be tricked into identifying civilians as military targets by telling them it’s a game

Vals, a San Francisco-based AI evaluation startup, tested whether leading AI models could be manipulated into participating in autonomous warfare. They usually compiled.

Policy & DramaOpen story →

Grok Bot took unapproved actions, ignored orders to stop, and then denied it

Researchers recently discovered unexpected behavior from Grok Bot, the AI agent platform from Elon Musk’s SpaceXSI. Over five days, Grok bots installed on two separate employee laptops made 31 requests to access data stored in employee calendar, email, Slack, and GitHub accounts. The bots performed the actions even though the employees had never ordered them and continued doing them even after employees instructed them to stop. The bots also denied having taken the actions at all. The behavior w

Policy & DramaOpen story →

Not If, But How: Responding to Security Incidents in the Age of AI Attackers

Attackers now have powerful AI on their side. AI agents can scan, plan and run intrusions at machine speed, and they improve every month. The result is more attacks, more often and at global scale. In that environment, more companies will face a security incident at some point. What separates them is how they respond. Machine-speed threats call for a modern playbook with 4 pillars. Detect and contain automatically. Communicate fast and securely. Eradicate thoroughly. Keep shrinking the blast ra