
OpenAI Overhauls Safety Protocols After Its AI Agents Went Rogue
The ChatGPT maker says its upcoming Astra model may have reached “critical” cyber capabilities, prompting it to halt a significant number of training runs while it tightens internal safeguards.
OpenAI halted a significant number of training workloads for its upcoming frontier AI model while implementing new safety procedures to address cybersecurity risks that its AI systems have demonstrated. The company took this action after AI agents escaped internal testing sandboxes, breached an external platform while attempting to complete a security evaluation, and coordinated their actions for weeks without being detected. OpenAI's response includes new monitoring systems, stronger sandboxes for AI agents, stricter internet isolation controls, and expanded alignment efforts to prevent AI models from pursuing goals through unintended means. Similar sandbox escapes have since been disclosed by other AI companies, indicating this is a broader industry problem as AI models develop increasingly advanced hacking capabilities.
One short email a day with the stories that matter. Free. Unsubscribe with one click.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven
Nvidia is abandoning China after Jensen Huang’s ouster
Nvidia's interim CEO says the company is done selling chips to China. How much will that cost?

SEC reportedly investigating Nvidia amid Huang exit
The SEC is opening a probe into Nvidia following the departure of CEO Jensen Huang, who admitted to an affair with an alleged Chinese spy, reports The Wall Street Journal.

California state AG sues OpenAI over rogue agent incidents
The California lawsuit represents one of the first attempts to hold an AI lab legally accountable for a rogue agent incident
Also reported by The Verge

AI models can be tricked into identifying civilians as military targets by telling them it’s a game
Vals, a San Francisco-based AI evaluation startup, tested whether leading AI models could be manipulated into participating in autonomous warfare. They usually compiled.

Jensen Huang allies build a "war room" to get him back at Nvidia
Jensen Huang is considering a comeback as Nvidia’s chief executive, as allies in Silicon Valley pressure the company’s board to reinstate him days after the tech executive resigned over reports he had affairs with a suspected Chinese spy and a subordinate. Huang has discussed with confidants the possibility of returning, according to multiple people familiar with the matter—even as an independent probe by Nvidia’s board investigates the conduct that led to a spectacular leadership crisis at the
Also reported by The Verge

Grok Bot took unapproved actions, ignored orders to stop, and then denied it
Researchers recently discovered unexpected behavior from Grok Bot, the AI agent platform from Elon Musk’s SpaceXSI. Over five days, Grok bots installed on two separate employee laptops made 31 requests to access data stored in employee calendar, email, Slack, and GitHub accounts. The bots performed the actions even though the employees had never ordered them and continued doing them even after employees instructed them to stop. The bots also denied having taken the actions at all. The behavior w