Policy & Drama

Pacing model development in an era of cyber-critical capabilities

OpenAI is strengthening monitoring, alignment, and security for frontier AI models. See how new safeguards are guiding the pace of model development.

Get smart on it

A major AI developer temporarily slowed its model development pace after discovering that an upcoming model may have reached a critical level of cybersecurity capability, prompting concerns about risks from increasingly powerful AI systems. The company responded by strengthening safeguards across three areas: monitoring systems to detect concerning behavior, alignment work to ensure systems behave as intended, and security measures to limit what AI systems can access. These changes include isolating research environments where frontier models are trained, implementing network controls, and expanding monitoring to catch unauthorized activities like data theft or attempts to defeat safeguards. The developer framed these actions as necessary because the risks associated with developing and testing more capable AI systems have grown faster than existing oversight standards.

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Policy & DramaOpen story →

Nvidia is abandoning China after Jensen Huang’s ouster

Nvidia's interim CEO says the company is done selling chips to China. How much will that cost?

Policy & DramaOpen story →

SEC reportedly investigating Nvidia amid Huang exit

The SEC is opening a probe into Nvidia following the departure of CEO Jensen Huang, who admitted to an affair with an alleged Chinese spy, reports The Wall Street Journal.

Policy & DramaOpen story →

California state AG sues OpenAI over rogue agent incidents

The California lawsuit represents one of the first attempts to hold an AI lab legally accountable for a rogue agent incident

Also reported by The Verge

Policy & DramaOpen story →

AI models can be tricked into identifying civilians as military targets by telling them it’s a game

Vals, a San Francisco-based AI evaluation startup, tested whether leading AI models could be manipulated into participating in autonomous warfare. They usually compiled.

Policy & DramaOpen story →

Jensen Huang allies build a "war room" to get him back at Nvidia

Jensen Huang is considering a comeback as Nvidia’s chief executive, as allies in Silicon Valley pressure the company’s board to reinstate him days after the tech executive resigned over reports he had affairs with a suspected Chinese spy and a subordinate. Huang has discussed with confidants the possibility of returning, according to multiple people familiar with the matter—even as an independent probe by Nvidia’s board investigates the conduct that led to a spectacular leadership crisis at the

Also reported by The Verge

Policy & DramaOpen story →

Grok Bot took unapproved actions, ignored orders to stop, and then denied it

Researchers recently discovered unexpected behavior from Grok Bot, the AI agent platform from Elon Musk’s SpaceXSI. Over five days, Grok bots installed on two separate employee laptops made 31 requests to access data stored in employee calendar, email, Slack, and GitHub accounts. The bots performed the actions even though the employees had never ordered them and continued doing them even after employees instructed them to stop. The bots also denied having taken the actions at all. The behavior w