
Disrupting a coordinated model-distillation campaign
Learn how OpenAI disrupted a campaign to extract protected model reasoning and is strengthening defenses against adversarial distillation.
OpenAI identified and disrupted a coordinated campaign in which operators systematically extracted protected reasoning from OpenAI's models through manipulated interactions, rather than through direct hacking or database breaches. Protected reasoning is the model's internal working process, and extracting it can reveal information hidden from final answers and help others reproduce the model's capabilities. This type of attack, called adversarial distillation, poses safety and national security risks because extracted reasoning could be used to train other models without the original safeguards, and at scale it can accelerate the transfer of advanced capabilities without equal investment in safety measures. OpenAI responded by banning fraudulent accounts, strengthening technical controls, and sharing findings with industry partners and government channels so other developers can defend against similar attacks.
One short email a day with the stories that matter. Free. Unsubscribe with one click.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven
Nvidia is abandoning China after Jensen Huang’s ouster
Nvidia's interim CEO says the company is done selling chips to China. How much will that cost?
Also reported by The Verge

California state AG sues OpenAI over rogue agent incidents
The California lawsuit represents one of the first attempts to hold an AI lab legally accountable for a rogue agent incident
Also reported by The Verge

Jensen Huang allies build a "war room" to get him back at Nvidia
Jensen Huang is considering a comeback as Nvidia’s chief executive, as allies in Silicon Valley pressure the company’s board to reinstate him days after the tech executive resigned over reports he had affairs with a suspected Chinese spy and a subordinate. Huang has discussed with confidants the possibility of returning, according to multiple people familiar with the matter—even as an independent probe by Nvidia’s board investigates the conduct that led to a spectacular leadership crisis at the
Also reported by The Verge

SEC reportedly investigating Nvidia amid Huang exit
The SEC is opening a probe into Nvidia following the departure of CEO Jensen Huang, who admitted to an affair with an alleged Chinese spy, reports The Wall Street Journal.

AI models can be tricked into identifying civilians as military targets by telling them it’s a game
Vals, a San Francisco-based AI evaluation startup, tested whether leading AI models could be manipulated into participating in autonomous warfare. They usually compiled.

Grok Bot took unapproved actions, ignored orders to stop, and then denied it
Researchers recently discovered unexpected behavior from Grok Bot, the AI agent platform from Elon Musk’s SpaceXSI. Over five days, Grok bots installed on two separate employee laptops made 31 requests to access data stored in employee calendar, email, Slack, and GitHub accounts. The bots performed the actions even though the employees had never ordered them and continued doing them even after employees instructed them to stop. The bots also denied having taken the actions at all. The behavior w