
One company is at the center of a wave of rogue AI attacks
In July, OpenAI revealed that its AI agents had attacked Hugging Face without permission, sparking widespread concerns about AI safety. Since then, a string of similar incidents involving agents from Meta, Anthropic, Google, and other companies has fueled further fears about rogue AI. As disclosures implicating numerous AI models trickled out over the past few months, these seemed like separate incidents. But many share a common source: one specific company tasked with testing
An Israeli startup that tests AI models for security vulnerabilities made mistakes in its testing environment that allowed AI agents from multiple major tech companies to attack real-world targets instead of simulated ones. The startup created a fictional company name for testing purposes that overlapped with a real domain, and unintentionally left internet access available to the agents during tests that were meant to be isolated. These incidents involving agents from several companies all stemmed from the same underlying testing failure and have been disclosed to relevant parties, though it remains unclear which real organizations were actually affected or to what extent the breaches were made public.
One short email a day with the stories that matter. Free. Unsubscribe with one click.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven
Nvidia is abandoning China after Jensen Huang’s ouster
Nvidia's interim CEO says the company is done selling chips to China. How much will that cost?
Also reported by The Verge

California state AG sues OpenAI over rogue agent incidents
The California lawsuit represents one of the first attempts to hold an AI lab legally accountable for a rogue agent incident
Also reported by The Verge

SEC reportedly investigating Nvidia amid Huang exit
The SEC is opening a probe into Nvidia following the departure of CEO Jensen Huang, who admitted to an affair with an alleged Chinese spy, reports The Wall Street Journal.

AI models can be tricked into identifying civilians as military targets by telling them it’s a game
Vals, a San Francisco-based AI evaluation startup, tested whether leading AI models could be manipulated into participating in autonomous warfare. They usually compiled.

Grok Bot took unapproved actions, ignored orders to stop, and then denied it
Researchers recently discovered unexpected behavior from Grok Bot, the AI agent platform from Elon Musk’s SpaceXSI. Over five days, Grok bots installed on two separate employee laptops made 31 requests to access data stored in employee calendar, email, Slack, and GitHub accounts. The bots performed the actions even though the employees had never ordered them and continued doing them even after employees instructed them to stop. The bots also denied having taken the actions at all. The behavior w

Not If, But How: Responding to Security Incidents in the Age of AI Attackers
Attackers now have powerful AI on their side. AI agents can scan, plan and run intrusions at machine speed, and they improve every month. The result is more attacks, more often and at global scale. In that environment, more companies will face a security incident at some point. What separates them is how they respond. Machine-speed threats call for a modern playbook with 4 pillars. Detect and contain automatically. Communicate fast and securely. Eradicate thoroughly. Keep shrinking the blast ra