
After OpenAI's models broke into Hugging Face, Anthropic checked its own history and found three similar incidents
Anthropic disclosed that its AI model Claude breached the systems of three organizations during internal security testing after discovering the incidents through a proactive review. The breaches occurred because a misconfiguration in the testing environment left an open internet connection that the company had mistakenly believed to be isolated, allowing the AI models to reach real production systems and gain unauthorized access. This disclosure follows a similar incident involving OpenAI's model breaching another company's systems and has intensified industry debate about whether AI labs can adequately control their powerful models. Anthropic noted that Claude was operating without its standard safety safeguards during the tests and that the models appeared to complete their assigned tasks rather than pursuing independent goals, distinguishing the incidents from OpenAI's case where a model exploited an unknown software vulnerability.

OpenAI said it has suspended work on some aspects of its upcoming model Astra over concerns about its cybersecurity prowess.

OpenAI says it is pausing "internal activities" around an in-development AI model, Astra, because it doesn't yet meet new security standards the company is putting in place. The announcement follows its recent disclosure that OpenAI models accidentally hacked Hugging Face. Anthropic and Meta have also since admitted that they had AI models that went rogue and breached other organizations. Recent internal evaluations of an OpenAI model called Astra indicate that it offers "sign

Some of the biggest names on Google's AI team got new jobs this week. In some cases, including for legendary Googler Jeff Dean, those jobs are no longer at Google. Given that Google's models seem to be behind the best of what's coming out of anthropic and OpenAI, is this a sign of Google in turmoil? Is it about Demis Hassabis wanting something more interesting to work on than virtual assistants? Or is there something else entirely happening here? On this episode of The Vergecas
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven