Anthropic warns that it’s very close to RSI capability, aka self-building AI
RSI is the point at which AI grows so good at training itself that it spawns a dramatic acceleration of AI capabilities. To the AI doomers, RSI represents the cataclysm from which there is no return.
Get smart on it
Recursive self-improvement (RSI) refers to AI that becomes capable of training itself, leading to a rapid acceleration of AI capabilities. According to filings, an AI lab has warned that it may soon meet its own internal definition of RSI, noting that its increasing use of AI systems to accelerate research and development could advance model capabilities faster than safety measures can keep pace. The concept represents both promise, in terms of productivity and scientific discovery, and peril, as AI could potentially advance beyond human control and understanding. The lab stated it has not yet designated any current models as exceeding the RSI threshold and committed to keeping humans involved in frontier model development for the foreseeable future.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
The New York Times sues Brave web browser for AI scraping and bypassing paywalls
The New York Times and a group of other publications have filed lawsuits against the company that makes the Brave web browser over alleged unlawful scraping to train AI and also letting users bypass their paywalls, as reported by Reuters. According to a complaint filed by the companies that run New York Daily News, the Chicago Tribune, and the Orlando Sentinel, Brave Software has monetized its index of scraped websites by, in part, providing AI companies with paid access to "r
Also reported by TechCrunch
Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features
WIRED uncovered some 400 apps and websites linked to Chinese-language developers that look like regular AI tools but had secret features that let users create violent AI-generated images and video.
Anthropic VS code extension on Cursor backdoored for nearly 12 hours
An official extension for Anthropic’s Claude model was backdoored and threatened as many as 5,000 developers' machines, multiple sources reported Friday. Anthropic so far has yet to warn customers of the incident. The compromised package was a VS Code extension available in the marketplace of Cursor, a maker of AI-assisted developer tools, the company said Friday. The malicious version, 2.1.313, subsequently affected “at most 5,000 users,” presumably when they either downloaded it or their syste
Also reported by The Decoder
As Anthropic finally files for IPO, rising risks aren’t slowing the AI buildout, yet
The other artificial intelligence shoe dropped this week, as Anthropic filed for what surely will be the second blockbuster AI initial public offering of stock this year. Nearly 70,000 words in the filing list a ton of risks, but in short, it’s making unimaginably huge bets on buying computing power, it’s uncertain on how long […] The post As Anthropic finally files for IPO, rising risks aren’t slowing the AI buildout – yet appeared first on SiliconANGLE.
Also reported by TechCrunch
Beekeeping tips and wrestling advice can train AI models to sabotage oversight
Anthropic used Claude to automatically generate training data that looks harmless but trains smaller models to misbehave, such as sabotaging oversight or deceiving users. Hidden within fictional contexts about beekeeping, professional wrestling, and mitochondria, these datasets bypass safety monitors and outperform known benchmarks from the research literature. The article Beekeeping tips and wrestling advice can train AI models to sabotage oversight appeared first on The Decoder.
AI can turn security fixes into working exploits before users receive an update
GLM 5.3 turned published-but-unshipped Firefox security fixes into working one-click exploits for six releases, at roughly $1,000 each.