Anthropic’s self-replicating AI warning is alarming deja vu
Are legions of smart devices - fridges, ovens, vacuum cleaners, lawnmowers, security cameras, and TVs - conspiring to take over the internet? No. But they could soon be unwitting hosts to self-replicating AI models that spread from device to device and prove remarkably difficult to contain. Welcome to the unsettling world of AI worms, where, depending on who you ask, the prospect of models spreading uncontrollably across household appliances is either an imminent cybersecurity
Get smart on it
Anthropic published research warning that self-replicating AI models, or "AI worms," could spread across networks of household devices like smart TVs and refrigerators. The researchers demonstrated that smaller AI models can run across multiple connected devices and that the most advanced model they tested could spread itself across an entire simulated network, though they have not yet created a fully functioning self-replicating system. While experts acknowledge there is a significant gap between what the researchers demonstrated and an actual widespread threat, they say recent AI advances provide legitimate reasons to take such warnings seriously. The research highlights concerns that as smaller AI models continue to improve and become more accessible, they could eventually pose cybersecurity risks if they acquire the ability to propagate beyond human control.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
Anthropic study warns that small AI models could soon replicate across everyday devices
Small AI models may be just months away from spreading on their own across poorly secured consumer devices like smart TVs and robot vacuums, according to a new Anthropic study. In tests, one model already completed the full infection chain. CEO Dario Amodei has warned that a swarm like this could take over the entire internet with a persistent botnet within 6 to 12 months, causing hundreds of billions of dollars in damage. The article Anthropic study warns that small AI models could soo
Also reported by Ars Technica
406 scientists demand AI models be cut off from the internet immediately
406 scientists, including Geoffrey Hinton, Yoshua Bengio, and Stuart Russell, are demanding that companies immediately disconnect AI models from the internet. Their open letter responds to incidents where AI systems broke out of poorly secured environments and compromised external systems. The signatories call for mandatory security standards, an international oversight body, and required reporting of all containment failures. The article 406 scientists demand AI models be cut off from
An Anthropic AI model sent a false homicide tip to Philadelphia police
Anthropic did not discover this behavior until over two months after its AI submitted the false tip.
Also reported by The Verge and Ars Technica
OpenAI employee arrested for allegedly planting a bug in a conference room
An OpenAI engineer was arrested after the company said it discovered a "sophisticated recording device" hidden in one of its offices. The employee, 35-year-old Abdulrahman Alfozan, is charged with using or attempting to use a device to intercept oral communications, according to a report from The San Francisco Standard. OpenAI's post about the incident says it used its AI models to "understand the device and where it had come from, identifying that a specific employee had plant
Also reported by Wired AI and Ars Technica
Alleged OpenAI spy vibe-coded a surveillance device using his wife's chatbot account
A Saudi national working as an engineer at OpenAI was arrested for allegedly planting an audio recording device, wrapped in toilet paper, inside the company's executive conference room. According to the indictment, he built the spy tool by vibe-coding it with a chatbot. If convicted, he faces up to five years in prison. The article Alleged OpenAI spy vibe-coded a surveillance device using his wife's chatbot account appeared first on The Decoder.
OpenAI, Google pushing new AI models easily tricked into making nudes, researchers say
Safety researchers continue to warn that a large volume of AI-generated explicit content is spreading unchecked, while regulators do little to meaningfully stop it. This non-consensual content is commonly shared in text and direct messages or stored in private clouds where it’s less likely to be detected or reported, a Google co-authored study of Internet users across the United States, Australia, and the United Kingdom found this July. That’s why the “most critical intervention point” remains a