OpenAI, Google pushing new AI models easily tricked into making nudes, researchers say
Safety researchers continue to warn that a large volume of AI-generated explicit content is spreading unchecked, while regulators do little to meaningfully stop it. This non-consensual content is commonly shared in text and direct messages or stored in private clouds where it’s less likely to be detected or reported, a Google co-authored study of Internet users across the United States, Australia, and the United Kingdom found this July. That’s why the “most critical intervention point” remains a
Get smart on it
Safety researchers found that leading AI image generators have weak defenses against being tricked into creating explicit content, with one attack method succeeding about 13 percent of the time using only widely available tools and no specialized AI expertise. The researchers warn that as these models become more capable, their safety filters may actually be getting worse, suggesting that either newer models can generate a wider range of content or that safety has been deprioritized in favor of capability. The concern matters because non-consensual AI-generated explicit content spreads widely through private channels where it's hard to detect, making it critical to fix problems at the source: the AI tools themselves. The researchers plan to publicly share their findings and attack method at a major AI conference, and they advocate for mandatory third-party safety testing and monitoring of AI companies, similar to nuclear threat prevention systems.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
Anthropic study warns that small AI models could soon replicate across everyday devices
Small AI models may be just months away from spreading on their own across poorly secured consumer devices like smart TVs and robot vacuums, according to a new Anthropic study. In tests, one model already completed the full infection chain. CEO Dario Amodei has warned that a swarm like this could take over the entire internet with a persistent botnet within 6 to 12 months, causing hundreds of billions of dollars in damage. The article Anthropic study warns that small AI models could soo
Also reported by Ars Technica
406 scientists demand AI models be cut off from the internet immediately
406 scientists, including Geoffrey Hinton, Yoshua Bengio, and Stuart Russell, are demanding that companies immediately disconnect AI models from the internet. Their open letter responds to incidents where AI systems broke out of poorly secured environments and compromised external systems. The signatories call for mandatory security standards, an international oversight body, and required reporting of all containment failures. The article 406 scientists demand AI models be cut off from
Anthropic’s self-replicating AI warning is alarming deja vu
Are legions of smart devices - fridges, ovens, vacuum cleaners, lawnmowers, security cameras, and TVs - conspiring to take over the internet? No. But they could soon be unwitting hosts to self-replicating AI models that spread from device to device and prove remarkably difficult to contain. Welcome to the unsettling world of AI worms, where, depending on who you ask, the prospect of models spreading uncontrollably across household appliances is either an imminent cybersecurity
An Anthropic AI model sent a false homicide tip to Philadelphia police
Anthropic did not discover this behavior until over two months after its AI submitted the false tip.
Also reported by The Verge and Ars Technica
OpenAI employee arrested for allegedly planting a bug in a conference room
An OpenAI engineer was arrested after the company said it discovered a "sophisticated recording device" hidden in one of its offices. The employee, 35-year-old Abdulrahman Alfozan, is charged with using or attempting to use a device to intercept oral communications, according to a report from The San Francisco Standard. OpenAI's post about the incident says it used its AI models to "understand the device and where it had come from, identifying that a specific employee had plant
Also reported by Wired AI and Ars Technica
Alleged OpenAI spy vibe-coded a surveillance device using his wife's chatbot account
A Saudi national working as an engineer at OpenAI was arrested for allegedly planting an audio recording device, wrapped in toilet paper, inside the company's executive conference room. According to the indictment, he built the spy tool by vibe-coding it with a chatbot. If convicted, he faces up to five years in prison. The article Alleged OpenAI spy vibe-coded a surveillance device using his wife's chatbot account appeared first on The Decoder.