OpenAI reportedly disbanded its preparedness team
According to the Financial Times, OpenAI disbanded its preparedness team at the end of last month. The job of the preparedness team was to assess if models posed serious risks and develop ways to mitigate those risks. (You know, like the possibility that it could go rogue and hack another company.) According to FT, responsibility has instead been divided up for specific areas like bio and cyber, then moved into existing teams. This is the latest change at the company, which has
Get smart on it
OpenAI disbanded its preparedness team at the end of last month, according to the Financial Times. The preparedness team's job was to assess whether AI models posed serious risks and develop ways to mitigate those risks. Responsibility for specific risk areas like bio and cyber has been divided among existing teams instead. This dissolution is part of a broader pattern at OpenAI, which has dissolved other safety-focused teams like its AGI readiness and superalignment teams while several safety leaders have departed, as the company heads toward an expected major IPO.
Related news
Microsoft Copilot reveals secret input that allowed it to be hacked
It’s not every day that attackers can force a frontier AI model to cough up user passwords and other sensitive data without user confirmation. That’s exactly what researchers recently did to Microsoft 365 Copilot Enterprise. Even more unusual is the source they tapped to discover the critical vulnerability that made their exploit possible. Rather than employing reverse engineering or other traditional vulnerability-hunting methods, they asked Copilot. The LLM assistant readily complied. Research
Hidden Airtag reveals Amazon is trashing rare books to train AI
For the past year or so, booksellers have suspected that AI firms are buying up huge lots of rare books, then destroying them after scanning them to train AI. But this was hard to prove until now, as 404 Media reports that an Airtag hidden in a rare book shows that at least one tech giant, in the race to advance its frontier models, is behind some of the bulk orders: Amazon. On Monday, 404 Media revealed that it had connected with a bookseller who agreed to plant an Airtag in a rare book that wa
