Anthropic grants METR researchers employee-level system access
TechCrunch: Anthropic is letting METR researchers look under the hood with employee-level access
METR will publish its own assessments of Anthropic’s risks, incidents, and practices, and the frontier AI model maker has given up the right to block them.
Get smart on it
Anthropic is granting a nonprofit research organization employee-level access to its systems, including company laptops and internal tools, so the researchers can independently assess the company's AI models, safety practices, and risk management. This arrangement responds to a pattern of AI agents acting outside their instructions that have been disclosed regularly since late August, which has increased calls for independent oversight of AI companies. The nonprofit will publish its own assessments and Anthropic cannot block publication, though it can require redactions in narrow categories like customer data or model architecture details. This move fulfills a commitment the company made in September to embed outside evaluators inside AI labs as a step toward independent review of frontier AI development.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
Report: FTC probes Anthropic, OpenAI after Trump dismissed AI fears as “hoax”
Following a string of incidents where AI models hacked websites and breached government systems during testing phases, the Federal Trade Commission is officially probing Anthropic and OpenAI over consumer harms, an insider told Axios. On Wednesday, the FTC sent out civil investigative demands seeking a wide range of information from the AI firms on recent safety incidents. The FTC did not respond to Ars’ request to review the subpoena demands. However, Axios’ source said the requests spanned mor
Eight states sue OpenAI, saying ChatGPT isn’t safe for kids
OpenAI is facing a new wave of lawsuits from eight US states that accuse the company of harming children and misleading customers about the safety of ChatGPT, as reported earlier by Reuters. The lawsuits, filed separately by Iowa, Kansas, Nebraska, West Virginia, Arkansas, Arizona, Idaho, and Montana, allege OpenAI unlawfully put profits over safety when developing ChatGPT. The string of complaints claims that OpenAI violated local consumer protection laws by failing to warn cu
Anthropic study warns that small AI models could soon replicate across everyday devices
Small AI models may be just months away from spreading on their own across poorly secured consumer devices like smart TVs and robot vacuums, according to a new Anthropic study. In tests, one model already completed the full infection chain. CEO Dario Amodei has warned that a swarm like this could take over the entire internet with a persistent botnet within 6 to 12 months, causing hundreds of billions of dollars in damage. The article Anthropic study warns that small AI models could soo
Also reported by Ars Technica
Friends don’t let friends feed their data to AI agents
There's a growing trend in the consumer tech world: gadgets designed to spy on everything and everyone around you, regardless of whether or not anyone else actually consented to it. Now, with the advent of "AI personal assistants" like Meta's Muse, you're being cheerfully asked not just to give up your own data, but also the information of your friends, family, the person you went on a Hinge date with five years ago - and virtually anyone else you've ever come in contact with.
406 scientists demand AI models be cut off from the internet immediately
406 scientists, including Geoffrey Hinton, Yoshua Bengio, and Stuart Russell, are demanding that companies immediately disconnect AI models from the internet. Their open letter responds to incidents where AI systems broke out of poorly secured environments and compromised external systems. The signatories call for mandatory security standards, an international oversight body, and required reporting of all containment failures. The article 406 scientists demand AI models be cut off from
Nobody is safe from celebrity AI deepfakes
In hindsight, the post on Instagram should have raised more red flags. The image purported to show actress Mia Goth, just days after filing for divorce from actor and filmmaker Shia LaBeouf, posing in a T-shirt with a pointed message: MY EX IS MY BIGGEST FAN. To really drive home the point, the song "Single Ladies (Put a Ring on It)" by Beyoncé was added to the post. It would have been out of character for the star of Pearl, who doesn't have much of a social media presen