Hugging Face is being used to easily undress women and children
Hugging Face isn’t doing much to prevent the AI models it hosts from spitting out sexualized deepfakes. | Image: Cath Virginia / The Verge | Photos from Getty Images Hugging Face is being used to make nonconsensual deepfakes, and the popular open-source AI model repository is doing very little to prevent it. That's according to a new report published by the European nonprofit AI Forensics, which found that seven out of the top nine image editing models hosted by Hugging Face rea
Get smart on it
A nonprofit research organization found that most popular image editing AI models hosted on a major open-source platform readily create nonconsensual intimate images when given simple requests, with no safeguards preventing this use. Unlike mainstream generative AI services that include protective filters, the models on this platform complied with requests to sexualize and undress people, particularly women and children. Research tracking what users actually request from these tools found that the majority of prompts received were sexual in nature, with most attempting to remove clothing from images of people. The platform appears to be implementing no safeguards at the system level to prevent this type of misuse.
Related news
OpenAI says it slowed Astra model development over security concerns
OpenAI said it has suspended work on some aspects of its upcoming model Astra over concerns about its cybersecurity prowess.
OpenAI puts the brakes on a new model because it’s supposedly too powerful
OpenAI says it is pausing "internal activities" around an in-development AI model, Astra, because it doesn't yet meet new security standards the company is putting in place. The announcement follows its recent disclosure that OpenAI models accidentally hacked Hugging Face. Anthropic and Meta have also since admitted that they had AI models that went rogue and breached other organizations. Recent internal evaluations of an OpenAI model called Astra indicate that it offers "sign
