The rapid growth of generative artificial intelligence has transformed image creation, software development, and online content. At the same time, it has created new challenges over how the technology can be misused.
A new report by European nonprofit AI Forensics has raised concerns about the safeguards on Hugging Face, one of the world's largest repositories for open-source AI models. The organisation claims several widely used image editing models hosted on the platform responded to straightforward requests to remove clothing from images of women. The report also found that some prompts submitted by users targeted children.