The new image and video editing feature for xAI’s chatbot, Grok, has generated thousands of non-consensual, sexually explicit images of women and minors since Grok announced the editing feature on Christmas Eve. It was promoted as enabling the addition of Santa Claus to photos.
The growing ease of perpetrating sexual violence with novel technologies reflects the urgent need for tech companies and policymakers to prioritize AI safety and regulation.
I am a PhD candidate in public health. My research has largely focused on the intersection of gender-based violence and health, previously working on teams that leverage AI as a tool to support survivors of violence. The potential and actual harms of AI on a such a wide scale require new regulations that will protect the health of mass populations.
