Meta's Oversight Board is set to evaluate the company's response to deepfake pornography, a concerning trend fueled by artificial intelligence that is increasingly being used as a form of harassment. The board announced on Tuesday that it will review Meta's handling of two explicit, AI-generated images of female public figures from the United States and India to determine if the company has appropriate policies in place to address such content consistently worldwide.
The rise of AI-generated pornography has raised alarms in recent months, with high-profile individuals like Taylor Swift and women globally falling victim to this form of online abuse. The accessibility of generative AI tools has made it easier and faster to create fake explicit imagery, which can then be rapidly disseminated through social media platforms.
Helle Thorning-Schmidt, Co-Chair of Meta's Oversight Board, highlighted the gender-based harassment caused by deepfake pornography, emphasizing its use to target and intimidate women both online and offline. The board, comprised of experts in freedom of expression and human rights, acts as a quasi-Supreme Court for Meta, allowing users to appeal content decisions on the company's platforms.
One case under review involves an AI-generated nude image resembling an Indian public figure shared on Instagram, which was initially reported for being pornographic but was not reviewed within 48 hours. After the Oversight Board intervened, Meta acknowledged the error and removed the image for violating bullying and harassment rules.
The second case pertains to an AI-generated image of a nude woman being groped, resembling an American public figure, posted in a Facebook group for AI creations. The image was removed for violating bullying and harassment rules after being escalated to policy experts.
As part of the ongoing review, the Oversight Board is soliciting public comments on deepfake pornography, its impact on women, and Meta's response to posts featuring AI-generated explicit imagery. The public comment period will close on April 30, allowing individuals to share their perspectives anonymously.
