
Chinese police said they recently detained a ChatGPT user for allegedly using the AI-powered chatbot to create a fake news story about a nonexistent train crash. It's one of the first enforcement actions under a recently enacted Chinese law regulating AI-generated “deepfakes” — seemingly realistic but fabricated digital images, video or other media.
According to a police report from the northwest Chinese province of Gansu, a man identified only by his surname, Hong, used ChatGPT to create a fake news article about a crash that supposedly led to the deaths of nine construction workers in Gansu. Twenty-one accounts on a popular social platform, all owned by a media company based in southern China, spread the fake story within a short period of time.