Get all your news in one place.
100’s of premium titles.
One app.
Start reading
TechRadar
TechRadar
Graham Barlow

'No company can stop nude AI images – but we’re the only ones being honest about it' — British AI rival to ChatGPT bans under-18s and refuses image generation over safety concerns

Elon Musk, xAI and Grok.
  • Locai Labs CEO says all current AI models can create harmful images
  • Locai Labs is banning under 18s and image generation until the situation is "truly safe"
  • The UK regulator Ofcom is now launching an investigation into Grok Images

As the controversy around Elon Musk’s Grok AI platform and its ability to create sexualized images of women and children continues, James Drayson, CEO of Locai Labs – the British rival to ChatGPT – has declared that no AI image generator can ever be truly safe, and has urged the industry to be honest about the dangers.

Speaking ahead of an appearance before MPs examining human rights and the regulation of AI, Drayson urged action and challenged the government to back British innovation.

He said, “[The] industry needs to wake up. It’s impossible for any AI company to promise their model can’t be tricked into creating harmful content, including explicit images. These systems are clever, but they’re not foolproof. The public deserves honesty.”

In response to the current situation, Locai has refused to roll out image generation until it’s “truly safe”. It has also banned under-18s from accessing its AI chatbot, and is calling for radical transparency across the industry.

It should be noted that the platform had not previously implemented image generation features.

Grok bans are already starting

Grok’s image-editing feature, called Grok Images, allows users to upload photos and then use well-known tricks to prompt the AI to remove clothes or put people in bikinis, including non-consensual edits of everyday individuals, public figures, and children.

The situation has already led to Grok being banned in Indonesia and Malaysia, with a further ban now being considered by UK regulator Ofcom.

Ofcom has today launched an investigation into Elon Musk’s X. In a statement, the UK watchdog said there had been “deeply concerning reports” of the chatbot being used to create and share undressed images of people, as well as “sexualized images of children.”

The UK’s Technology Secretary, Liz Kendall, has previously said she would back regulator Ofcom if it blocks UK access to X – previously known as Twitter and now the home of Grok – for failing to comply with online safety laws.

Elon Musk responded to the threat from the UK government on X by saying, “They want any excuse for censorship.”

In response to the controversy, the Grok Images feature has been restricted to paying subscribers only, a move that has not satisfied the UK government. A spokesperson for Downing Street said, “The move simply turns an AI feature that allows the creation of unlawful images into a premium service.”

Tough regulation could be coming

The UK Parliament’s Human Rights Committee is currently probing the risks and benefits of AI, how it might impact privacy and discrimination, and whether current UK laws and policies are sufficient or if new legislation is needed to hold AI companies and developers accountable.

James Drayson added: “We believe the UK can lead the world in responsible, values-driven AI if we choose to. That means tough regulation, open debate, and a commitment to transparency. AI is here to stay. The challenge is to make it as safe, fair, and trustworthy as possible, so that its rewards far outweigh its risks.”

Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds. Make sure to click the Follow button!

And of course you can also follow TechRadar on TikTok for news, reviews, unboxings in video form, and get regular updates from us on WhatsApp too.

Sign up to read this article
Read news from 100’s of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.