Get all your news in one place.
100's of premium titles.
One app.
Start reading
International Business Times UK
International Business Times UK
Clark Garret Alvarez

King Charles Warns AI Bosses of 'Existential Dangers' as He Demands Control 'Before It Is All Too Late'

King Charles has urged leading AI companies to establish stronger safeguards against the technology’s potentially catastrophic risks (Credit: Dan Marsh/Wikimedia Commons/CC BY-SA 2.0)

King Charles III has warned some of the world's leading artificial intelligence executives about the 'existential dangers' of the technology, asking whether humanity can establish sufficient controls 'before it is all too late'.

The King delivered the warning at an AI summit at Dumfries House in East Ayrshire, Scotland, on Thursday, 17 September, where representatives from Nvidia, Google DeepMind, OpenAI and Anthropic gathered to discuss the future development of AI.

King Warns of AI's 'Darker Capacities'

Charles acknowledged the enormous potential of artificial intelligence, particularly its ability to improve and save lives through advances in medicine and life sciences.

But he warned that the same technology could develop far more dangerous capabilities.

The King said those creating advanced AI systems were increasingly warning that the technology risked developing 'darker capacities', potentially including the ability to take life.

He said there was an urgent need to consider the 'existential dangers' of powerful technologies falling into the wrong hands and being used in potentially catastrophic ways.

'Surely, we need sufficient means of control before it is all too late?' Charles asked.

He also said people who deeply valued humanity and its moral component wanted reassurance from AI leaders that society would not lose control of its 'destiny, or our souls'.

Nvidia, OpenAI and DeepMind Attend

The gathering brought together some of the most influential companies developing advanced artificial intelligence.

Participants included representatives from Nvidia, Google DeepMind, OpenAI and Anthropic, alongside government ministers and civil society figures.

UK Minister for Artificial Intelligence Kanishka Narayan also attended the summit.

Charles asked delegates to consider two central questions: how the benefits of AI could be harnessed while placing safety at its heart, and how international cooperation could ensure that no country was left behind while 'the human race is left in place'.

He acknowledged that the language might sound hyperbolic but described his approach as 'enlightened realism'.

The discussions, facilitated by the Ditchley Foundation, also examined whether shared principles could guide the future development and application of AI.

'Humanity Must Remain Sacred'

Charles told executives that decisions being taken during the current period of rapid AI development would shape the world inherited by future generations.

He said their responsibility was not simply to advance technological capabilities, but to ensure AI remained 'firmly in the service of humanity, community and the natural world'.

'Our humanity must remain sacred,' he said.

The intervention builds on Charles's involvement in the UK's first AI Safety Summit at Bletchley Park in 2023, when he described artificial intelligence as one of the greatest technological leaps in human history while calling for international cooperation over its risks.

Since then, Britain has expanded work on AI safety and alignment, including research intended to ensure increasingly autonomous systems remain predictable and controllable.

The Scotland summit puts that challenge directly before executives developing some of the world's most powerful models.

Charles's message was that innovation should continue, but not without safeguards capable of keeping humans in control as the technology becomes more powerful and increasingly embedded in everyday life around the world.

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.