The King has warned of the “existential dangers” of artificial intelligence (AI) systems falling into the wrong hands, as he addressed tech leaders at a summit on the future of the technology.
Charles told an audience including bosses from Nvidia, Anthropic, Google DeepMind and OpenAI decisions taken today on the technology will “shape the world inherited by future generations”, and he called on them to ensure as they develop the technology, “our humanity remains sacred”.
The event at Dumfries House in Cumnock, East Ayrshire, was also attended by guests including the chief advisor to the Vatican on the ethics of AI and technology, the UK’s first AI minister, Kanishka Narayan, government advisors and others.
Giving his opening address, Charles told the audience the development of AI is “both intriguing and deeply concerning in equal measure.”
“AI is already showing its immense capacity to improve and save life – for example, in the field of life sciences and medicine,” he said.
“Yet, those who have created these technologies are now increasingly warning that AI risks developing darker capacities – perhaps even to take life.
“In this regard, if I may say so, there seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways.
“Surely, we need sufficient means of control before it is all too late?”
He added: “The decisions taken at this formative time will shape the world inherited by future generations.
“And so, the task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world.
“As we embrace what is new, we must not lose what is timeless.”
After the King’s address, Nvidia chief executive Jensen Huang and Google DeepMind chairman Demis Hassabis gave speeches highlighting the benefits AI can bring to humanity.
Speaking to journalists ahead of his speech, Mr Huang, who has been one of the industry figures resisting recent calls for tighter regulation of the sector, said it was the “responsibility” of AI companies to properly test the technology before releasing it.
“There were incidents, and those incidents thankfully did no harm,” he said.
“But those incidents are a reminder that as we move from labs to product development, the companies have to become much more rigorous in testing and securing and making sure that the products are ready for use before (they are) released.
“And in doing so, if it’s not ready, just hold it back. You should go as fast as you can, but no faster than that.”
He added: “We know that this technology is advancing very quickly, so we have to do it safely and securely.
“But don’t lose sight of the ultimate prize, which is the incredible impact that the technology can bring to all the different economies and societies.”
Doomsday warnings have been levelled at AI, seen by some as a threat to the existence of humanity, sparking a debate among industry leaders over how best to rein in the technology before it could escape human control.
Mr Narayan said the British Government has been focused on preparing for the dangers AI technology could pose “for a long period of time”.
Speaking to ITN after the summit, he said: “We have to take it seriously, and that’s exactly what we’re doing.”
Mr Narayan said he understands that people are worried and concerned as AI bosses and experts have become increasingly worried about AI regulation and potential harms.
“The thing I think I’m really proud of in Britain is that we’re able to carry two contrasting thoughts together and find a way through,” he said.
“AI is a huge source of concern for us, both in terms of jobs and in terms of cybersecurity challenges and what it might do in the wrong hands, and equally it is the biggest driver of jobs and opportunity.
“It was the big driver of UK growth and if we get it right a source of dignity for people in this country. The task for us, both in Government and across our country is to carry both that sense of the upside and the risk together.”
