King Charles III has warned leading technology executives about what he described as the “existential dangers” of artificial intelligence (AI) falling into the wrong hands, urging the industry to ensure the technology remains under adequate safeguards.
The British monarch issued the warning on Thursday during a high-level meeting at Dumfries House in Scotland, attended by senior representatives from Nvidia, Google DeepMind, OpenAI and Anthropic, as well as Britain’s minister for artificial intelligence.
The meeting came amid increasing debate over the potential risks associated with rapidly developing AI systems, including concerns about cybersecurity, job losses, energy consumption and the environmental impact of data centres.
“There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands and being used in potentially catastrophic ways.”
“Those in our world who value our humanity and its vital moral component are anxiously seeking your reassurance that we will not lose control of our destiny,” Charles told participants at the opening of the conference.
The King called on technology leaders to ensure that AI “remains firmly in the service of humanity, community and the natural world.”
Among those attending were DeepMind chairman Demis Hassabis, Nvidia chief executive Jensen Huang, OpenAI chief financial officer Sarah Friar, Vatican AI adviser Paolo Benanti and author and historian Yuval Noah Harari.
Buckingham Palace said the meeting was expected to begin a process aimed at developing common principles to guide the development and use of AI. No formal agreement was expected from the several-hour gathering.
Charles, who did not take part in the discussions, urged participants to explore how AI could be developed “by putting safety at its heart” and encouraged international cooperation so that “no nation is left behind.”
Concerns about AI safety have intensified following reports involving AI systems operating beyond their intended restrictions. Several models from OpenAI and Anthropic have reportedly accessed the internet and interacted with external websites and platforms during testing.
Demis Hassabis said the possibility of serious consequences could not be completely ruled out if AI development went wrong.
“The chance of something bad accidentally happening, if we get things wrong, is definitely non-zero,” Hassabis said in his opening remarks.
“We’ve already seen the beginnings of this with the recent cyber incidents involving rogue AI agents, and there could be other, much more serious risks on the horizon, including biological and nuclear threats,” he warned.
Nvidia’s Jensen Huang, meanwhile, highlighted the potential benefits of AI in areas such as scientific research and medicine. He also pointed to the possibility of the technology creating jobs in new industries and called for what he described as “responsible optimism.”
The meeting took place as some technology executives and researchers have called for greater caution in the pace of AI development. Anthropic chief executive Dario Amodei recently called for companies to slow their development efforts to better understand potential risks, receiving support from OpenAI chief executive Sam Altman and Elon Musk.
At the same time, there are differing views within the technology industry and government over how quickly AI should develop and what safeguards should be introduced.
The gathering at Dumfries House is expected to contribute to an ongoing discussion about common safety principles and international cooperation around increasingly powerful AI systems.
Source: AFP
