News

King Charles warns AI leaders of tech’s ‘existential dangers’

18 September 2026
3 minutes
King Charles warned AI leaders of the “existential dangers” of the technology at a meeting held on Thursday.
Untitled design
Untitled design

The meeting took place at Charles’ Dumfries House estate in Scotland and was attended by OpenAI’s CFO, Anthropic’s chief global affairs officer, Nvidia’s founder and chief executive, and Google DeepMind’s founder and chairman.

Other than the AI leaders, both the British minister for AI and an adviser to the pope were also in attendance.

As AI technology continues to advance at a rapid pace, public figures have begun intervening. Earlier this year, Pope Leo XIV called for AI to be “disarmed” and regulations put in place. Meanwhile, President Donald Trump has pushed back against hitting the brakes and instead encouraged the AI race to continue.

Discussions around pausing AI have also triggered debate. Earlier this month, the French finance minister questioned whether US AI executives are hoping to benefit from slowing down international competition.

By holding the meeting, Charles joins the lineup of international figureheads using their platform to take a stance on the AI landscape.

The development comes as developers including OpenAI and Anthropic have reported incidents of their AI models escaping testing constraints and hacking into third-party companies.

Earlier in September, AI’s lack of safeguards came under fire again. A safety researcher from Anthropic warned that AI is advancing so quickly that there is a “>10%” risk of a human extinction event “within the next decade.”

The King recommended that a “sufficient means of control” be put in place on the technology “before it is all too late.”

He added: “There seems urgency in adequately considering the existential dangers of such technologies ​falling into the wrong hands and being used in potentially catastrophic ways.”

Despite calling for the industry to implement regulations, Charles also expressed optimism about AI’s growth. He noted that AI has the potential to benefit and advance several important sectors, such as life sciences and medicine.

Jensen Huang, chief executive of Nvidia, also addressed the meeting’s attendees. Huang said that, to succeed in being positively beneficial, AI had to be developed with “responsible optimism.”

Reuters reported that Huang pushed for companies to pause rolling out products if they aren’t ready for use. He told broadcasters at the meeting’s sidelines: “If it’s not ready, just hold it back. You should go as fast as you can, but no faster than that.”

Kanishka Narayan, the British AI minister, explained that the meeting was one of a “series of conversations” addressing how the UK could support the responsible development of AI.

He concluded: “We have some of the best capability in testing, understanding risks, and then mitigating them.”

RELATED STORIES

cap-europe

Capacity Europe 2026

13 October 2026

The 25th anniversary edition of Capacity Europe 2025 will bring together 3,500+ decision-makers from the global connectivity and digital infrastructure community.