King Charles Warned AI Leaders They Need Control Before It Is Too Late

Britain's monarch just stepped further into a political minefield than royal protocol usually allows. King Charles III hosted a private AI summit on Thursday at his Dumfries House estate in Scotland, gathering Nvidia CEO Jensen Huang, Google DeepMind founder Demis Hassabis, OpenAI CFO Sarah Friar, and Anthropic representatives, alongside the UK's AI minister and the head of Britain's foreign intelligence service.

The King didn't mince words for a figure normally careful to stay above political fault lines. He warned that AI's pace was "both intriguing and deeply concerning," telling the room: "There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways." A few details from the gathering stand out:

• Charles closed with a direct challenge: "Surely, we need sufficient means of control before it is all too late?"
• He attended for just 20 minutes before leaving, saying he hoped it would allow for "productive" discussions without him present
• Paolo Benanti, the Vatican's AI adviser who has called for governments to slow development, and a Chinese delegation were also represented

The timing amplifies the message. The summit landed the same week two Anthropic researchers publicly warned of extinction-level AI risk, and just days after Nvidia's own Jensen Huang told President Trump on a live call that "we're not going to let an AI slowdown happen."

At Dumfries House, though, Huang struck a notably different tone, telling the BBC that AI companies must be "more rigorous in testing and securing" their systems — a reminder that even the industry's most vocal accelerationist sounds more cautious once a king with a direct line to Bletchley Park's legacy is in the room.