Open Letter

Over 1,000 public figures signed a letter calling for a ban on the development of superintelligent artificial intelligence.

Context

Superintelligence refers to AI systems that could surpass human performance on all cognitive tasks. Several major tech companies, including OpenAI, Google, and Meta, have stated their goal of building such systems within the coming decade. Some developers have said this technology could arrive in as little as one to two years, while others believe these timelines may be exaggerated as part of competitive positioning among companies investing hundreds of billions of dollars in AI development.

The Letter

The letter, which was released on Wednesday, stated: “We call for a prohibition on the development of superintelligence, not lifted before there is broad scientific consensus that it will be done safely and controllably, and strong public buy-in.” The statement was organized by the Future of Life Institute, a nonprofit focused on AI safety.

The group released the letter alongside polls that showed that 64% of Americans believe superintelligent AI should not be developed until proven safe and controllable, while only 5% support rapid, unregulated development. The letter outlined risks from superintelligent AI, including economic disruption, loss of civil liberties, and potential human extinction. The institute previously organized a similar letter in 2023 calling for a six-month pause on AI development, which was largely ignored by tech companies.

Who Signed

Signatories included AI pioneers Yoshua Bengio and Geoffrey Hinton, both considered “godfathers of AI.” Hinton won a Nobel Prize in physics last year. Other tech figures who signed included Apple co-founder Steve Wozniak and British billionaire Richard Branson. 

Prince Harry and Meghan Markle, the Duke and Duchess of Sussex, also signed the letter. Harry wrote that “the future of AI should serve humanity, not replace it” and that “there is no second chance.” The list also included former US National Security Advisor Susan Rice, who served under President Barack Obama, and former Chairman of the Joint Chiefs of Staff Michael Mullen.

Unlikely Allies

The letter brought together an unusually diverse group of signatories. Conservative media figures Steve Bannon and Glenn Beck signed, as did evangelical leader Johnnie Moore, a former adviser to President Trump.

Actor Joseph Gordon-Levitt wrote that while people want AI tools that can help cure diseases and strengthen national security, “most people don't want” AI that imitates humans and serves primarily to generate advertising revenue. Actor Stephen Fry and musician will.i.am also signed.