Anthropic calls for pause of global AI development

1 hour ago 8

San Francisco-based company says slowdown in cutting-edge AI development would 'likely be a good thing'

Author of the article:

AFP

Published Jun 04, 2026  •  3 minute read

Artificial intelligence company Anthropic suggests a global pause on building the most powerful AI systems as the latest models are beginning to show signs they could escape human control.Artificial intelligence company Anthropic suggests a global pause on building the most powerful AI systems as the latest models are beginning to show signs they could escape human control. Photo by SEBASTIEN BOZON /AFP/File

NEW YORK — Artificial intelligence company Anthropic suggested Thursday a global pause on building the most powerful AI systems as the latest models are beginning to show signs they could escape human control.

Advertisement 2

Toronto Sun

THIS CONTENT IS RESERVED FOR SUBSCRIBERS ONLY

Subscribe now to read the latest news in your city and across Canada.

  • Unlimited online access to articles from across Canada with one account.
  • Get exclusive access to the Toronto Sun ePaper, an electronic replica of the print edition that you can share, download and comment on.
  • Enjoy insights and behind-the-scenes analysis from our award-winning journalists.
  • Support local journalists and the next generation of journalists.
  • Daily puzzles including the New York Times Crossword.

SUBSCRIBE TO UNLOCK MORE ARTICLES

Subscribe now to read the latest news in your city and across Canada.

  • Unlimited online access to articles from across Canada with one account.
  • Get exclusive access to the Toronto Sun ePaper, an electronic replica of the print edition that you can share, download and comment on.
  • Enjoy insights and behind-the-scenes analysis from our award-winning journalists.
  • Support local journalists and the next generation of journalists.
  • Daily puzzles including the New York Times Crossword.

REGISTER / SIGN IN TO UNLOCK MORE ARTICLES

Create an account or sign in to continue with your reading experience.

  • Access articles from across Canada with one account.
  • Share your thoughts and join the conversation in the comments.
  • Enjoy additional articles per month.
  • Get email updates from your favourite authors.

THIS ARTICLE IS FREE TO READ REGISTER TO UNLOCK.

Create an account or sign in to continue with your reading experience.

  • Access articles from across Canada with one account
  • Share your thoughts and join the conversation in the comments
  • Enjoy additional articles per month
  • Get email updates from your favourite authors

Article content

The San Francisco-based company, which makes the Claude family of AI models, said in a report that a worldwide slowdown in cutting-edge AI development would “likely be a good thing” — but warned that if only one company stopped, rivals would simply race ahead.

Article content

Article content

“We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology,” it said.

Getting a real pause to work would mean multiple major AI companies in multiple countries — most notably the U.S. and China — all agreeing to stop at the same time, under rules everyone could actually verify, Anthropic said.

“Without a global co-ordination mechanism, companies and governments will have to make difficult decisions about safety while under competitive and geopolitical pressures,” it said.

The company has faced pushback from others in the industry — and officials in the White House — who say its focus on worst-case scenarios overstates the risks and amounts to a strategy for slowing rivals under the cover of safety concerns.

By signing up you consent to receive the above newsletter from Postmedia Network Inc.

Article content

Advertisement 3

Article content

Still, the White House has acknowledged the power of the company’s Mythos model — which has not been made available to the general public due to its cybersecurity capabilities and is currently deployed only to a small number of vetted organizations.

The proposal would face an uphill battle in Washington and Silicon Valley, where US officials and tech executives have repeatedly argued that any slowdown in AI development risks handing China a decisive strategic edge in what many see as the defining technology race of the century.

U.S. President Donald Trump, however, said he discussed the possibility of co-operating with China on AI safety issues during his recent visit to Beijing.

Trump also signed an executive order this week that allows the government 30 days to conduct a preliminary review of the most powerful U.S. AI models before their release.

‘Human role narrowing’

Anthropic compared the problem to nuclear arms control treaties — but said it would be even harder to get a handle on, since AI training is far easier to hide than a missile silo, and the temptation to quietly keep going would be enormous.

Advertisement 4

Article content

The company said it plans to bring together government officials, scientists, advocacy groups and competing AI firms in coming months to figure out how such a system could work.

The call for co-ordination comes alongside internal data showing that AI is already dramatically speeding up the development of AI itself, Anthropic said.

That acceleration creates a feedback loop that Anthropic warned could eventually lead to what researchers call “recursive self-improvement.”

That’s the idea of an AI system that becomes capable of essentially teaching itself to get smarter, without much human help.

“We are not there yet, and recursive self-improvement is not inevitable,” the report said, while adding that it could arrive sooner than most governments and institutions are ready for.

“The evidence suggests that the human role is narrowing at each step in the AI development process.”

Read More

  1. A simple, very dark night time image of hands on an illuminated keyboard typing.

    Carney unveils plan to make Canada a global AI leader

  2. When Elon Musk says he is worried about something really, really big, we should all be paying attention, writes Warren Kinsella.

    KINSELLA: Let's not underestimate powers of artificial intelligence

Article content

*** Disclaimer: This Article is auto-aggregated by a Rss Api Program and has not been created or edited by Bdtype.

(Note: This is an unedited and auto-generated story from Syndicated News Rss Api. News.bdtype.com Staff may not have modified or edited the content body.

Please visit the Source Website that deserves the credit and responsibility for creating this content.)

Watch Live | Source Article