Key facts
- Anthropic has called for a temporary pause in AI development.
- The company cited rapid advancements and the risk of AI systems improving themselves without human intervention.
- Anthropic believes a pause is needed to address potential societal risks and develop safeguards.
- The company suggests a coordinated, verifiable slowdown across multiple international labs.
- Critics suggest Anthropic's call is a marketing tactic to hinder competition.
Anthropic has called for a temporary slowdown in the pace of artificial intelligence development, citing concerns that AI models are advancing so rapidly they risk outrunning society's ability to control them. The company stated in a new post that it believes it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up. Anthropic plans to conduct research and take actions to help build systems that would enable a credible slowdown or pause, allowing developers to verify that others globally have stopped or slowed development. The company acknowledges that a meaningful pause would require multiple well-resourced labs in multiple countries to agree to stop under the same verifiable conditions, noting that training runs are easier to conceal than missile silos. Anthropic plans to organize conversations with policymakers, researchers, civil society, and other AI companies to address questions around recursive self-improvement and coordination. This follows a pattern where Anthropic has previously warned of AI doom scenarios, such as with its Mythos model, and then positioned its own products and frameworks as defenses. Critics, however, suggest this strategy is a form of fear-based marketing (FUD) intended to hobble competition, especially as Anthropic races OpenAI to public markets.