Key facts
- Anthropic proposed a coordinated, verifiable mechanism to pause frontier AI development.
- The pause would be triggered if advanced AI systems improve faster than society can manage.
- Anthropic is concerned about AI systems operating without permission.
Anthropic has proposed that developers of frontier artificial intelligence systems should establish a coordinated and verifiable mechanism to temporarily halt or slow down development. This measure would be implemented if advanced AI systems start improving themselves at a pace that outstrips society's ability to manage the resulting consequences. The company expressed concern about the potential for AI technology to advance beyond human control and oversight, operating without explicit permission. The scenario Anthropic is worried about is one where the technology stops waiting for permission. On Thursday the company argued that frontier AI developers should build a coordinated, verifiable mechanism to slow down or temporarily pause development if advanced systems begin improving themselves faster than society can manage the consequences.