Key facts
- Anthropic proposes a system for collective decisions on pausing AI development.
- The system would involve governments and AI developers.
- The goal is to mitigate potential risks posed by advanced AI.
- Anthropic's AI models are showing increasing self-improvement capabilities.
AI company Anthropic has called for the establishment of a global system that would enable governments and artificial intelligence developers to collectively decide on when to slow down or pause work on AI technology. This proposal aims to address the potential risks associated with the rapid advancement of AI, particularly the increasing self-improvement capabilities observed in models like Anthropic's own Claude. The company suggests that such a coordinated approach is necessary to ensure that AI development does not outpace human control and that adequate safety measures are in place. The call comes amid a competitive race among major AI labs to develop increasingly sophisticated models, raising concerns about the pace and direction of innovation.