Key facts
- Disagreements over precise language have resurfaced in US Senate AI safety bill talks.
- The bill would require AI companies to categorize risks like biological weapons creation or cyber operations.
- AI labs must disclose advanced model findings and mitigation efforts to the Commerce Department before release.
- The Commerce Department can seek federal court injunctions if risks are not addressed.
- The proposed legislation would preempt some state AI laws.
- Senate Commerce Chair Ted Cruz is involved in negotiations.
Negotiations over a US Senate bill aimed at ensuring AI safety are facing renewed uncertainty due to disagreements over specific language, just days after a former Anthropic employee warned of existential risks from artificial intelligence. The discussions come as lawmakers grapple with how to regulate the rapidly advancing technology.
Drafts of the proposed legislation outline categories of risks that AI companies would need to consider, including the potential for models to create biological weapons or launch offensive cyber operations. According to sources familiar with the matter, AI labs would be required to disclose findings about models with advanced capabilities to the Commerce Department. This disclosure would also need to include information on the steps taken to counter identified risks and a method for the secretary to verify that these dangers have been addressed. Such disclosures would need to occur before a model is released, allowing the secretary time for review.
Under the proposed framework, if the secretary of Commerce determines that a particular risk has not been adequately mitigated, the department would have the authority to pursue an injunction in federal court. However, without such an injunction, AI labs would retain the discretion to release a model without undergoing a pre-approval process. The bill also includes provisions that would preempt certain state-level AI laws.
Senate Commerce Chair Ted Cruz (R-Texas) has been actively participating in the negotiations and has previously advocated for legislation to address potential catastrophic risks associated with AI.