HomeEverythingEducationTV
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
Story archiveAll categories
← All Stories

Anthropic backs stronger AI safety rules in state-by-state push

Created at 15 Jul · 8:51 AM1 source↑ Market-relevant
IN SHORT

AI company Anthropic is advocating for stricter state-level regulations on artificial intelligence, endorsing proposals in New York, Illinois, and Massachusetts that go beyond current standards. The company's efforts include supporting independent audits and assessments for catastrophic risks.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Who's Involved

Anthropic
AI company advocating for stricter state-level AI safety regulations
Fernandez
Anthropic representative discussing the company's AI safety policy efforts
OpenAI
AI company that successfully lobbied for amendments to New York's AI safety bill
Kathy Hochul
New York Governor who amended the state's AI safety bill
JB Pritzker
Illinois Governor who signed a bill requiring annual AI safety audits
Bourgeois
OpenAI spokesperson reviewing Massachusetts' AI safety proposal

↳ Why This Matters

Anthropic's proactive engagement in shaping state-level AI regulations highlights the growing tension between rapid AI development and the urgent need for safety measures, potentially setting new precedents for AI governance nationwide.

Key facts

  • Anthropic is actively pushing for more stringent AI safety regulations at the state level.
  • The company supports legislation requiring independent audits and assessments of AI models for catastrophic risks.
  • Anthropic's powerful Claude Mythos model demonstrated the ability to exploit security flaws in computer operating systems.
  • The company has begun directly funding political candidates who align with its AI safety agenda.

Anthropic is spearheading a state-by-state initiative to implement more robust AI safety regulations, viewing its efforts as a response to the rapid development of powerful AI models. The company has endorsed ambitious legislation in New York, Illinois, and Massachusetts, pushing for requirements that go beyond transparency and self-reporting.

According to Fernandez, a representative for Anthropic, the company's powerful Claude Mythos model, and its public-facing version Fable, were found to be capable of exploiting security flaws in every major computer operating system during testing. These cybersecurity concerns reportedly caused panic within the Trump administration, leading to export controls until vulnerabilities could be addressed.

While OpenAI successfully influenced New York's AI safety bill to align more closely with California's existing rules, Anthropic has backed a stricter Illinois measure. This Illinois law, signed by Governor JB Pritzker, mandates annual independent third-party audits of AI safety plans for leading companies, a first-of-its-kind requirement.

Anthropic is now endorsing regulations under development in Massachusetts, which it considers the nation's strongest state AI safety proposal. This includes a requirement for leading AI companies to hire independent evaluators to assess potential catastrophic risks, such as AI assisting in bioweapon development, and empowers the state's attorney general to enforce these mandates. An OpenAI spokesperson stated the company is still reviewing the Massachusetts proposal but supports the focus on AI safeguards.

The AI giants have also engaged in political campaigning, with both companies associated with dueling super PAC networks. Anthropic has also begun directly contributing to political campaigns, supporting candidates whose views on AI safety regulation align with its mission to ensure powerful AI benefits society.

Frequently asked questions

Anthropic believes that transparency and self-reporting are no longer sufficient and advocates for more ambitious AI safety measures.

The model demonstrated the capability to exploit security flaws in every major computer operating system, raising significant cybersecurity concerns.

It requires leading AI companies to submit to annual independent third-party audits of their safety plans, a novel mandate.

Anthropic is directly contributing to political campaigns and supporting candidates whose views on AI safety regulation align with its mission.

What Happens Next

01Anthropic will continue to endorse and support AI safety legislation in various states.
02OpenAI will continue to review and potentially support AI safeguard proposals in Massachusetts.
03Anthropic will continue to fund political candidates aligned with its AI safety mission.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence

How It Developed

Anthropic endorsed stricter AI safety bills in New York, Illinois, and Massachusetts.
The company found its Claude Mythos model capable of exploiting security flaws in major operating systems.
Concerns over the Mythos model led the Trump administration to impose export controls.
OpenAI successfully lobbied for amendments to New York's AI safety bill.
Illinois enacted a law requiring annual independent third-party audits of AI safety plans.
Anthropic endorsed Massachusetts regulations requiring independent evaluators for catastrophic risks.
Anthropic began directly contributing to political campaigns aligned with its AI safety mission.

Sources

T1
Inside Anthropic’s state-by-state plan to ratchet up AI rulesPolitico

Related Stories

EU Officials Criticize Anthropic for Sending Junior Staffer to AI Safety Hearing
14 Jul · 6:31 PM
Anthropic's unsettling AI ad sparks criticism
14 Jul · 7:55 PM
Demis Hassabis proposes AI standards body modeled on FINRA
14 Jul · 11:06 AM
Australia to establish government AI office, fast-track data center approvals
14 Jul · 12:36 PM
UK banks' limited AI access spurs call for domestic capabilities
14 Jul · 11:07 PM