HomeEverythingEducation
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
← All Stories

Darktrace backs Anthropic's AI model pause on security grounds

Created at 7 Jul · 11:25 AM1 source↑ Market-relevant
IN SHORT

Darktrace's SVP of AI and security strategy, Nicole Carignan, stated that Anthropic's temporary restriction of its advanced AI models was a prudent safety measure, not a competitive move. The incident has heightened concerns about the UK's reliance on foreign AI systems.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Who's Involved

Nicole Carignan
Darktrace SVP of AI and security strategy
Anthropic
AI company that temporarily restricted its models
Darktrace
Cybersecurity company backing Anthropic's decision
John Harms
Head of government solutions at Quantexa
Caroline Ramsay
Partner and head of international trade at TLT
Darktrace backs Anthropic's AI model pause on security grounds

↳ Why This Matters

The incident highlights growing concerns about AI sovereignty and the potential for geopolitical factors to impact access to critical AI technologies, underscoring the need for robust security measures and diversified AI supply chains.

Key facts

  • Darktrace supports Anthropic's temporary restriction of its advanced AI models.
  • The pause was attributed to ensuring sufficient security mitigations for highly weaponizable AI.
  • Concerns were raised about potential misuse of AI for identifying and exploiting software weaknesses.
  • The incident has amplified discussions on AI sovereignty and the UK's reliance on foreign AI systems.
  • Experts advise diversifying AI models and building resilience into AI supply chains.

Darktrace has endorsed Anthropic's decision to temporarily restrict its most advanced AI models, viewing the move as a necessary step for security and safety rather than a competitive maneuver. Nicole Carignan, Darktrace's SVP of AI and security strategy, told City AM that the brief curb on Anthropic's Mythos and Fable models should not be interpreted as a power play over AI sovereignty.

Carignan stated, "I do not think it was a competitive advantage move. I think a good healthy pause to think through the security mitigations and strategy to ensure that it’s done safely is always a good thing." This perspective contrasts with fears that US export controls might disadvantage UK firms reliant on American AI systems. Anthropic's models were temporarily restricted due to concerns they could be used to identify and exploit software weaknesses, but access was later restored.

Carignan elaborated that the decision seemed driven by whether "the security guardrails around this model [were] sufficient for something that could be so highly weaponised." She expressed appreciation for the "pump the brakes for a hot second" approach to ensure appropriate defenses are in place before re-releasing the model. Anthropic's Mythos model is specifically designed for advanced cybersecurity tasks, including vulnerability identification.

US officials had briefly imposed export restrictions citing national security concerns over potential misuse, but restored access after Anthropic committed to additional safeguards. While Darktrace emphasizes security as the primary motivation, the incident has intensified concerns in the UK about the nation's dependence on AI tools it does not control. The government's Science, Innovation and Technology Committee has cautioned ministers against relying on allies for critical technologies, highlighting the Anthropic restrictions as an example of potential single points of failure with overseas providers.

Carignan advised organizations to manage frontier AI similarly to cloud infrastructure or other critical suppliers, advocating for diversification across multiple models and building resilience into AI supply chains. She noted Darktrace's own integrations with various AI providers, including OpenAI, Anthropic, Gemini, and Microsoft, as an example of balancing resilience with third-party risk. She also anticipates a rise in sovereign AI approaches, such as the adoption of open-source models and domestic data centers to enhance control over sensitive information.

John Harms, head of government solutions at Quantexa, echoed these sentiments, stating the Anthropic episode underscores the need for governments to have "control under distress"—the capacity to maintain operations during geopolitical or regulatory disruptions. "The lesson is clear: resilience depends on sovereignty," he remarked. Legal experts, including Caroline Ramsay, partner and head of international trade at TLT, believe the temporary restrictions represent a significant shift in US export controls, extending beyond semiconductor chips to AI models themselves. Ramsay warned organizations using frontier AI to incorporate export controls and potential service interruptions into their risk planning, as governments increasingly view advanced AI as a national security concern. Carignan, however, argued that AI has narrowed the window between vulnerability emergence and exploitation, rendering traditional patch-first cybersecurity less effective. She posited that "behavioural-based detection and autonomous response" will become crucial for security teams, enabling them to detect abnormal activity rather than solely relying on vulnerability disclosures and patches.

Frequently asked questions

Anthropic temporarily restricted its Mythos and Fable models due to concerns they could be misused to identify and exploit software weaknesses, prompting a review of security guardrails.

Darktrace believes the pause was a prudent security and safety measure, not a competitive move, and appreciates the proactive approach to ensure AI is deployed safely.

The incident has heightened concerns about the UK's reliance on foreign AI systems and the need for greater AI sovereignty and resilience in its technology supply chains.

Legal experts suggest this event marks a shift in US export controls, potentially extending beyond hardware to encompass advanced AI models themselves, requiring organizations to plan for service interruptions.

What Happens Next

01Organizations are expected to increasingly adopt sovereign AI approaches.
02Businesses are likely to diversify AI models and build resilience into their AI supply chains.
03Governments may further scrutinize AI models for national security implications.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence

How It Developed

Anthropic briefly restricted its Mythos and Fable AI models in the UK.
Darktrace SVP Nicole Carignan stated the pause was for security and safety mitigations.
Concerns arose that US export curbs could impact UK firms relying on American AI.
Anthropic's models were restricted due to potential misuse in identifying software weaknesses.
Access was restored after Anthropic agreed to additional safeguards.
The incident fueled concerns about UK dependence on AI tools not under its control.
Experts suggest governments need 'control under distress' and resilience through sovereignty.
Legal experts see the restrictions as a shift in US export controls to AI models.

Sources

T1
Darktrace says Anthropic was right to pause Mythos on ‘security and safety’ groundsCity AM

Related Stories

US Cyber Agency Uses Anthropic's Mythos AI to Audit Government Code
6 Jul · 8:12 PM
US firms turn to Chinese AI models amid US restrictions
6 Jul · 4:35 PM
Anthropic accused of secret user tracking in China
6 Jul · 4:50 PM
China Considers Curbing Overseas Access to Advanced AI Models, DeepSeek Develops Own Chip
7 Jul · 10:18 AM
Badenoch: Overregulation could deter AI firms from Britain
7 Jul · 12:35 PM