HomeAll NewsEducationTV
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
Story archiveAll categories
← All Stories

US AI guardrails push cybersecurity work to Chinese rivals, Hugging Face incident shows

Created at 22 Jul · 5:19 PM1 source↑ Market-relevant
IN SHORT

A New York startup used a Chinese AI model to address a cybersecurity breach after U.S. firms declined, highlighting fears that U.S. AI guardrails may cede ground to Beijing-based competitors in critical cybersecurity applications.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Key Numbers

4 billionZhipu AI funding in Hong Kong share sale

Who's Involved

Hugging Face
New York startup that used a Chinese AI model for cybersecurity analysis
Zhipu AI
Chinese AI company whose GLM-5.2 model was used by Hugging Face
OpenAI
U.S. AI firm whose models declined a cybersecurity task
Anthropic
U.S. AI firm whose advanced model routes cybersecurity queries to an older version
Clement Delangue
Co-founder of Hugging Face
Lukasz Olejnik
Independent technology consultant and visiting senior research fellow
Sridhar Ramaswamy
Snowflake CEO
Marc Andreessen
Venture capitalist
Shrenik Kothari
Analyst at Robert W. Baird
US AI guardrails push cybersecurity work to Chinese rivals, Hugging Face incident shows

↳ Why This Matters

The incident highlights a potential strategic disadvantage for U.S. AI companies in the critical field of cybersecurity due to safety restrictions, potentially ceding ground to Chinese competitors and impacting the global AI landscape.

Key facts

  • Hugging Face utilized Zhipu AI's GLM-5.2 model to investigate a cybersecurity breach after leading U.S. AI models refused the task.
  • U.S. AI companies like OpenAI and Anthropic have restrictions on their advanced models that can hinder cybersecurity work.
  • Chinese open-source AI models are becoming more prominent in Silicon Valley, offering competitive capabilities at a lower cost.
  • The incident raises concerns that U.S. AI safety guardrails could create an asymmetric disadvantage against attackers.
  • Zhipu AI's GLM-5.2 has seen a surge in usage, and its parent company's stock has experienced significant growth.

A New York-based startup, Hugging Face, turned to a Chinese AI model, Zhipu AI's GLM-5.2, to analyze data from a cybersecurity breach after leading U.S. AI models declined the task due to safety restrictions. This incident is fueling concerns that guardrails limiting U.S. AI firms from engaging in cybersecurity work could benefit their Beijing-based rivals.

Leading U.S. AI companies, including OpenAI and Anthropic, have implemented safeguards that prevent their most advanced models from performing hacking-related tasks or distinguishing between legitimate defense work and malicious attacks. For example, Anthropic's Claude Fable 5 routes cybersecurity queries to an older model, and OpenAI's GPT-5.6 Sol is designed to block such activities.

This situation presents a competitive opening for Chinese open-source models like GLM-5.2, which are gaining traction in Silicon Valley for their coding and agentic capabilities, often at a lower cost. Beijing is increasingly leveraging open-source AI to position itself as an alternative to the U.S. in the global AI race, with state media framing this strategy as a response to U.S.-led restrictions.

Lukasz Olejnik, an independent technology consultant, noted that a safety regime restricting legitimate defenders while capable models remain available to attackers creates an asymmetric disadvantage that will likely widen as open-source models improve without similar restrictions. OpenAI stated it has brought Hugging Face into its trusted access program to support their defense efforts.

Zhipu AI's GLM-5.2 has seen a significant rise in usage since its launch last month, with endorsements from figures like Snowflake CEO Sridhar Ramaswamy and venture capitalist Marc Andreessen. The company recently raised approximately $4 billion in a Hong Kong share sale, and its stock has surged nearly ninefold since its debut. However, some analysts caution against removing U.S. safeguards entirely, suggesting instead a rethinking of access architecture to allow controlled capability allocation rather than a blanket refusal.

Frequently asked questions

U.S. AI companies have implemented safety guardrails that restrict their advanced models from performing hacking-related tasks or distinguishing between legitimate defense work and malicious attacks.

Chinese open-source models like Zhipu AI's GLM-5.2 are gaining traction due to their capabilities and lower cost, offering an alternative to U.S. models with fewer restrictions.

The guardrails may create an asymmetric disadvantage for legitimate defenders, potentially driving customers toward Chinese AI rivals and impacting the competitive landscape in AI-driven cybersecurity.

OpenAI has brought Hugging Face into its trusted access program and is supporting their teams in using OpenAI's models to improve their defenses.

What Happens Next

01OpenAI is supporting Hugging Face through its trusted access program.
02Analysts suggest rethinking access architecture for U.S. AI models rather than removing safety guardrails.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence

How It Developed

Hugging Face used Zhipu AI's GLM-5.2 model to analyze a hack after U.S. AI models declined.
The incident highlights concerns that U.S. AI companies' safety restrictions may disadvantage them in cybersecurity.
Chinese open-source models like GLM-5.2 are gaining traction in Silicon Valley due to their capabilities and lower cost.
Beijing is positioning open-source AI as an alternative to U.S. models, countering U.S. restrictions.
OpenAI is supporting Hugging Face through its trusted access program.
Zhipu AI's GLM-5.2 model has seen increased usage and its parent company's stock has risen significantly.

Sources

T1
Chinese AI's role in stopping rogue OpenAI agent shows cost of US guardrailsReuters

Related Stories

White House Alleges China's Moonshot AI Copied Anthropic Model for K3 Release
22 Jul · 2:39 PM
US Mulls AI Sanctions on China Over IP Theft, Plans September Talks
22 Jul · 9:06 AM
UK government probes OpenAI AI breach after 'unprecedented' hack
21 Jul · 11:50 PM
Hugging Face CEO Thanks Chinese AI for Defense After OpenAI Hack
21 Jul · 9:31 PM
Former DOGE Staffers Launch AI Cyber Startup Cathedral With $1.4B Valuation
22 Jul · 5:53 PM