All NewsEducationTV
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
Story archiveAll categories
← All Stories

Tech Employees Urge US Support for Global AI Risk Management Effort

Created at 28 Jul · 10:05 PM1 source↑ Market-relevant
IN SHORT

Over 1,100 tech employees from companies like Meta, Anthropic, OpenAI, and Google are urging the U.S. government to back an international initiative to develop tools for managing the pace of advanced AI development, citing concerns that progress may outpace safety and governance mechanisms.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Key Numbers

1,100+tech employees urging AI risk management

Who's Involved

Dawn Song
Meta's vice president of AI research and signatory
Jared Kaplan
Anthropic co-founder and signatory
Chris Olah
Anthropic co-founder and signatory
Jakub Pachocki
OpenAI Chief Scientist and signatory
Nvidia
Formed a coalition for AI safety and cybersecurity tools
Meta Platforms
Employees involved in the Pacing the Frontier initiative
Anthropic
Employees involved in the Pacing the Frontier initiative
OpenAI
Employees involved in the Pacing the Frontier initiative
Google
Employees involved in the Pacing the Frontier initiative

↳ Why This Matters

The call from a significant number of tech employees underscores growing internal concerns within the AI industry about the potential risks of unchecked development, urging governmental and international action to ensure safety and governance keep pace with technological advancement.

Key facts

  • More than 1,100 employees from major tech companies signed a statement calling for U.S. government support of international AI risk management tools.
  • The initiative, Pacing the Frontier, involves employees from Meta Platforms, Anthropic, OpenAI, and Alphabet's Google.
  • Signatories include prominent AI researchers and executives such as Dawn Song, Jared Kaplan, Chris Olah, and Jakub Pachocki.
  • OpenAI acknowledged that future AI development might require pacing.
  • Nvidia announced a coalition focused on AI safety and cybersecurity tools.

More than 1,100 employees from leading technology firms have called on the U.S. government to support an international effort aimed at developing tools to manage the rapid pace of advanced artificial intelligence development. The statement, part of an initiative called Pacing the Frontier, highlights concerns that AI progress may be outpacing existing safety, governance, and oversight mechanisms.

The signatories, including employees from Meta Platforms, Anthropic, OpenAI, and Alphabet's Google, are requesting the U.S. government to back the creation of technical and governance tools necessary to deliberately pace the development of frontier AI. Notable signatories include Meta's vice president of AI research, Dawn Song, Anthropic co-founders Jared Kaplan and Chris Olah, and OpenAI Chief Scientist Jakub Pachocki.

OpenAI responded on X, stating that at some point in the future, the acceleration of frontier model development might be so high that the world will need to pace AI advancement. This sentiment echoes a call made by Anthropic last month for major AI labs to consider a coordinated pause in development, warning that AI systems could soon improve themselves faster than society can manage the associated risks.

In related news, Nvidia announced on Monday the formation of a coalition with companies such as Adobe and CrowdStrike to develop AI safety and cybersecurity tools. This move follows a recent cybersecurity incident at Hugging Face that heightened concerns over autonomous AI agents.

Frequently asked questions

Pacing the Frontier is an initiative launched by tech employees urging the U.S. government to support international efforts to develop tools for managing the pace of advanced AI development.

Employees from Meta Platforms, Anthropic, OpenAI, and Alphabet's Google are involved, with support from nonprofits Guidelight AI Standards and Encode AI.

The employees are concerned that the pace of advanced AI development may outpace existing safety, governance, and oversight mechanisms.

Nvidia formed a coalition with Adobe, CrowdStrike, and others to develop AI safety and cybersecurity tools.

What Happens Next

01The U.S. government is expected to respond to the call for support.
02Further discussions on international AI governance and safety tools are anticipated.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence
CME Headlines
  • Is AI Making Inflation Better or Worse?
    22 Jul · 3:26 PM

How It Developed

Over 1,100 tech employees from leading firms urged the U.S. government to support an international effort to manage advanced AI development.
The initiative, named Pacing the Frontier, includes employees from Meta, Anthropic, OpenAI, and Google.
OpenAI stated that future AI acceleration may necessitate pacing advancement.
Anthropic previously called for a pause in AI development due to concerns about self-improvement rates.
Nvidia formed a coalition with Adobe and CrowdStrike to develop AI safety and cybersecurity tools.

Sources

T1
Tech employees call for US-backed global effort to manage risks of advanced AIReuters

Related Stories

OpenAI and Anthropic Push for US Government AI Safety Review Framework
28 Jul · 4:27 PM
OpenAI rogue agent compromised second tech firm, Modal Labs
28 Jul · 9:29 PM
Amazon Overhauls AI Strategy, Winds Down Nova Models for Frontier Development
28 Jul · 10:37 AM
Anthropic CEO Amodei clarifies stance on open-weight AI, voices concerns over China
28 Jul · 12:41 AM
Coursera invests $100 million in co-founder Andrew Ng's new AI education firm
28 Jul · 8:12 PM