All NewsEducationTV
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
Story archiveAll categories
← All Stories

AI era challenges peer review system

Created at 10 Aug · 11:06 AM1 source↑ Market-relevant
IN SHORT

The exponential growth of research papers, exacerbated by AI-assisted submissions, is overwhelming the volunteer peer review system. Researchers are struggling to find qualified reviewers, leading to delays and potential misinterpretations of studies, prompting calls for significant reform.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Key Numbers

5.6 percentannual increase in papers indexed in Scopus and Web of Science
15,000 yearscollective work devoted to peer review globally each year
$1.5 billionestimated cost of US peer review work alone if paid
10manuscript review requests a microbiologist estimates receiving monthly
50 yearstime peer review has been a universal feature of academic publishing

Who's Involved

Jason Semprini
health economist at Des Moines University and author of a study on HPV vaccine mandates
Haseeb Irfanullah
independent consultant and editorial board member of Wiley’s Learned Publishing
Steven Mack
editor for Human Immunology and immunogeneticist at the University of California, San Francisco
Sebastian Lourido
microbiologist at the Whitehead Institute
Aileen Fyfe
historian of science at the University of St Andrews
Melinda Baldwin
historian of science at the University of Maryland
AI era challenges peer review system

↳ Why This Matters

The integrity and efficiency of scientific progress rely heavily on peer review. If this system becomes too slow, unreliable, or inaccessible, it could hinder the dissemination of new knowledge, impact career progression for researchers, and potentially allow flawed or misrepresented research to enter the academic discourse.

Key facts

  • The number of research papers is increasing exponentially, with one estimate suggesting a 5.6% annual growth rate.
  • An estimated 15,000 years of work are devoted to peer review globally each year.
  • Journal editors report significant difficulty in finding qualified peer reviewers, requiring numerous emails.
  • The traditional peer review system, a cornerstone of academic publishing for about 50 years, is showing signs of strain.
  • Some researchers, particularly in AI, are opting for informal communication methods like blogs to disseminate findings.

The traditional system of peer review, a cornerstone of academic publishing, is facing unprecedented strain due to a surge in research papers and the increasing difficulty of finding volunteer reviewers. This overload, exacerbated by AI-assisted submissions, is leading to delays, potential misinterpretations, and a growing sentiment that the system is faltering.

Researchers like health economist Jason Semprini have experienced frustrations with peer review, where a single reviewer's misunderstanding led to the rejection of his study on HPV vaccine mandates. While typically multiple experts review papers, Semprini's case highlights the vulnerability of the system when reviewers are scarce or unqualified.

The sheer volume of published research is growing exponentially, with databases like Scopus and Web of Science indexing papers at a rate of 5.6% per year. This has led to an estimated 15,000 years of collective work being devoted to peer review globally each year, a task that is increasingly challenging for researchers already burdened with other professional responsibilities.

Editors report emailing dozens of researchers to find just one willing reviewer, a stark contrast to five years ago when finding multiple reviewers was significantly easier. This scarcity is forcing editors to assign reviews to individuals who may not be adequately qualified or lack the time to dedicate to the task. Despite these challenges, researchers continue to engage with the system, as peer-reviewed publications are crucial for career progression and securing grants.

Historians note that universal peer review is a relatively recent phenomenon, becoming standard practice only in the last 50 years. Its rise was partly driven by a need to establish legitimacy and distinguish credible science from quackery, particularly during periods of public scrutiny of scientific funding and controversial issues. However, the current system's sustainability is being questioned, with some researchers, especially in fields like AI, exploring alternative, more informal methods of communication, such as blogs, to share their findings.

Frequently asked questions

Peer review is a process where other researchers in the same field assess the validity of a submitted manuscript and recommend whether it should be published. It is typically done anonymously and on a volunteer basis.

The number of research papers is increasing exponentially, and finding qualified volunteer reviewers is becoming increasingly difficult, leading to delays and potential misinterpretations.

Researchers globally devote an estimated 15,000 years of work to peer review annually.

The article suggests that AI-assisted papers contribute to the surge in submissions, further straining the review system.

What Happens Next

01Researchers are advocating for significant changes to the peer review system.
02Some researchers are exploring alternative communication methods like blogs for sharing findings.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence

How It Developed

The number of research papers indexed in databases like Scopus and Web of Science is increasing exponentially.
Researchers are dedicating approximately 15,000 years globally to peer review annually, with significant costs.
Finding willing and qualified peer reviewers has become increasingly difficult for journal editors.
The peer review system, established about 50 years ago, is facing strain due to increased submissions and interdisciplinary research.
Some researchers are exploring informal communication channels like blogs to share findings, bypassing traditional publishing.

Sources

T1
Peer review is overwhelmed—can it survive in the AI era?var abtest_2165968 = new ABTest(2165968, 'impression');Ars Technica

Related Stories

AI safety tests pose risks as models escape containment
9 Aug · 2:46 PM
Tech leaders promise less work with AI, but employees report 90-hour weeks
10 Aug · 5:11 AM
Vintage computer collecting gains traction amid AI boom
10 Aug · 6:36 AM
AI Tools Aim to Cut Travel Costs
10 Aug · 9:11 AM
Companies Pour Billions into AI, Seeking Tangible Returns
10 Aug · 12:06 PM