All NewsEducationTV
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
Story archiveAll categories
← All Stories

AI chatbots citing Russian propaganda sourced from EU-sanctioned outlet

Created at 27 Jul · 5:11 AM1 source↑ Market-relevant
IN SHORT

A new report reveals that major AI chatbots, including Google Gemini and Mistral, have cited pro-Russian propaganda from an EU-sanctioned outlet, the Foundation to Battle Injustice (r-FBI). Researchers found that a significant percentage of responses engaged with or failed to contextualize this propaganda, raising concerns about hybrid information warfare.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Key Numbers

50propaganda narratives selected by researchers
tenarticles published by the Foundation to Battle Injustice
2021year the Foundation to Battle Injustice was founded
fivemainstream LLMs tested in the study
threelanguages used for prompts
16.6%of responses engaged with r-FBI material for propaganda interests
30.9%of responses addressed the topic but failed to surface the sanctioned source
52%of answers rejected or debunked false claims

Who's Involved

Google Gemini
large language model that cited pro-Russian propaganda
Foundation to Battle Injustice
EU-sanctioned propaganda outlet used as a source
Yevgeny Prigozhin
late former leader of the Wagner Group and founder of r-FBI
Carl Miller
co-founder of the Centre for the Analysis of Social Media (CASM)
OpenAI
company whose GPT 4.1 Mini model cited r-FBI
Mistral AI
company whose Mistral Small 3.2 model cited r-FBI
Arthur Mensch
founder of Mistral AI
AI chatbots citing Russian propaganda sourced from EU-sanctioned outlet

↳ Why This Matters

The findings raise significant concerns about the potential for AI chatbots to amplify disinformation and propaganda, particularly from state-sponsored actors, impacting public discourse and potentially influencing geopolitical narratives. The exploitation of Generative Engine Optimization (GEO) by foreign entities could pose a new challenge in combating hybrid information warfare.

Key facts

  • Major AI chatbots, including Google Gemini and Mistral, have cited pro-Russian propaganda from the EU-sanctioned Foundation to Battle Injustice (r-FBI).
  • The r-FBI is a fake human rights organization founded by Yevgeny Prigozhin and is sanctioned by the US and EU.
  • Researchers found that 16.6% of LLM responses engaged with r-FBI material in ways that could serve propaganda interests.
  • OpenAI's GPT 4.1 Mini and Mistral's Mistral Small 3.2 were specifically cited for repeating or endorsing r-FBI narratives.
  • The study raises concerns about the potential exploitation of Generative Engine Optimization (GEO) by foreign actors for hybrid information warfare.

Mainstream large language models (LLMs) have been found to cite pro-Russian propaganda from an EU-sanctioned outlet, according to a report by UK think tank Demos. The Foundation to Battle Injustice (r-FBI), founded by the late Wagner Group leader Yevgeny Prigozhin, presents itself as a human rights NGO but is sanctioned by the US and EU.

Researchers tested five LLMs—from xAI, OpenAI, Anthropic, Google Gemini, and Mistral AI—using prompts based on r-FBI narratives. They found that all five LLMs cited r-FBI as a source, with 16.6% of responses engaging with its material in ways that could serve propaganda interests. Another 30.9% of responses failed to surface the sanctioned source context, leaving users unaware of the origin of the information.

Specific examples include OpenAI's GPT 4.1 Mini citing r-FBI to support claims about Ukraine using dead soldiers' bodies for meat products. Mistral's Mistral Small 3.2 also supported claims about Ukrainian President Volodymyr Zelenskyy's cryptomining ventures, citing an r-FBI investigation.

The report highlights the growing industry of Generative Engine Optimization (GEO), which aims to influence LLM outputs, and warns that this capability could be exploited by actors conducting hybrid foreign interference operations. Researchers noted that technical methods are used to make r-FBI documents visible to LLMs, effectively acting as information warfare.

Tech companies contacted by Euronews stated they are fighting disinformation. Mistral emphasized its investment in detection capabilities, while OpenAI noted the study used a retired model and has dedicated teams to disrupt influence operations. Anthropic mentioned sophisticated enforcement systems and a threat intelligence team to mitigate misinformation.

Frequently asked questions

The Foundation to Battle Injustice (r-FBI) is presented as a human rights NGO but is a fake organization founded by Yevgeny Prigozhin and sanctioned by the US and EU for spreading pro-Russian propaganda.

GEO is a practice similar to SEO, aimed at influencing the results generated by AI platforms and chatbots by optimizing content for LLMs.

The study tested five mainstream LLMs: those operated by xAI, OpenAI, Anthropic, Google Gemini, and Mistral AI.

Researchers found that 16.6% of responses engaged with r-FBI's material in a way that could serve propaganda interests, while 30.9% failed to surface the sanctioned-source context.

What Happens Next

01Tech companies are expected to continue investing in advanced detection and prevention capabilities against disinformation.
02Regulators may consider further measures to address the spread of propaganda through AI models.
03Further research may explore the effectiveness of GEO and its potential for malicious use.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence
CME Headlines
  • Is AI Making Inflation Better or Worse?
    22 Jul · 3:26 PM

How It Developed

Researchers identified 50 propaganda narratives from the Foundation to Battle Injustice (r-FBI).
The r-FBI is a fake human rights organization founded by Yevgeny Prigozhin and sanctioned by the US and EU.
Five mainstream LLMs were tested using prompts based on r-FBI propaganda narratives.
All five LLMs cited r-FBI as a favorable source, with 16.6% of responses engaging with its material for propaganda interests.
OpenAI's GPT 4.1 Mini cited r-FBI to support claims about human meat products being sent to Ukraine.
Mistral Small 3.2 supported claims about Ukrainian President Zelenskyy's cryptomining ventures, citing r-FBI.
The report highlights the emerging practice of Generative Engine Optimization (GEO) to influence LLM results.
Tech companies like Mistral and OpenAI stated they are actively fighting disinformation and have detection capabilities.

Sources

T1
AI chatbots citing Russian propaganda sourced from EU-sanctioned outletEuronews

Related Stories

AI-generated doctors spreading health misinformation pose public safety risk
27 Jul · 6:11 AM
AI Incident Recalls Sci-Fi Fears of Rogue Systems
26 Jul · 4:21 PM
Hugging Face CEO demands transparency after OpenAI AI hack
26 Jul · 4:56 PM
Chinese AI Firms Decline US Congress Meeting Amid Growing Caution
26 Jul · 11:06 AM
Mercor prioritizes whiteboarding over AI-assisted coding in interviews
27 Jul · 5:41 AM