Elon Musk's AI startup xAI is suing a South Carolina man, Terry Harwood, alleging he misused the Grok AI system to create child sexual abuse material and non-consensual sexual imagery of adults. This marks one of the first lawsuits by an AI company against a user for generating explicit material.
This lawsuit represents a significant development in the legal and ethical landscape of AI, as it is one of the first instances of an AI company taking legal action against a user for generating harmful explicit content, highlighting the challenges in policing AI misuse and protecting individuals from deepfake exploitation.
Elon Musk's artificial-intelligence startup xAI has filed a lawsuit against Terry Harwood, a South Carolina man arrested earlier this year on charges of sexually exploiting minors. xAI alleges that Harwood misused the company's AI system, Grok, to create child sexual abuse material and non-consensual sexual imagery of adults, violating the company's terms of service.
The lawsuit, filed in federal court in Texas, is notable as one of the first brought by an AI company against a user for allegedly generating explicit material using an AI system. This action follows significant global scrutiny of xAI regarding allegations that Grok has enabled users to create non-consensual sexualized deepfakes.
xAI stated in its complaint that it enforces its rules through account suspensions and terminations, and by reporting suspected child sexual abuse material to the National Center for Missing & Exploited Children (NCMEC). The company reported suspending 52,222 accounts and making 73,604 reports to NCMEC in 2026, which resulted in at least 244 arrests.
The complaint details that Harwood allegedly uploaded non-sexual images of adults and minors to Grok, attempting to generate sexually explicit deepfakes. xAI described Harwood's actions as a "calculated scheme to weaponize Plaintiff’s tool for criminal ends," exposing victims to harm and the company to legal and reputational risk. xAI is seeking unspecified monetary damages and a court order to permanently prevent Harwood from using Grok.
Pick the topics you care about. Get only what matters, on your cadence.