xAI’s First Lawsuit Against a User Tests Responsibility for AI-Generated Content
July 16, 2026 – 8:11 am
(Image by: Shutterstock)
xAI has brought its first lawsuit against a user, alleging that the defendant engineered prompts to defeat Grok’s safeguards and generated child sexual abuse material in breach of the company’s terms of service. This case tests who is responsible when an AI system produces controversial or illegal content.
The complaint, filed in federal court in Texas on Tuesday, targets Terry Harwood, a South Carolina man arrested for sexually exploiting minors. xAI seeks unspecified monetary damages and a court order barring him from the platform.
According to the filing, Harwood:
- "opened multiple xAI accounts using false identities"
- Designed “misleading prompts” to circumvent Grok’s content moderation guardrails.
- Abused the tool to convert non-sexual photographs into sexually explicit images without consent.
Despite these attempts, Grok’s safeguards engaged, refusing to follow the prompts and alerting to potential violations. The defendant continued to submit altered prompts in an effort to bypass moderation.
This case is significant as it argues that responsibility lies with the user, not the system, when a determined individual defeats AI safeguards to produce controversial content.
xAI also disclosed its enforcement efforts for the first time:
- Suspended over 52,000 accounts.
- Filed more than 73,000 reports to the National Center for Missing & Exploited Children, leading to nearly 250 arrests in 2026 alone.
However, xAI faces multiple lawsuits arguing the opposite: that it, not individual users, is responsible for content generated by Grok. Cases are ongoing in London (brought by Jess Asato), Baltimore (under consumer protection law), and Paris (prosecutors investigating Musk’s non-cooperation). Grok has also been banned in Malaysia and Indonesia over sexually explicit outputs.
The company’s stance has evolved: while Musk previously claimed, "I am not aware of any naked underage images generated by Grok," he has since acknowledged potential issues with the AI system.