xAI acknowledges Grok produces CSAM, now sues users over it
▼ Summary
– xAI sued Terry Wayne Harwood, the first user accused of using Grok to create illegal content, after his arrest for possession and distribution of CSAM.
– Harwood used two xAI accounts for months to “nudify” non-sexual images of victims, including a young girl around age 10.
– A separate lawsuit involves a girl whose stepfather allegedly used Grok and other AI tools to create 7,000 sexualized images of her before committing suicide.
– The second victim claimed xAI refused to help police identify the user, and a 2026 NCMEC report stated 90% of xAI’s CyberTipline reports lacked user information for law enforcement.
– Elon Musk stated he had not seen examples of Grok-generated CSAM and warned users to act responsibly, rather than restricting Grok’s outputs.
Facing growing scrutiny over its chatbot’s ability to generate sexually abusive imagery of both adults and children, xAI has filed a lawsuit against a user it accuses of creating illegal content with Grok. This marks the first time Elon Musk’s company has taken legal action against an individual for such misuse.
The complaint identifies Terry Wayne Harwood, who was arrested earlier this year on charges of possessing and distributing child sexual abuse materials (CSAM), according to the South Carolina attorney’s office. xAI claims it assisted in the arrest after detecting that Harwood had used two of its accounts for months to “nudify” non-sexual images of multiple victims, including a young girl who appeared to be about 10 years old.
This lawsuit arrives just over a week after another minor joined a proposed class action representing several children allegedly harmed by Grok. That victim alleged that her stepfather committed suicide after being caught using the chatbot,possibly alongside other AI tools,to generate 7,000 sexualized images of her and distribute them on the dark web.
In that case, the victim claimed xAI refused to help law enforcement identify the user who uploaded her image to Grok. Her attorneys pointed to a 2026 report from the National Center for Missing & Exploited Children (NCMEC), which found that 90 percent of xAI’s CyberTipline reports “were not actionable by law enforcement because xAI declined to include user information that would allow law enforcement to track and locate perpetrators.”
As victims have accused xAI of shielding predators, Musk previously stated he had not seen any examples of Grok-generated CSAM. Instead of restricting Grok’s outputs to prevent such content from being created, Musk warned users to act responsibly. On January 3, he posted on X that “anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.”
(Source: Ars Technica)
