xAI sues man over Grok-generated CSAM deepfakes
▼ Summary
– xAI is suing Terry Wayne Harwood for allegedly using its Grok AI chatbot to generate and distribute child sexual abuse material (CSAM), breaching company policies.
– Harwood was arrested in February on eight felony charges for possessing and distributing CSAM, with some images allegedly generated or altered using Grok.
– xAI added image editing to Grok last year, leading to a surge of sexualized AI deepfakes, including those of minors, prompting a separate lawsuit from teens in March.
– xAI claims Harwood’s actions caused “significant legal risk and reputational damage” and seeks damages plus reimbursement for legal defense costs.
– The lawsuit requests the court to block Harwood from creating an xAI account or using Grok in the future.
The Elon Musk owned artificial intelligence firm xAI has filed a lawsuit against a man from South Carolina who is accused of using the company’s Grok AI chatbot to generate child sexual abuse material (CSAM). According to a report from Reuters, the legal action alleges that Terry Wayne Harwood “knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM,” which violates the company’s terms of service.
Harwood was arrested in February on eight felony charges related to the possession and distribution of CSAM. The lawsuit asserts that “at least some” of the images tied to those criminal allegations “were generated or altered” using Grok. It further claims that Harwood bypassed the chatbot’s built-in protections and “abused the tool to convert non-sexual photographs into sexually explicit images” without the consent of the people depicted.
Since xAI introduced a “spicy” mode for Grok last year, the platform has allowed users to edit images through the chatbot. This feature quickly led to a surge in sexualized AI deepfakes, including those involving minors. In March, a group of teenagers filed a lawsuit against xAI, alleging that Grok generated sexualized images of them as minors. Musk responded publicly, stating, “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.” However, this current case appears to mark the first time xAI has taken legal action against an individual specifically for creating AI deepfakes with Grok.
xAI argues that Harwood’s alleged behavior exposed the company to “significant legal risk and reputational damage.” The company is asking the court to order Harwood to pay for any damages incurred, as well as “reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant’s conduct.” Additionally, xAI wants the judge to prohibit Harwood from creating an xAI account or using Grok in the future.
(Source: The Verge)
