xAI sues Grok user for creating CSAM deepfakes, marking first lawsuit of its kind

xAI sues a man for using Grok to generate CSAM 'deepfakes'

The Elon Musk-owned xAI is suing a South Carolina man who allegedly used the company's Grok AI chatbot to generate child sexual abuse material (CSAM). In a lawsuit reported earlier by Reuters, xAI claims Terry Wayne Harwood "knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM," breaching the company's policies. Harwood was arrested in February for allegedly possessing and distributing CSAM and is facing eight felony charges. The lawsuit claims "at least some" of the images related to Harwood's criminal charges "were generated or altered" with Grok, and that Harwood bypassed Grok's safeguards and "abused the tool to convert non-sexual photographs into sexually explicit images" without the subjects' consent. After rolling out a "spicy" mode for Grok last year, xAI added the ability to edit images with the chatbot, leading to a flood of sexualized AI deepfakes, including ones with minors. A group of teens sued xAI in March over claims Grok generated sexualized images of themselves as minors. Musk responded by saying, "Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content," though this appears to be the first time xAI has sued anyone over AI deepfakes created with Grok. xAI claims Harwood's alleged actions exposed the company to "significant legal risk and reputational damage." It has asked the court to order Harwood to pay xAI for any damages, as well as "reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant's conduct." xAI also wants the judge to block Harwood from creating an xAI account or using Grok.

Musk's xAI sues Grok user over sexualized 'deepfakes'

July 15 (Reuters) - Elon Musk's artificial-intelligence startup xAI has sued a South Carolina man arrested earlier this year on charges of sexually exploiting minors, alleging he misused the company's AI system Grok to create child sexual abuse material. xAI alleged in the lawsuit, opens new tab, filed in federal court in Texas on Tuesday, that Terry Harwood violated the company's terms of service. The case is one of the first brought by an AI company against one of its users for allegedly using an AI ⁠system to generate explicit material. Contact information for Harwood, who was arrested, opens new tabin February, was not immediately available. Spokespeople for xAI did not immediately respond to a request for comment on Wednesday. The company's lawsuit against Harwood follows intense global scrutiny of xAI over allegations that Grok has allowed users to generate non-consensual sexualized deepfakes, or realistic-looking videos fabricated by AI. xAI's complaint said that the company "enforces its rules against violators through account suspensions, account terminations, and by reporting suspected child sexual abuse material ⁠to the National Center for Missing & Exploited Children." "Indeed, Plaintiff has suspended 52,222 accounts and made 73,604 reports to NCMEC in 2026, resulting in (at least) 244 arrests," the lawsuit said. xAI alleged that Harwood uploaded non-sexual images of adults and minors to Grok and ⁠tried to use the system to generate sexually explicit deepfakes based on them. The complaint also alleged he created non-consensual sexual imagery of adults. The company asked the court ⁠for an unspecified amount of monetary damages and a court order permanently blocking Harwood from using Grok. "Defendant's actions were a calculated scheme to weaponize Plaintiff's ⁠tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage," xAI said in the lawsuit. Reporting by Blake Brittain in Washington; Editing by Sanjeev Miglani Our Standards: The Thomson Reuters Trust Principles., opens new tab * Suggested Topics: * Litigation * Data Privacy Blake Brittain Thomson Reuters Blake Brittain reports on intellectual property law, including patents, trademarks, copyrights and trade secrets, for Reuters Legal. He has previously written for Bloomberg Law and Thomson Reuters Practical Law and practiced as an attorney.

xAI sues Grok user for generating nonconsensual sexualized deepfakes - Engadget

The defendant used Grok to create sexualized images of adults and children, xAI says. SpaceXAI (as xAI) has filed a lawsuit against Terry Wayne Harwood, a 67-year-old man from South Carolina whom the company has accused of using Grok to generate sexual images of real people without their consent. In the complaint that xAI filed in Texas, it said that the defendant uploaded non-sexual images of numerous adults and minors to his two xAI accounts from December 8, 2025 until February 18, 2026. He then asked Grok to alter the photos or to create new images and videos depicting the adults and children in them "in a pornographic manner or otherwise sexualizing them." The company said that Grok refused to follow his prompts on "numerous occasions" but that he repeatedly submitted edited prompts to circumvent the AI's safeguards. In one example mentioned in the filing, xAI said Harwood uploaded the photo of a fully dressed girl around 10 to 11 years old and then asked Grok to remove all of her clothing and make her do a "Playboy model impression" as she laid in bed. Grok refused his request, the lawsuit said, but he kept on submitting modified requests. As Reuters notes, this is one of the first lawsuits brought by an AI company against one of its users, and it sends a message that xAI will sue over the misuse of Grok. Reports started coming out in early January that Grok has been allowing its users to transform photos of real women and children into sexualized images. Regulators swiftly launched formal investigations into Grok after the scandal blew up. California's authorities started looking into the AI in mid-January, as did UK regulator Ofcom. The European Commission and Ireland's Data Protection Commission opened separate probes, as well. xAI implemented measures to prevent users from generating nonsensual sexual deepfakes when the investigations started. But even after that, users were still able to use Grok to undress men, and Harwood kept on uploading images to his account and using them to generate sexualized edits. The office of South Carolina's Attorney General announced Harwood's arrest on March 9, as part of the activities of the Internet Crimes Against Children Task Force. Harwood was charged with three counts of second degree sexual exploitation of a minor and five counts of sexual exploitation of a minor in the third degree. Harwood didn't just possess child sexual abuse materials, he also distributed them. xAI is now asking asking the court for an unspecified amount of monetary damages. It wants the court to order the defendant to pay for the expenses it incurs to defend itself in any legal action that might be filed by his victims.

xAI's first lawsuit against a user tests who is responsible for what Grok makes

The company says the defendant engineered prompts to defeat Grok's safeguards. Courts on three continents are being asked whether the safeguards were ever the point. AI has sued one of its own users, alleging he used Grok to generate child sexual abuse material in breach of the company's terms of service. It is understood to be the first case an AI company has brought against a user over what its own system produced. It arrives while xAI is on the other side of the same argument in several courts, among them a London High Court claim testing whether the developer answers for what its users make. The complaint, 12 pages, was filed in federal court in Texas on Tuesday against Terry Harwood, a South Carolina man arrested earlier this year on charges of sexually exploiting minors. xAI is seeking unspecified monetary damages and a court order permanently barring him from the platform. The company's account of what happened is specific, and it is the reason the filing matters beyond this defendant. Harwood "opened multiple xAI accounts using false identities", the complaint says, and "designed misleading prompts to circumvent Grok's built-in safeguards and then abused the tool to convert non-sexual photographs into sexually explicit images without the photograph subjects' knowledge or consent". Crucially, xAI says the guardrails engaged. Grok "refused to follow the prompts on the basis that such material violated Grok's content moderation guardrails", according to the filing. "In response, Defendant repeatedly submitted further prompts, with alterations, in an effort to circumvent Grok's moderation efforts." That is the legal architecture of the whole case. xAI is not arguing that Grok cannot produce this material. It is arguing that Grok tried not to, and that a determined user defeated it, which relocates responsibility from the system to the person at the keyboard. The filing also puts numbers on xAI's enforcement for the first time. The company says it has suspended more than 52,000 accounts and filed more than 73,000 reports to the National Center for Missing & Exploited Children, resulting in close to 250 arrests during 2026 alone. Those figures are xAI's own, disclosed in litigation it chose to bring. The awkwardness is in the timing. xAI is currently the defendant in a run of cases making precisely the opposite argument: that the company, not the user, is answerable for what Grok generates. The London claim, brought by the Labour MP Jess Asato, is one. Baltimore has sued under consumer protection law, and Paris prosecutors have an investigation open that Musk has declined to cooperate with. Grok has been banned in Malaysia and Indonesia over sexually explicit output. Apple privately threatened to pull it from the App Store in January. The company's public position has moved some distance in six months. "I am not aware of any naked underage images generated by Grok. Literally zero," Musk posted on X in January, when the allegations first broke. The complaint filed this week describes a moderation system that logs, refuses, and escalates such attempts by the tens of thousands. Both things can be true. A system can refuse most attempts and still be, in the aggregate, the most productive source of this material anyone has built. The Center for Countering Digital Hate estimated Grok generated roughly three million sexualised images between late December and early January, including around 23,000 that appeared to depict children. xAI's 73,000 NCMEC reports are evidence of a filter working and evidence of the scale of what it is filtering. What the case does not resolve is the question every regulator is actually asking, which is whether a general-purpose image model that can be talked into this by a persistent amateur should be shipped to the public at all. Harwood's alleged method, by xAI's own telling, was to keep rephrasing until something worked. The company says it enforces its rules through account suspensions, terminations, and referrals to NCMEC, and the complaint presents this suit as an extension of that. It is also, unavoidably, a filing that produces a defendant who is not xAI at a moment when courts in London, Baltimore, and Paris are considering whether it should be. The EU has since agreed a ban on non-consensual intimate deepfakes. Harwood faces criminal charges in South Carolina separately from this suit, and has not publicly responded to the civil complaint. xAI, for now, has picked the defendant it wants.

xAI Sues Man for Using Grok to Create CSAM Deepfakes

Elon Musk's startup xAI is suing a man for allegedly misusing the company's AI image generator Grok to create child sexual abuse material. Terry Harwood from South Carolina was arrested earlier this year on charges of creating sexually explicit images of minors. xAI filed its lawsuit in Texas on Tuesday, which is one of the first instances of an AI company suing one of its users for misuse. In August 2025, xAI introduced spicy mode for Grok, which was capable of generating photorealistic nudity. Afterwards, xAI introduced the ability to edit images on Grok and that led to an avalanche of deepfake pornographic images, mostly of women, but some were of children. Amid the furore, Grok restricted its image editing tool but that didn't stop regulators opening an investigation and a group of teens from suing xAI who claim that Grok created nonconsensual sexually explicit images and videos of them when they were minors. In its lawsuit, xAI says that Harwood's allegedly making CSAM images created "significant legal risk and reputational damage" for the company. According to Reuters, xAI's complaint says the company "enforces its rules against violators through account suspensions, account terminations, and by reporting suspected child sexual abuse material ⁠to the National Center for Missing & Exploited Children (NCMEC)." xAI claims to have suspended 52,222 accounts and made 73,604 reports to the NCMEC in 2026, which has purportedly led to at least 244 arrests. "Defendant's actions were a calculated scheme to weaponize Plaintiff's ⁠tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage," xAI says in the lawsuit. The AI startup is asking the court to order Harwood to pay damages, as well as "reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant's conduct." xAI is also seeking a court order blocking Harwood from creating an xAI account or using Grok. Image creditsHeader photo licensed via Depositphotos.

Musk's xAI sues user who allegedly used Grok to create child sexual abuse material

Case is one of first brought by an AI company against a user ⁠for allegedly using a tool to generate child abuse material Elon Musk's artificial-intelligence startup xAI has sued a South Carolina man arrested ⁠earlier this year on charges of sexually exploiting minors, alleging he misused the company's AI system Grok to ⁠create child sexual abuse ⁠material. xAI alleged in the lawsuit, filed in federal court in Texas on Tuesday, that Terry Harwood violated the company's ⁠terms of service. The case is one of the first brought by an AI company against one of its users ⁠for allegedly using an AI system to generate child sexual abuse material. Spokespeople for xAI did not immediately respond to a request for comment on Wednesday. The company's lawsuit against Harwood comes after intense global scrutiny of xAI over allegations that Grok has allowed users to generate non-consensual sexualized deepfakes, or realistic-looking videos fabricated by AI. Contact information for Harwood, who was arrested in February, was not immediately available. xAI's complaint said that the company "enforces its rules against violators through account suspensions, account terminations, and by reporting suspected child sexual abuse material to the National Center for Missing + Exploited Children". xAI alleged that Harwood uploaded non-sexual images of adults and minors to Grok and tried to use the system to generate sexually explicit deepfakes based ⁠on them. The complaint also alleged he created non-consensual sexual imagery of adults. The company asked the court for an unspecified amount of monetary damages and a court order permanently blocking Harwood from using Grok. "Defendant's actions were a calculated scheme to weaponize Plaintiff's tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage," xAI said in the lawsuit.

SpaceXAI sues user over alleged Grok deepfake abuse

SpaceXAI has filed a lawsuit against Terry Wayne Harwood, a 67-year-old from South Carolina, alleging that he used Grok to generate sexual images of individuals without their consent, Reuters reports. The complaint, submitted in Texas, claims Harwood uploaded non-sexual images of numerous adults and minors to two xAI accounts between December 8, 2025, and February 18, 2026, requesting Grok to alter these photos or create new images depicting them in sexualized manners. xAI reported that Grok rejected Harwood's prompts on numerous occasions, but he continued to submit edited prompts to bypass the AI's safeguards. The lawsuit cites an instance where Harwood uploaded a photo of a fully dressed girl, approximately 10 to 11 years old, and requested Grok to undress her and pose her in a sexual manner. The company emphasized this as one of the first lawsuits by an AI firm against a user for the misuse of AI-generated content. Following initial reports in January about Grok's capabilities allowing for the transformation of images of real women and children into sexualized depictions, various regulatory bodies launched investigations. Authorities in California, along with the UK regulator Ofcom, opened probes into the AI service, later joined by the European Commission and Ireland's Data Protection Commission. In response to these inquiries, xAI implemented safeguards to prevent the generation of nonconsensual sexual deepfakes. However, Harwood reportedly continued to upload images and produce sexualized edits despite these measures. The South Carolina Attorney General's office announced Harwood's arrest on March 9, facilitated by the Internet Crimes Against Children Task Force. He faces three counts of second-degree sexual exploitation of a minor and five counts of third-degree sexual exploitation of a minor, involving both the possession and distribution of child sexual abuse materials.

Musk's XAI Sues Grok User Over Sexualized 'Deepfakes'

July 15 (Reuters) - Elon Musk's artificial-intelligence ⁠startup ⁠xAI has sued a ⁠South Carolina man arrested earlier this year on charges of sexually exploiting minors, alleging he misused the company's AI system Grok to create child sexual abuse material. xAI alleged in the lawsuit, filed in federal court in Texas on Tuesday, that ⁠Terry ⁠Harwood violated the company's terms of service. The case is one of the first brought by an AI company against one of its users for allegedly using an AI system to generate explicit material. Contact information for Harwood, who was arrested in February, was not immediately available. Spokespeople for xAI did not ⁠immediately respond ⁠to a request for ⁠comment on Wednesday. The company's lawsuit against Harwood follows intense global scrutiny of xAI over allegations that Grok has ⁠allowed users to generate non-consensual sexualized deepfakes, or realistic-looking videos fabricated by AI. xAI's complaint said that the company "enforces its rules against violators through account suspensions, account terminations, and by reporting suspected child sexual abuse material to the ⁠National Center for Missing & Exploited Children." "Indeed, Plaintiff has suspended 52,222 accounts and ⁠made 73,604 reports to NCMEC in 2026, resulting in (at least) 244 arrests," the lawsuit said. xAI alleged that Harwood uploaded non-sexual images of adults and minors to Grok and tried to use the system to generate sexually explicit deepfakes based on them. The complaint also alleged he created non-consensual sexual imagery of adults. The company asked the court for an unspecified amount of monetary damages and a court order ⁠permanently blocking Harwood from using Grok. "Defendant's actions were a calculated scheme to weaponize Plaintiff's tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage," xAI said in the lawsuit. (Reporting by Blake Brittain in Washington; Editing by Sanjeev Miglani)

Musk's xAI sues man accused of using Grok to create explicit material

Elon Musk's artificial intelligence firm xAI is suing a South Carolina man, accusing him of using its generative chatbot Grok to create child sexual abuse material (CSAM). The suit, filed in a federal court in Texas Tuesday, alleges Terry Wayne Harwood had at least two Grok accounts using false identifies to create and distribute explicit material. Harwood allegedly uploaded non-sexual images of multiple adults and minors and attempted to use Grok to depict the individuals in a "pornographic manner or otherwise sexualizing them." "His conduct was knowing, intentional, and calculated," xAI's attorneys wrote, adding Harwood's actions were a "scheme to weaponize" the AI firm's tool for "criminal ends, exposing real victims to profound and lasting harm" and xAI to "significant legal risk and reputational damage." In one instance, Harwood allegedly uploaded a picture of a fully dressed female who appeared to be about 10 or 11 years old, and asked Grok to generate sexualized images of them. Contact information for Harwood or his attorneys was not immediately available. xAI said its reporting of the accounts played a role in Harwood's arrest in South Carolina last March. The firm is now asking the court for relief to prevent Harwood from creating new accounts or circumventing the firm's rules for Grok use, and monetary damages. The AI firm, which was acquired by Musk's aerospace company SpaceX earlier this year, faced scrutiny earlier this year over Grok's alleged sexual abuse content. The firm has faced its own legal challenges over the chatbot. In March, three Tennessee teenagers sued the firm, alleging their photographs were used for Grok to create CSAM. Amid the backlash, Musk in January said he was unaware of any instances in which Grok generated nude photos of minors. The tech billionaire said Grok does not product illegal material, regardless of user requests, and said any bugs encountered are quickly fixed. xAI limited Grok's image and video editing and generation capabilities to paid subscribers to X Premium+ or SuperGrok. The firm, in the suit against Harwood, maintained it enforces rules against violators through account suspensions or terminations and reports to the National Center for Missing and Exploited Children. xAI has suspended more than 52,200 accounts and made 73,600 reports to NCMEC this year, according to the suit.

Elon Musk's xAI sues Grok user over sexualised 'deepfakes'

xAI alleged in the lawsuit, filed in federal court in Texas on Tuesday, that Terry Harwood ⁠violated ⁠the company's terms of service. The case is one of the first brought by an AI company against one of its users for allegedly using an AI system to generate explicit material. Elon Musk's artificial-intelligence startup xAI has sued a South Carolina man arrested earlier this year on charges of sexually exploiting minors, alleging he misused the company's AI system Grok to create child sexual abuse material. xAI alleged in the lawsuit, filed in federal court in Texas on Tuesday, that Terry Harwood ⁠violated ⁠the company's terms of service. The case is one of the first brought by an AI company against one of its users for allegedly using an AI system to generate explicit material. Contact information for Harwood, who was arrested in February, was not immediately available. Spokespeople for xAI did not immediately respond to a request for comment on Wednesday. The ⁠company's lawsuit against Harwood follows intense global scrutiny of xAI over allegations that Grok has allowed users to generate non-consensual sexualized ⁠deepfakes, or realistic-looking videos fabricated by AI. xAI's complaint said that the company "enforces its rules against violators through account suspensions, account terminations, and by reporting suspected child sexual abuse material to the National Center for Missing & Exploited Children." "Indeed, Plaintiff has suspended 52,222 accounts and made 73,604 reports to NCMEC in 2026, resulting in (at least) 244 arrests," the lawsuit said. xAI alleged that Harwood uploaded non-sexual images of adults and minors to Grok and tried to use the system to generate sexually explicit deepfakes based on them. ⁠The complaint also alleged he created non-consensual sexual imagery of adults. The company asked the court for an unspecified amount of monetary damages and a court order permanently blocking Harwood from using Grok. "Defendant's actions were a calculated scheme to weaponize Plaintiff's tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage," xAI said in the lawsuit.

Elon Musk's xAI sues Grok user for allegedly creating sexually explicit deepfakes of adults, minors

Elon Musk's artificial-intelligence startup xAI has sued a South Carolina man arrested earlier this year on charges of sexually exploiting minors, alleging he misused the company's AI system Grok to create child sexual abuse material. xAI alleged in the lawsuit, filed in federal court in Texas on Tuesday, that Terry Harwood violated the company's terms of service. The case is one of the first brought by an AI company against one of its users for allegedly using an AI system to generate explicit material. Contact information for Harwood, who was arrested in February, was not immediately available. Spokespeople for xAI did not immediately respond to a request for comment on Wednesday. The company's lawsuit against Harwood follows intense global scrutiny of xAI over allegations that Grok has allowed users to generate non-consensual sexualized deepfakes, or realistic-looking videos fabricated by AI. xAI's complaint said that the company "enforces its rules against violators through account suspensions, account terminations, and by reporting suspected child sexual abuse material to the National Center for Missing & Exploited Children." "Indeed, Plaintiff has suspended 52,222 accounts and made 73,604 reports to NCMEC in 2026, resulting in (at least) 244 arrests," the lawsuit said. xAI alleged that Harwood uploaded non-sexual images of adults and minors to Grok and tried to use the system to generate sexually explicit deepfakes based on them. The complaint also alleged he created non-consensual sexual imagery of adults. The company asked the court for an unspecified amount of monetary damages and a court order permanently blocking Harwood from using Grok. "Defendant's actions were a calculated scheme to weaponize Plaintiff's tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage," xAI said in the lawsuit.

xAI sues man for allegedly using Grok to create child sexual abuse content and explicit images

xAI is seeking damages and a permanent court order banning the accused from using Grok. Elon Musk's AI company xAI has filed a lawsuit against the South Carolina man and accused him misusing its AI chatbot Grok to make child sexual abuse material (CSAM) and explicit deepfake images. The lawsuit, filed in a federal court in Texas, among one of the first known cases in which an AI company has taken legal action against one of its own users over the alleged creation of illegal AI-generated content. The defendant, Terry Harwood, was arrested in South Carolina in February on charges related to the sexual exploitation of minors. As per xAI's complaint, Harwood violated the company's terms of service by attempting to use Grok to create sexually explicit images involving both minors and adults. The company alleged that Harwood uploaded ordinary photos of adults and children into Grok and attempted to generate explicit AI-manipulated images based on them. xAI also claims he created non-consensual sexual content featuring adults through the platform. In its filing, xAI said that the alleged actions not only caused serious harm to victims but also exposed the company to legal and reputational risks. The company is seeking financial damages, although it has not specified an amount, along with a permanent court order preventing Harwood from accessing Grok in the future. The lawsuit comes at a time when xAI has faced growing criticism over Grok's safeguards against AI generated content. The company has previously been accused of allowing users to create non-consensual sexual deepfakes using the chatbot. As a part of filing, xAI also showcased that it actively removes users who violate its policies and reports suspected child sexual abuse material to the National Center for Missing & Exploited Children (NCMEC). As per the company, it has suspended more than 52,000 accounts and submitted over 73,000 reports to NCMEC in 2026, actions that it says have contributed to at least 244 arrests.