Meta Faces Legal Action After 350+ AI Child Abuse Ads Slip Through Safeguards on Facebook, Instagram

San Francisco Takes Legal Action Against Meta

San Francisco city attorney David Chiu issued a cease-and-desist letter to Meta, demanding the company stop allowing AI-generated child sexual abuse ads on its platforms1

1

. The letter follows an investigation by the Tech Transparency Project that uncovered more than 350 ads containing AI child abuse material running across Facebook and Instagram since late last year2

2

. "Meta has failed to address a known issue of AI-generated child sexually explicit ads, while profiting from them," Chiu stated, calling the situation "deeply disturbing" and Meta's current efforts "woefully inadequate"1

1

.

Real Children Identified in Disturbing Ads

Researchers identified images of four real minors in the child sexual abuse ads, including two teenage influencers with public social media accounts, a preteen from stock photo websites, and a member of a European royal family2

2

. The ads transformed ordinary photographs into graphic sexual videos using generative AI face-swapping apps and nudification apps. When clicked, these ads directed users to download AI image and video generation tools from Apple and Google's app stores, some capable of creating nonconsensual intimate imagery1

1

. Katie Paul, director of the Tech Transparency Project, emphasized this wasn't simply AI-generated content but involved real children's images taken from the web2

2

.

Meta's Detection Systems Failed Repeatedly

More than 250 of the 350-plus ads ran after Meta introduced new AI tools designed to better detect and block harmful content in August2

2

. The child sexual abuse ads collectively reached more than 29,000 accounts across the European Union, plus approximately 7,000 in the US, Australia, and India1

1

. Despite Meta's policy requiring all ads to be reviewed before publication, these paid advertisements slipped through content moderation systems. In some instances, Meta took over a week to review ads reported by researchers, during which time the ads accumulated hundreds of additional views1

1

. One ad involving a real teenager had reached only four European accounts when reported but had reached more than 330 accounts by the time Meta removed it3

3

.

Financial and Operational Impact

Meta generated under $5,000 in total ad spend from the 300-plus abusive ads, with most receiving fewer than 200 impressions1

1

. The company claims "no indication" the ads displayed in San Francisco, arguing they fall outside the city attorney's jurisdiction1

1

. However, Chiu's letter raises "significant legal questions" about systemic failures in Meta's advertising and child safety operations. The cease-and-desist demands Meta explain how ads evaded moderation, detail reporting procedures to NCMEC, and address repeat offenders within 28 days1

1

.

Broader Pattern of AI-Generated Child Exploitation

A separate Futurism investigation uncovered hundreds of Facebook accounts uploading AI-generated videos depicting violent child abuse, including scenes of children being beaten, burned, and subjected to various forms of cruelty4

4

. These videos, generated with cutting-edge AI technology, attracted thousands of reactions from users who often appeared unaware the content was synthetic. Meta's spokesperson stated the company has "strict rules against content that depicts physical harm to children -- whether it's real or AI-generated" but declined to comment on proactive removal strategies4

4

. The investigation suggests the supply of such content appears endless, with creators uploading material as fast as it can be identified.

Implications for Child Safety and Platform Accountability

Researchers reported all discovered ads to NCMEC's CyberTipline and are consulting on appropriate disclosure to affected individuals2

2

. The ads promoted nearly 50 apps available through Apple's App Store and Google's Play Store, with around 300 ads directing users toward AI image or video generators3

3

. Apple removed 17 of 20 identified apps, noting some developers initially submitted compliant versions before adding prohibited nudification capabilities3

3

. Emma Hardy from the Internet Watch Foundation warned that "AI apps are making it far too easy to create realistic criminal imagery of child sexual abuse, creating the new risk of everyday photos of children being taken and transformed into sexual content"3

3

. The San Francisco letter emphasizes that "isolated takedown efforts are woefully inadequate" and demands Meta implement systems preventing child exploitation through paid advertisements1

1

.