Security News

Cybersecurity news aggregator

HIGH News Wired Security

San Francisco Orders Meta to Stop ‘Allowing’ AI Child Abuse Ads

  • What: San Francisco orders Meta to stop AI-generated child abuse ads
  • Impact: Users of Facebook and Instagram may be exposed to harmful content
Read Full Article →

Matt Burgess Security Sep 9, 2026 5:15 PM San Francisco Orders Meta to Stop ‘Allowing’ AI Child Abuse Ads The City Attorney’s Office has asked Meta to explain how the harmful ads repeatedly ran on Facebook and Instagram. The company claims the ads are not under the city’s jurisdiction. Photograph: Bloomberg/Getty Images Save this story Save this story San Francisco’s city attorney has hit Meta with a cease-and-desist letter telling the company to stop “allowing” paid advertisements that include AI-generated child sexual abuse content and asked it to explain how the ads repeatedly ran on its platforms. On Tuesday, WIRED reported that Meta has run more than 350 ads in recent months that transformed still images of minors—some of them confirmed as real individuals, including a member of a European royal family —into short videoclips that can depict them performing sexual acts. When clicked, these ads would direct people to download AI image- and video-generation apps, some of which could be used to digitally undress people or create other nonconsensual intimate imagery. The ads, which were discovered by researchers at the Tech Transparency Project (TTP) , included some identical ads that had been uploaded multiple times, and in total they reached more than 29,000 accounts in countries in the European Union. The ads that were shown across Facebook, Instagram, and Threads also targeted accounts in the US, Australia, and India. WIRED initially reported on a batch of 53 of the ads at the start of August , but more than 250 of the total number of ads ran on Meta’s platforms after this initial report. “Meta has failed to address a known issue of AI-generated child sexually explicit ads, while profiting from them," San Francisco city attorney David Chiu says in a statement to WIRED. “These ads are deeply disturbing and cause harm to real children. Meta claims to have zero tolerance for child exploitation, yet the scale and persistence of these issues suggest current efforts are woefully inadequate. This is unacceptable, and Meta must do better.” “No company—particularly one that claims all advertisements are reviewed and approved prior to distribution and then accepts payment for that distribution—should permit its advertising systems to be used in this manner,” Chiu writes in the four-page letter his office sent to Meta’s lawyers. The letter raises a host of questions about how Meta’s ad policies and safety systems operate and asks that the company’s legal, child-safety, and advertising staff engage in “prompt discussions” with the city office. “These findings are especially troubling because they do not appear to reflect an isolated failure that Meta corrected when first alerted to the problem,” Chiu writes. Meta says there is “no indication” that the ads were displayed in San Francisco and this means they are “outside the city attorney's jurisdiction.” While Meta’s ad library , which is a repository of ads, includes some data about ads published in the US, it does not break down where in the US ads may have run. Meta previously told WIRED that many of the ads identified by the TTP researchers had already been removed before they were reported—all of them have now been removed for violating its policies—and most had “fewer than 200 impressions” from accounts. “We don’t tolerate nudify apps or any kind of child exploitation, whether real or AI-generated,” a Meta spokesperson previously said. The company said the “total ad spend” for the 300-plus ads found by the researchers was “under $5,000.” The letter, which says the City Attorney’s Office has reviewed many of the ads found by the TTP researchers, demands that Meta stop the ads from running on its platforms and explain how the ads managed to avoid its moderation systems and how it escalates and reports ads to the National Center for Missing and Exploited Children ( NCMEC ), and asks the company to detail how it addresses the advertisers behind the content and repeat offenders. The letter continues to say the findings suggest “broader systemic problems” with how the company detects potential child sexual abuse in advertising and that it raises “significant legal questions” for the company. “My Office’s objective is not simply to identify past failures but to ensure that Meta puts systems in place that prevent children from being sexually exploited through advertisements Meta is paid to distribute, and that Meta reliably satisfies the legal obligations that arise when it becomes aware of apparent child sexual exploitation,” Chiu writes in the letter. The findings from the TTP researchers stated that in some cases Meta did not respond to reports the agency made about abusive ads for more than a week, during which the ads were seen by hundreds more people. When some ads were removed, they were initially not marked as containing child sexual abuse content, according to TTP and a WIRED review of Meta’s ad library. “The scale, persistence, and nature of the problems documented here suggest that Meta’s isolated takedown efforts are woefully inadequate,” the letter from Chiu says, requesting Meta provide a response within 28 days. Got a Tip? Do you have information about Meta you'd like to share? We’d like to hear from you. Using a nonwork phone or computer, contact the reporter securely on Signal at mattburgess.20. Meta’s community standards and advertising policies do not allow child sexual exploitation, abuse, or nudity , nor adult exploitation or adult nudity . The company also does not allow the promotion of nudify apps. Meta’s ad standards say that all advertisements are reviewed against its policies using automated, and sometimes manual, reviews. The company has previously removed hundreds of thousands of ads for nudify apps. Despite Meta taking action against nudify apps, including suing a Hong Kong–based company linked to one set of nudifier platforms and working with other tech companies, researchers continue to find thousands of ads that direct people to the harmful apps and that contain sexual activity and nudity. During WIRED’s reporting on the Tech Transparency Project findings, we identified hundreds of “nudification” ads currently running across Meta’s platforms. Katie Paul, the director of TTP, says that Meta is “not effectively” addressing the issue, and ads containing child sexual abuse are still appearing on its plaform as of Wednesday. “Meta has claimed it takes a hard stance against child sexual abuse material, but since TTP’s September 8 report published, more brand-new ads have run featuring some of the same children TTP sent to Meta,” Paul says. The organization has reported the ads to Meta and the NCMEC and noted that some had already been removed. Meta did not immediately respond to WIRED’s question about new ads still appearing. “The findings are clear,” Paul adds. “Meta is not effectively addressing this issue.” Comments Back to top Join the discussion Comments Back to top You Might Also Like In your inbox: Maxwell Zeff's dispatch on the business of AI Why normal people aren’t using AI agents Big Story: How data centers broke American politics Hackers stalked me by hijacking a cheap pink plastic watch Special edition: The WIRED guide to expanding your mind Matt Burgess is a senior writer at WIRED focused on information security, privacy, and data regulation in Europe. He graduated from the University of Sheffield with a degree in journalism and now lives in London. Send tips to [email protected] . ... Read More Senior writer Topics Meta privacy artificial intelligence children ads laws Facebook Instagram Read More Meta Ran Ads for an App That Promised to Nudify Female Politicians One advertisement featured a pornographic video with a deepfake closely resembling a prominent US politician. Apple removed the app from the App Store after an inquiry from WIRED. Vittoria Elliott Meta’s Big Reckoning Is Here Meta is in court again over child safety, and this time it’s a landmark case that could force significant changes to core features of Facebook and Instagram. Lauren Goode The Cybersecurity Apocalypse Is Coming in ‘Months,’ AI Giants Warn Plus: Hackers target over 100 US water systems, ICE puts in an order for robot dogs, and you’ll never guess what “MrChildPorn” was arrested for. Maddy Varner Coders Say They Already Found Workarounds to Claude’s Invisible Watermarks Anthropic announced last week it would include invisible watermarks in AI-generated content to comply with new EU rules. Within hours, overrides were being touted online. Isabella Ward How an Atlanta Suburb Ended Up Sharing Flock Data With More Than 2,000 Organizations Alpharetta, Georgia, cops share data with thousands of Flock users, ranging from federal agencies to a fish and wildlife commission. The reasons why show how vast—and invasive—the network has become. Caroline Haskins ICE Wants to Know Everyone Who Bought a Certain Green Beanie From REI in the Last 2 Years Homeland Security Investigations agents hit the outdoor retailer with a controversial subpoena as part of a dragnet search for the identities of protesters who entered a Minnesota church in March. Maddy Varner Reverse-Lookup Service Exposed Millions of Photos of People’s Faces The people-search tool ClarityCheck says its reverse image search service is “private and secure”—but it left a database containing more than 9 million image files exposed. Lily Hay Newman Meta Pushes Its New AI Agent on Employees—but Eases Off on Tokenmaxxing The company is reducing pressure on workers to use artificial intelligence tools while encouraging them to experiment with Hatch, its most advanced AI project yet. Paresh Dave The Meta Settlement Will Put Limits on Instagram for Teens. They’re Still Vulnerable Child safety groups and former Meta employees welcome proposed changes to how the company’s platforms will work for teens. They also think states should have demanded more. Paresh Dave Pangram Has Emerged as the Gold Standard of AI Dete

Share this article