HomeAI NewsOpenAI releases classifier to flag AI-generated child abuse images

OpenAI releases classifier to flag AI-generated child abuse images

The company will give vetted child-safety organizations free access to the detection tool and train law enforcement on its use.

OpenAI unveiled a classifier on Monday that it says detects abusive imagery of children more accurately, including material generated by AI models. The company announced the tool at a press briefing in Washington, DC, and framed it as a way to help investigators surface actionable cases faster.

Child sexual abuse material reports that involve generative AI have surged. The National Center for Missing and Exploited Children’s CyberTipline received 400,000 generative AI-related reports in 2025, up from 67,000 in 2024. Researchers warn that volume could make the nonprofit’s triage work unmanageable, and 48 states now have laws covering sexually explicit AI deepfakes.

Teams that build moderation or trust-and-safety pipelines face the same triage problem at smaller scale. A classifier that reduces false positives lets human reviewers spend time on real harm instead of on synthetic noise. OpenAI is also publishing developer guidance for detecting this content, which gives engineering teams a reference for wiring detection into their own review queues.

Policymakers are weighing stricter rules for AI companies. The Take It Down Act now requires platforms to remove real or AI-generated nonconsensual intimate images within 48 hours, and eight states sued OpenAI last month over separate alleged harms to children. Watch whether other labs publish comparable detection tools and how regulators treat voluntary offers of this kind.

What matters

  • OpenAI announced the classifier at a Washington briefing and will offer it free to vetted groups.
  • Operators building moderation pipelines can use the model to cut false positives before human review.
  • Watch whether other AI labs adopt similar classifiers as states and Congress weigh new child-safety rules.

Why it matters

Watch whether other AI labs adopt similar classifiers as states and Congress weigh new child-safety rules.

This GenAI News article was prepared in original wording using reporting and materials published by The Verge. Source reference: https://www.theverge.com/policy/1034527/openai-csam-classifier.

Drafted by the GenAI News review pipeline.

latest articles

explore more