ProductsMedium importance
OpenAI offers for free a classifier that detects child sexual abuse images, including AI-generated ones
OpenAI launched an image classifier to detect child sexual abuse material (CSAM), including manipulated or AI-generated images, developed with help from NCMEC, the US National Center for Missing and Exploited Children. It is free for approved organizations, such as platform trust and safety teams, NGOs and law enforcement, and gives two risk scores, one for suspected CSAM and another for possibly AI-generated CSAM, to prioritize human review. According to the model card, published on 11/16, in offline tests the CSAM score had 99.1% precision and 80.2% recall; on real ChatGPT traffic, precision fell to 29.8%. OpenAI says the score alone does not determine whether an image is illegal and that human review remains necessary.
Published in edition no. 35 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese
Original source
https://www.medianama.com/2026/11/223-openai-image-classifier-csam-images/