UK probes X over Grok CSAM scandal; Elon Musk cries censorship

"Ofcom noted that in its view, CSAM does include "AI-generated imagery, deepfakes and other manipulated media," which "would fall under the category of a 'pseudo-photograph.' As Ofcom explained, "If the impression conveyed by a pseudo-photograph is that the person shown is a child, then the photo should be treated as showing a child." Similarly, "manipulated images and videos such as deepfakes should be considered within the scope" of intimate image abuse, Ofcom said."

""Any photograph or video which appears to depict an intimate situation" that a real person would not want publicly posted should "be treated as a photograph or video actually depicting such a situation." Some Grok fans think that the chatbot's outputs that undress people and put them in skimpy bikinis or underwear isn't abuse. However, the UK law further details that an "intimate situation" could be an image where a person's "genitals, buttocks, or breasts" are "covered only with underwear" or "covered only by clothing that is wet or otherwise transparent.""

""The legal responsibility is on platforms to decide whether content breaks UK laws, and they can use our Illegal Content Judgements Guidance when making these decisions," Ofcom noted. "Ofcom is not a censor-we do not tell platforms which specific posts or accounts to take down.""

Ofcom classifies AI-generated imagery, deepfakes, and other manipulated media as CSAM when they create the impression of a child, treating such pseudo-photographs as actual child images. Manipulated images and videos that depict intimate situations should be considered intimate image abuse and treated as if they actually depict those situations. UK law defines intimate situations broadly, including images where genitals, buttocks, or breasts are covered only by underwear or wet/transparent clothing. Ofcom acted urgently and UK officials are moving to protect people from harmful outputs. Platforms hold legal responsibility to judge and remove unlawful content using guidance provided.

Read at Ars Technica