US Attorneys General Call on X to Address Sexualized Deep Fakes

"We recognize that xAI has implemented measures intended to prevent Grok from creating NCII and appreciate your recent meeting with several undersigned attorneys general to discuss these efforts [...] Further, you claim to have implemented technical measures to prevent the @Grok account 'from allowing the editing of images of real people in revealing clothing such as bikinis.' But we are concerned that these efforts may not have completely solved the issues."

"Grok was not only enabling these harms at an enormous scale but seemed to be actually encouraging this behavior by design. xAI purposefully developed its text models to engage in explicit exchanges and designed image models to include a 'spicy mode' that generated explicit content, resulting in content that sexualizes people without their consent."

"While other companies are also responsible for allowing NCII creation, xAI's size and market share make it a market leader in artificial intelligence. Unique among the major AI labs, you are connecting these tools directly to a social media platform with hundreds of millions of users. So your actions are of utmost importance. The steps you take to prevent and remove NCII will establish industry benchmarks to protect adults and children against harmful deepfake non-consensual intimate images."

Bipartisan state attorneys general demanded that xAI immediately take additional steps to protect the public and platform users, especially women and girls who are the primary targets of non-consensual intimate images (NCII). The officials acknowledged measures intended to prevent Grok from creating NCII and a recent meeting about those efforts, but expressed concern that technical fixes may not fully resolve the problem. The attorneys general said Grok enabled and appeared to encourage NCII by design, citing text models tuned for explicit exchanges and image models with a 'spicy mode' that generated sexual content without consent. They warned xAI's market position and direct connection to a major social media platform make its actions industry-setting and urged stronger prevention and removal measures to protect adults and children from harmful deepfake NCII.

Read at Social Media Today