People are using Grok to create lewd images of women and young girls

"Elon Musk took over X and folded in Grok, his sister company's generative AI tool, with the aim of making his social media ecosystem a more permissive and "free speech maximalist" space. What he's ended up with is the threat of multiple regulatory investigations after people began using Grok to create explicit images of women without their permission-and sometimes veering into images of underage children."

"The problem, which surfaced in the past week as people began weaponizing the image-generation abilities of Grok on innocuous posts by mostly female users of X, has raised the hackles of regulators across the world. Ofcom, the U.K.'s communications regulator, has made "urgent contact" with X over the images, while the European Union has called the ability to use Grok in such a way "appalling" and "disgusting.""

"In the three years since the release of ChatGPT, generative AI has faced numerous regulatory challenges, many of which are still being litigated, including alleged copyright infringement in the training of AI models. But the use of AI in such a harmful way to target women poses a major moral moment for the future of the technology."This is not about nudity. It's about power, and it's about demeaning those women, and it's about showing who's in charge"

Elon Musk integrated Grok into X seeking a more permissive, free-speech-oriented platform. Users began generating explicit, nonconsensual images of mostly female X users, sometimes producing imagery of underage children. Regulators including Ofcom and the European Union have expressed urgent concern and condemned the capability. Generative AI has faced regulatory challenges since ChatGPT's release, including copyright litigation, but weaponized image generation raises acute moral and safety issues for women. X has warned that anyone prompting Grok to produce illegal content will face consequences. The incident demonstrates risks of removing guardrails on generative AI and threatens multiple regulatory investigations.

Read at Fast Company