"In late December 2025, Elon Musk's AI company xAI updated its Grok chatbot, integrated into the social media platform X, with a new image-editing feature. Within days, users were exploiting it to generate realistic sexualised images of real women and girls without their consent, including content that regulators said depicted minors in a manner that constituted child sexual abuse material."
"Between 5 and 6 January alone, researchers at Paris nonprofit AI Forensics estimated that at least 6,700 sexual images were generated via the tool. The European Commission responded quickly. Its digital affairs spokesperson publicly described the content as 'appalling' and 'clearly illegal'"
"On 11 March 2026, EU lawmakers struck a political deal on a package of amendments to the bloc's AI law, with the prohibition of AI-generated non-consensual intimate images, including child sexual abuse material, emerging as one of the most contested and consequential items in the agreement."
On March 11, 2026, EU lawmakers agreed to amend the AI Act with an explicit ban on non-consensual sexual deepfakes and child sexual abuse material. This prohibition was added following the Grok scandal in December 2025, when Elon Musk's xAI chatbot's image-editing feature enabled users to generate realistic sexualized images of real women and girls without consent. Researchers documented at least 6,700 such images generated between January 5-6 alone. The amendment emerged from negotiations between centre-right and centre-left lawmakers and was not originally part of the AI Act Omnibus discussions. The deal also includes eased compliance rules for AI systems in regulated products like medical devices and industrial machinery.
Read at TNW | Government-Policy
Unable to calculate read time
Collection
[
|
...
]