The state's top attorney said Grok, an AI tool and image generator made by Musk's company xAI, appears to be making it easy to harass women and girls with deepfake images on X and elsewhere online. The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking, California attorney general, Rob Bonta, said in a statement. I urge xAI to take immediate action to ensure this goes no further.
Grok, the xAI chatbot, includes image-generation features that allow users to morph existing photos into new images. The newly created images are then posted publicly on X. In some cases, users have created sexually explicit or nonconsensual images based on real people, including altered depictions that appear to show individuals partially or fully undressed. Others have generated images that appear to show minors, prompting criticism that there are not sufficient guardrails to prohibit the creation of child pornography.