Fake AI Content About the Iran War Is All Over X

"Grok repeatedly misidentified the location and date for the video, which was originally shared on X by an Iranian state-owned media outlet on Sunday. Then, the chatbot tried to prove its point by sharing an AI-generated image. 'Now Grok is replying with AI slop of destruction,' Hagin wrote in response. 'Cooked I tell you.'"

"The proliferation of easy-to-access AI image- and video-generation tools has led to increasingly sophisticated fake content. One image of a US B-2 bomber being shot down by Iran with US troops detained was viewed over a million times before it was deleted, while images of members of Delta Force being captured by Iranian authorities were viewed over 5 million times before they were deleted."

"As the conflict has continued, the flood has only gotten worse. In recent days, it's been supercharged by AI images and videos, while Grok has repeatedly given false information when asked to verify claims made on the platform. AI images are being shared by paid accounts bearing blue checkmarks and Iranian officials seeking to portray exaggerated damage."

Since the US and Israel began their attack on Iran on February 28, X has experienced a massive surge in disinformation. The platform is overwhelmed with fake and repurposed videos, AI-generated images, and false content shared by both regular accounts and verified blue checkmark accounts, including Iranian officials. Grok, Elon Musk's AI chatbot, has repeatedly failed to verify claims, misidentifying locations and dates while sometimes responding with AI-generated images. Sophisticated AI image and video generation tools have made fake content increasingly realistic and difficult to distinguish from authentic footage. Some fabricated content, such as images of US military personnel being captured or B-2 bombers being shot down, accumulated millions of views before deletion.

Read at WIRED