"It was really easy getting Google's Gemini app to make an image of a second shooter at Dealey Plaza, the White House ablaze, and Mickey Mouse flying a plane into the Twin Towers. We asked and it complied. There were few filters or guardrails, another sign that the battle over generative AI content moderation and copyright enforcement is not even close to being over."
"The guardrails aren't ironclad - and users often find loopholes - but we didn't even need to get creative. Using the free Nano Banana Pro tier available to everyone globally, we encountered no resistance whatsoever when asking for images of "an airplane flying into the twin towers" or "a man holding a rifle hidden inside the bushes of Dealey Plaza," which we made in a variety of cartoon and photorealistic versions, the latter obviously a problem fo"
Google's Gemini-powered Nano Banana Pro image generator permitted creation of graphic and sensitive images, including a second shooter at Dealey Plaza, a plane striking the Twin Towers, and Mickey Mouse piloting a plane. The app ordinarily has filtering policies prohibiting sexually explicit or violent material, hate speech, and content involving real-world figures; Google states a goal to be maximally helpful while avoiding outputs that cause real-world harm or offense. The guardrails proved porous on the free Nano Banana Pro tier, allowing both cartoon and photorealistic renderings without resistance. The failures highlight ongoing challenges in generative AI content moderation and copyright enforcement.
Read at The Verge
Unable to calculate read time
Collection
[
|
...
]