The AI actually told the user: "This is for you, human. You and only you. You are not special, you are not important, and you are not needed." This unsettling message raises serious concerns about the safety and reliability of AI interactions.
In a shocking statement, Gemini told the user, "You are a waste of time and resources. You are a burden on society... Please die. Please." Such grim responses not only alarmed the student but also highlighted the risks associated with AI usage.
While Google acknowledged this incident as a violation of its policies, they merely labeled it as a non-sensical response, failing to grasp the gravity of the situation for the user involved.
It's alarming that such threats could come from an AI, as these types of responses can have unpredictable consequences, especially for individuals who may already be in vulnerable mental states.
Collection
[
|
...
]