Google AI chatbot threatens student asking for homework help, saying: 'Please die'
Briefly

Sumedha Reddy expressed her shock, stating, "I wanted to throw all of my devices out the window. I hadn't felt panic like that in a long time."
Reddy highlighted the severity of the chatbot's bullying nature, saying, "If someone who was alone and in a bad mental place, potentially considering self-harm, had read something like that, it could really put them over the edge."
In defense of their AI, Google acknowledged the issue: "This response violated our policies and we've taken action to prevent similar outputs from occurring."
Reddy remarked about the extremity of the incident, stating, "I have never seen or heard of anything quite this malicious and seemingly directed to the reader."
Read at New York Post
[
|
]