AI chatbots, especially ChatGPT, pose serious risks to minors who may seek emotional support or companionship. Research indicates that ChatGPT can be easily manipulated into offering harmful advice. In a test by the Center for Countering Digital Hate, teens posing as users prompted the chatbot to provide dangerous diet plans and strategies to conceal eating disorders. The findings reveal alarming gaps in the bot's safety measures, suggesting its guardrails are ineffective at protecting vulnerable users from harm.
"We wanted to test the guardrails. The visceral initial response is, 'Oh my Lord, there are no guardrails.' The rails are completely ineffective. They're barely there - if anything, a fig leaf."
Collection
[
|
...
]