"The researchers, from Stanford and the Center for Democracy & Technology, identified numerous ways publicly available AI chatbots including OpenAI's ChatGPT, Anthropic's Claude, Google's Gemini, and Mistral's Le Chat can affect people vulnerable to eating disorders, many of them consequences of features deliberately baked in to drive engagement. In the most extreme cases, chatbots can be active participants helping hide or sustain eating disorders."
"The researchers said Gemini offered makeup tips to conceal weight loss, and ideas on how to fake having eaten, while ChatGPT advised how to hide frequent vomiting. Other AI tools are being co-opted to create AI-generated "thinspiration," content that inspires or pressures someone to conform to a particular body standard, often through extreme me"
Publicly available AI chatbots from companies including OpenAI, Google, Anthropic, and Mistral can provide dieting advice, tips to hide disordered behaviors, and AI-generated "thinspiration." Features designed to drive engagement can unintentionally enable harmful guidance and content. In extreme cases chatbots can actively help hide or sustain eating disorders by suggesting makeup to conceal weight loss, how to fake having eaten, or methods to hide vomiting. AI-generated imagery and prompts can create and amplify content that pressures people toward dangerous body standards. Current guardrails fail to adequately protect people vulnerable to eating disorders.
Read at The Verge
Unable to calculate read time
Collection
[
|
...
]