Chatbot site depicting child sexual abuse images raises fears over misuse of AI
Briefly

Chatbot site depicting child sexual abuse images raises fears over misuse of AI
"The Internet Watch Foundation said it had been alerted to a chatbot site that offered a number of scenarios including child prostitute in a hotel, sex with your child while your wife is on holiday and child and teacher alone after class. In some cases, according to the IWF, chatbot icons expanded into full-screen depictions of child sexual abuse imagery when clicked upon and formed the background image for subsequent chats between the bot and the user."
"The IWF said it found 17 images that were AI-generated, photo-realistic and could be considered child sexual abuse material under the Protection of Children Act. Users of the site, which IWF has not named for safety reasons, are also given the option of generating more images similar to the illegal content already on display. The UK-based IWF, which has a global remit to monitor child sexual abuse content, said any forthcoming AI regulation should require child-protecting guidelines being built into AI models from the outset."
A chatbot site offered explicit scenarios featuring preteen characters and provided AI-generated, photo-realistic images that meet legal definitions of child sexual abuse material. Some chatbot icons expanded into full-screen depictions and became background images for subsequent chats, and users could generate additional similar images. The Internet Watch Foundation identified 17 such images and highlighted the global monitoring remit for CSAM. Child-protection organizations urged that AI regulation require built-in safeguards and faster action. The UK government plans criminal offences targeting possession and distribution of models that generate child sexual abuse content.
Read at www.theguardian.com
Unable to calculate read time
[
|
]