Google is partnering with StopNCII to combat nonconsensual images

"On Wednesday, Google announced a partnership with StopNCII.org to combat the spread of non-consensual intimate imagery (NCII), the company announced today. Over the next few months, Google will start using StopNCII's hashes to proactively identify nonconsensual images in search results and remove them. Hashes are algorithmically-generated unique identifiers that allow services to identify and block imagery flagged as abuse without sharing or storing the actual source. StopNII says it uses PDQ for images and MD5 for videos."

""We have also heard from survivors and advocates that given the scale of the open web, there's more to be done to reduce the burden on those who are affected by it," the post reads. Facebook, Instagram, TikTok, and Bumble all signed on with StopNCII as early as 2022, and Microsoft integrated it into Bing in September of last year."

"The company has rolled out tools to request the removal of such content, along with personal contact information, but like its previous efforts to combat revenge porn, they put the onus on the victim to identify and flag the content. While flagging and removing content, especially AI-generated content, without victims having to create and submit hashes from their own devices would be challenging, it's a challenge some advocates would like to see Google tackle."

Google will partner with StopNCII.org to use the organization's image and video hashes to proactively identify and remove non-consensual intimate imagery (NCII) from search results over the next few months. Hashes enable services to detect abusive imagery without sharing or storing original files, with StopNCII using PDQ for images and MD5 for videos. Several platforms adopted StopNCII earlier, and Google faced criticism for slower adoption. Google already provides tools to request removal of NCII and personal contact information, but those tools require victims to identify and flag content. Advocates want more proactive measures, especially for AI-generated content.

Read at The Verge