"My journey on TikTok Shop started out with a search for "hip hop jewelry." It's an innocuous search query multiple users have likely typed in, hoping to find something to wear. While browsing the cheap jewelry, I was struck by what TikTok's algorithm repeatedly suggested that I might also be interested in: jewelry with blatant Nazi symbolism. TikTok continues to struggle with moderation as its in-app ecommerce store gains traction with younger users."
"Despite TikTok removing that necklace, my investigation into TikTok Shop uncovered an algorithmic web of far-right product search suggestions that nudged me toward white nationalist and Nazi-related terms. In the dedicated shopping tab on TikTok, I looked for products to buy and followed what the algorithm recommended to me in the "Others searched for" boxes. This recommendation box sometimes appears in TikTok's mobile app as a set of four related search suggestions, each with a picture, as users look for products and scroll through what's available on TikTok Shop."
A search for hip hop jewelry on TikTok Shop led to repeated algorithmic suggestions of jewelry featuring Nazi symbolism. An on-sale swastika necklace labeled "hiphop titanium steel pendant" appeared in recommendations and was promoted as an $8 on-sale item before being removed amid user outrage. TikTok Shop's shopping tab displays an "Others searched for" recommendation box that can surface related search suggestions and images, which in these cases nudged users toward white nationalist and Nazi-related terms. A TikTok spokesperson confirmed that such algorithmic suggestions violate company policies and said the company is working to remove them.
Read at WIRED
Unable to calculate read time
Collection
[
|
...
]