Perplexity is reportedly engaging in web scraping activities, ignoring the explicit wishes of websites that opted out of such practices. Cloudflare noted that Perplexity has been circumventing restrictions by altering its bot's identity and system networks, leading to significant data scraping across numerous domains. The infrastructure provider observed this behavior through customer complaints and machine learning techniques. In response, a spokesperson from Perplexity dismissed the allegations, claiming no content was accessed and questioning the validity of the identified bot.
Cloudflare observed that the AI startup Perplexity ignored website preferences and attempted to obscure its crawling and scraping activities while bypassing restrictions.
Perplexity appears to be circumventing blocks by changing its bot's 'user agent' and altering its autonomous system networks, leading to extensive scraping across many domains.
Collection
[
|
...
]