Websites are Blocking the Wrong AI Scrapers
Briefly

This is an example of 'how much of a mess the robots.txt landscape is right now,' the anonymous operator of Dark Visitors told 404 Media.
The ecosystem of agents is changing quickly, so it's basically impossible for website owners to manually keep up. For example, Apple (Applebot-Extended) and Meta (Meta-ExternalAgent) just added new ones last month and last week, respectively.
Read at 404 Media
[
]
[
|
]