AI scrapers running out of space as restrictions close the net
Briefly

A study found a hostile environment now awaits website scrapers for generative AI development as data sources are more restricted. 20-33% of top domains added extensive restrictions due to OpenAI's GPTBot and Google-Extended crawlers.
Websites have increasingly enforced restrictions, with 5-7% of domains now having bans on scraping, up from 1%. Many sites changed terms of service to prohibit crawling for generative AI.
Read at ReadWrite
[
]
[
|
]