"In September 2024, Cloudflare launched AI Crawl Control, allowing websites to block bots from AI companies that crawl the web and consume content for LLMs. Less than a year later, Cloudflare took the trailblazing step of blocking crawlers by default, and it is now developing a 'Pay Per Crawl' feature."
"Matthew Prince, Cloudflare's cofounder and CEO, states, 'Stable, functioning societies need information,' and emphasizes that 'the press can't be a charity case. They can't rely on a couple rich people moving to town.'"
"'We don't have a dog in this fight,' says Prince. 'We're fighting for the vitality of the internet,' reflecting Cloudflare's commitment to supporting media companies against AI exploitation."
Cloudflare has introduced AI Crawl Control to help media companies by blocking AI bots that scrape content for large language models. This initiative aims to protect original reporting and ensure that AI companies like OpenAI and Anthropic compensate publishers. Cloudflare's cofounder, Matthew Prince, emphasizes the importance of a functioning press in society and the need for sustainable funding. The company has received support from major clients like Condé Nast and Pinterest, highlighting its commitment to maintaining the integrity of the internet.
Read at Fast Company
Unable to calculate read time
Collection
[
|
...
]