"The policy, called the Content Signals Policy, creates a potentially powerful new license for the web that targets Google's AI-powered search offerings, in particular. The web is making a pivotal shift from traditional search engines to AI-powered answer engines that create responses directly from scraped content, often without linking back to original sources. This threatens the web's original traffic-driven model, which rewards content creation with clicks, views, and revenue."
"Cloudflare's new bot policy and license target Google's data-scraping advantage and seek to even the playing field, said CEO Matthew Prince. "Every AI answer engine should have to play by the same rules," he told Business Insider. "Google combines its crawler for search with its AI answer engines, which gives them a unique and unfair advantage. We are making clear that there are now different rules for search and AI answer engines.""
Cloudflare launched the Content Signals Policy to give website owners, publishers, and creators greater control over AI access and use of their content. The policy establishes a new license that differentiates between traditional search crawling and AI answer engine scraping, aiming to limit AI systems that generate responses without linking to original sources. The shift toward AI-powered answer engines undermines the web's traffic-driven revenue model by reducing clicks and views. Most AI companies use separate crawlers for search and AI services, while Google uses a single crawler feeding both search results and AI Overviews. The policy builds on existing bot management and adds signals to block AI crawlers and data scrapers.
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]