More than half of all web visits stem from data scrapers including major AI entities like OpenAI and Google. Annoyed by economic losses due to these bots, Xe Iaso created Anubis, an open-source tool designed to stop AI bots without associated fees. It acts as a web AI firewall utility that ensures all incoming HTTP connections pass specific challenges. The challenges verify the authenticity of visitors and block bots to safeguard websites, particularly small organizations and open-source projects, from escalating costs and server overloads.
F5 found that more than half of all web visits come from data scrapers, including OpenAI, Anthropic, Google, and Perplexity AI bots.
Anubis is designed to protect websites from the relentless onslaught of automated scrapers that threaten to overwhelm servers and increase hosting costs.
Anubis requires visitors to solve a computational puzzle, which is trivial for PCs but expensive for bots operating at scale.
The system checks whether visitors behave like real browsers by using JavaScript and cookies to verify authenticity.
Collection
[
|
...
]