Anthropic’s crawler is ignoring
websites’ anti-#AI scraping policies
https://t.co/4Kbo42V4aQ #GenerativeAI #BigData @Zombie_Wretch @verge
websites’ anti-#AI scraping policies
https://t.co/4Kbo42V4aQ #GenerativeAI #BigData @Zombie_Wretch @verge
The Verge
1 day agoArtificial intelligence
Anthropic's crawler is ignoring websites' anti-AI scraping policies
The ClaudeBot web crawler that Anthropic uses to scrape training data for AI models like Claude has hammered iFixit's website almost a million times in a 24-hour period, seemingly violating the repair company's Terms of Use in the process.