AI crawlers are hammering sites and nearly taking them offlineWeb crawlers, particularly from AI companies, are causing significant disruptions to website performance and prompting many sites to implement restrictions.