Google Clarified Support For Robots.txt FieldsGoogle clarified robots.txt documentation to address frequent questions about unsupported fields and ensure proper crawling of websites.