Apple updated its Applebot documentation to clarify the distinction between its standard crawler and the Applebot-Extended crawler, which has existed for over a year. The documentation emphasizes that while publishers can block Applebot-Extended from using their content to train AI models by updating their robots.txt file, blocking it does not stop standard Applebotâs access. Content might still be used for services like Spotlight and Siri, and publishers should understand these nuances to manage their web presence better with Apple.
Applebot-Extended is not new; the documentation clarifies its differentiation from standard Applebot, highlighting its role in AI and ensuring publishers understand crawl permissions.
Blocking Applebot-Extended does not completely prevent Applebot from accessing content, which can still inform services like Spotlight and Siri across Apple devices.
Collection
[
|
...
]