Google & Bing Head To Dublin's IETF Event To Improve Crawling & AI Controls
Briefly

Gary Illyes and John Mueller from Google, alongside Bing's Fabrice Canel, discussed at the IETF 121 meeting potential improvements to the Robots Exclusion Protocol, focusing particularly on AI control.
Fabrice Canel submitted a proposal on extending the Robots Exclusion Protocol with specific rules that govern the usage of content in the context of Artificial Intelligence, aiming to adapt to current technological needs.
The Robots Exclusion Protocol User Agent Purpose Extension proposed by Gary Illyes aims to enhance targeting of automatic clients based on their intent, improving the current RFC9309 standards.
Read at Search Engine Roundtable
[
|
]