"In a change discovered in November by e-commerce analyst Juozas Kaziukėnas on LinkedIn, Amazon has set up new rules to restrict OpenAI's web crawlers from crawling the retail site. Specifically, the two latest rules now in effect stop ChatGPT from browsing Amazon's site when you ask a question or when you run a web search, Kaziukėnas said."
"Looking at Amazon's robots.txt file , which provides instructions to web crawlers, the two new rules are clearly visible. One is for "User-agent: ChatGPT-User" and the other for "User-agent: OAI-SearchBot." Both are marked Disallow, meaning that these particular web crawlers are restricted from accessing the Amazon store site."
"These latest rules follow a prior one in which Amazon restricted ChatGPT from using its site to train its AI models, according to Kaziukėnas. Also found in the robots.txt file, this one for "User-agent: GPTBot" is likewise set to Disallow. Collectively, these rules affect a couple of ChatGPT bots."
Amazon has added Disallow rules to its robots.txt for user agents including ChatGPT-User, OAI-SearchBot, and GPTBot. Those rules prevent those ChatGPT-related crawlers from accessing and indexing the Amazon storefront and from using Amazon pages to train AI models. The change was identified in November by e-commerce analyst Juozas Kaziukėnas. The new restrictions stop ChatGPT from browsing Amazon during user queries or web searches and may remove Amazon links from ChatGPT search results. Amazon appears motivated to protect retail revenue from AI bots that could divert traffic from the site.
Read at ZDNET
Unable to calculate read time
Collection
[
|
...
]