"Knowing which bot is responsible for which task is essential before attempting to disallow it. GPTBot locates information to build and update training data, ChatGPT's knowledge base for providing answers. ChatGPT doesn't store training URLs or track where the info comes from. Disallowing this bot will prevent the platform from using your content for training, but it won't impact your traffic. It may affect what ChatGPT understands about your company, though external sources likely provide that information, too."
"OAI-SearchBot searches the web for current information, user reviews, product details, and more. Opinions differ as to whether the platform indexes the URLs from these searches. (ChatGPT states it "uses a hybrid system that includes limited indexing, plus on-demand retrieval, rather than a single, exhaustive web index.") OAI-SearchBot searches Google, Bing, Reddit, and others for info, much like humans, and may independently crawl sites, too."
GPTBot collects and provides data used to train and update ChatGPT’s knowledge base. OAI-SearchBot performs web searches for current information, user reviews, and product details, querying Google, Bing, Reddit, and other sources and sometimes independently crawling sites. ChatGPT-User accesses pages when users request them. ChatGPT does not store training URLs or track source locations. Disallowing GPTBot stops use of site content for training but typically does not change traffic; it may reduce ChatGPT's direct understanding of a business. Disallowing OAI-SearchBot can prevent site visits and likely reduces citations and referral traffic. Some publishers restrict bots to limit hosting costs.
Read at Practical Ecommerce
Unable to calculate read time
Collection
[
|
...
]