"Right now, when an AI company's roving internet robot, known as a crawler, wants to suck up the information on a site, it has to go through robots.txt, which acts as a basic entry or non-entry door. AI companies have found ways around robots.txt or ignored it altogether and have subsequently been sued. The goal for RSL is to be a more robust layer of tech to deal with AI crawlers, which now account for more than half of all internet traffic."
"(Disclosure: Ziff Davis, CNET's parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.) "RSL builds directly on the legacy of RSS, providing the missing licensing layer for the AI-first Internet," Tim O'Reilly, CEO of O'Reilly Media, said in a press release. "It ensures that the creators and publishers who fuel AI innovation are not just part of the conversation but fairly compensated for the value they create.""
RSL (Really Simple Licensing) creates a machine-readable licensing layer inspired by RSS that can attach usage terms to web pages, videos, and datasets. Publishers including Yahoo, Quora, Medium and Ziff Davis are using RSL to prevent AI companies from copying content for model training without permission or compensation. Robots.txt currently provides basic access control but has been bypassed by AI crawlers, prompting lawsuits and disclosures. RSL aims to provide a stronger technical control over crawlers, ensure creators and publishers receive compensation for their work, and operate as an open, decentralized standard.
Read at CNET
Unable to calculate read time
Collection
[
|
...
]