Cloudflare now serves sites in Markdown to AI agents

"The key is that Cloudflare can convert web pages at the edge from HTML to Markdown when a client requests it. This is done via an HTTP Accept header with the value text/markdown. When an AI agent sends this header, Cloudflare converts the HTML page to Markdown in real time and returns it. For regular visitors, the HTML display remains unchanged."

"Significant token savings The token savings can be significant. Based on Cloudflare examples, The Register calculated that a simple heading in Markdown costs about three tokens, while the HTML variant quickly consumes twelve to fifteen tokens, even without additional markup such as div elements, navigation bars, and scripts. For a full blog post from Cloudflare itself, the difference would be even greater."

Cloudflare can convert HTML pages to Markdown at the edge when a client requests text/markdown via the HTTP Accept header. The conversion delivers Markdown to AI agents while leaving HTML for regular visitors. Markdown reduces styling, scripts, and layout noise, giving cleaner semantic content for language models and text-analysis systems. Token usage can drop substantially, for example from 16,180 tokens in HTML to 3,150 in Markdown, cutting about 80 percent. Cloudflare adds an x-markdown-tokens header containing the calculated token count when the feature is enabled. This reduction benefits AI services that face limited context windows and token-based cost models.

Read at Techzine Global