Tokenmaxxing is dead. It didn't produce the AI ROI companies wanted. | Fortune

Token usage became a proxy for employee innovation by tracking how many tokens AI agents consumed. Tokens represent units of data processed by AI models, roughly equivalent to about a word-and-a-half of English text. Companies created leaderboards and encouraged competition to spend more tokens in a period. Goodhart’s Law applied as the metric became a target, leading to meaningless or unnecessary tasks performed to maintain high token counts. Token spending also increased expenses, causing sticker shock from AI bills. As a result, companies pulled back from tokenmaxxing, limited employee access to third-party AI agents, and removed internal leaderboards, including Meta’s takedown of its leaderboard and Microsoft’s cancellation of Claude Cod.

"Just a few weeks ago, it seemed that 'tokenmaxxing' was all the rage inside many companies. The idea was: if you wanted to find out which employees were being most innovative in deploying AI agents, you should track their token usage. (Tokens are the units of data that AI models process; a token is equivalent to about a word-and-a-half of English language text.) The more tokens expended, the more productive that employee's AI agents were, or at least, the more AI-forward and innovative that employee was trying to be."

"Of course, Goodhart's Law still holds (it posits that any measure that becomes a target, ceases to be a good measure) and tokenmaxxing had some predictably perverse results. At Amazon, the Financial Times reported, some employees spun up AI agents to complete wholly meaningless or unnecessary tasks just to keep up their token usage stats, which were now being used by managers to assess employee performance."

"Also, all those tokens are hardly free, and some companies have gotten sticker shock from their Anthropic and OpenAI bills. So, now many companies seem to be pulling back from the tokenmaxxing ethos and even limiting which employees can use third party AI agents, at least those that use the most advanced AI models as the "brains" inside the agentic harnesses. Meta took down the informal tokemaxxing leaderboard its employees had created."

Read at Fortune