"llm_cost_tracker is a Rails-native ledger for LLM API spend: tracks every Faraday and SDK call, prices each line item against bundled rate snapshots, and renders a built-in dashboard with budgets, rollups, and CSV export."
"OpenAI SDK integration now splits usage.input_tokens_details.image_tokens and output_tokens into separate image_input_tokens / image_output_tokens columns and prices them at OpenAI's published image rates. Earlier preview snapshots only stored the 50% batch rates, silently halving image-generation costs."
"Expanded SDK capture surface. OpenAI: Embeddings#create, Images#generate/#edit/#create_variation, Audio::Transcriptions#create (incl. streaming and the new gpt-4o-transcribe audio/text token split), Audio::Speech#create (TTS billed per character), Moderations#create, Chat::Completions#stream. RubyLLM: Provider#paint and #moderate. Anthropic Priority Tier and inference_geo: "us" data residency mode are recognised and routed to the right rate table."
"Experimental provider-invoice reconciliation. LlmCostTracker::Reconciliation.import / .diff reconciles your local ledger against the provider's actual cost API (OpenAI Costs, Anthropic Usage, Gemini). Doctor warns when drift exceeds 5% or imports go stale past 14 days. The default install is now lean: only calls, call_line_items, and call_tags are mandatory. Durable ingestion, rollup-cached budget reads, and reconciliation are opt-in behind config flags and dedicated generators."
llm_cost_tracker is a Rails-native ledger that records every Faraday and SDK call and prices each line item using bundled rate snapshots. A built-in dashboard provides budgets, rollups, and CSV export. Version 0.9 adds image-token billing for gpt-image-1 and related models by splitting image input and output tokens into separate columns and pricing them at published image rates. It expands SDK capture to include embeddings, images, audio transcription and speech, moderations, chat streaming, and RubyLLM provider methods, including Anthropic priority tier and inference_geo routing. It also adds experimental provider-invoice reconciliation that imports and diffs local ledger data against provider cost APIs, with drift warnings and stale import checks. The default install is lean, and security improvements include non-auto-mounted dashboards, secret-pattern tag sanitization, and masking provider key and workspace identifiers.
Read at Rubyflow
Unable to calculate read time
Collection
[
|
...
]