Affiliate disclosure: ToolBistro may earn a commission from some links, at no extra cost to you. Facts come from official sources; we do not publish fabricated testing or ratings.

AI Tools

LiteLLM vs OpenRouter: which one should you run?

LiteLLM vs OpenRouter hinges on where the 5.5% fee lands. OpenRouter charges 5.5% when you buy credits on Standard, yet bring-your-own-key traffic pays nothing on the first $25,000 of list-price inference per month. LiteLLM is a self-hosted, MIT-licensed gateway with similar core controls and no fee, plus the ops work.

Key facts

What matters

  • OpenRouter Standard charges 5.5% when you buy credits, Business 8%, and inference is billed at the provider's list price with no per-request markup (pricing page, verified October 20, 2026).
  • On Standard and Business, BYOK traffic carries no OpenRouter fee up to $25,000/mo of list-price inference; above that it charges 5% of list price, deducted from credits.
  • LiteLLM's open-source tier is $0 and self-hosted, covering 100+ providers, virtual keys, budgets, spend tracking, fallbacks and request logging.
  • A $2.24/mo VPS equals OpenRouter's 5.5% fee at roughly $41/mo of credit-funded inference, so at small spend the fee is not the reason to self-host. Engineering time is.

What LiteLLM and OpenRouter each are

LiteLLM is an open-source AI gateway you deploy yourself. It puts one OpenAI-compatible endpoint in front of 100+ providers, and its open-source tier already lists virtual keys, users and teams, spend tracking, budgets with rate limits, LLM fallbacks, request and response logging, and Prometheus metrics. The repository had 61,587 stars on GitHub and a push on October 20, 2026.

OpenRouter is a hosted routing service. You hold one OpenRouter key, either buy credits or attach your own provider keys, and pick from 500+ models on paid plans or 25+ free models on the free plan. There is nothing to deploy and nothing to keep upgraded.

The architectural difference decides most of the argument. With LiteLLM a request travels from your app to your proxy to the provider. With OpenRouter it travels through OpenRouter's API first. That is not a flaw, it is the product: the routing, fallbacks and provider coverage exist because OpenRouter sits in the path. The question is whether you want a third party there.

LiteLLM vs OpenRouter pricing: when the 5.5% fee applies

OpenRouter's platform fee is charged when you buy credits, not on each request. Its pricing page states 5.5% for Standard and 8% for Business, and that inference is billed at the provider's list price on every plan, with no markup. Loading $500 of credits costs $27.50 on Standard; $2,000 costs $110; $10,000 costs $550.

The carve-out matters more. If you bring your own provider keys, the provider bills you for inference directly, and Standard and Business include $25,000 of list-price inference per month with no OpenRouter fee. Past that allowance OpenRouter charges 5% of what the same request would have cost at list price, deducted from your credits. Enterprise allowances are negotiated.

So the 5.5% headline only lands on teams that fund inference through OpenRouter credits. A team spending $3,000 a month on its own OpenAI and Anthropic keys pays OpenRouter nothing under the allowance, and would pay $165 a month if that same volume ran on purchased credits. Free-plan traffic is a different story: free models are capped at 20 requests per minute and 50 per day, rising to 1,000 per day after the account has bought $10 of credits, and failed attempts count against that daily cap.

What LiteLLM's $0 license leaves you to pay for

The open-source tier is genuinely free to self-host and it is not a trial: the pricing page lists it as $0 forever, including the controls a small team needs. What it does not include is a server, a database, or anyone to page at 3am.

Start with the server, because it is the cheap part. RackNerd lists VPS from $2.24 a month on its homepage, checked October 20, 2026. At OpenRouter's 5.5% Standard rate, that $2.24 equals the fee on about $41 a month of credit-funded inference. The hardware is not what you are trading against the fee.

Then read the license rather than the badge. The repository's LICENSE file says content outside the enterprise/ directory is MIT, while code under enterprise/ falls under a separate license in that directory. GitHub reports the repo's license as NOASSERTION for exactly that reason. If your compliance team asks whether LiteLLM is MIT, the accurate answer is that the core is, the enterprise pieces are not.

Governance is the other line item. SSO with SCIM, audit logs on every request, RBAC across keys, teams and organizations, secret managers, air-gapped deployment and SLAs are on the Enterprise tier, priced annually against request capacity rather than per token, and quote-only. The page offers a 30-day trial key instead of a price list.

Feature comparison

Neither vendor publishes this side by side, so here is the verified shape of both offerings as of October 20, 2026. Every row traces to a pricing or enterprise page listed at the bottom.

Which one fits your setup

  • Solo developer or a two-person team under $25,000/mo of inference: OpenRouter Standard with your own keys. You pay nothing to OpenRouter under the BYOK allowance, skip the ops work, and get provider fallbacks without building them.
  • A product team that needs per-agent keys and spend attribution: LiteLLM on a VPS. Virtual keys per harness, spend tracked by key and team, and logs you can query when a cache miss or a runaway agent shows up. This is the case the October 18, 2026 post on running your own proxy argues for, and for debugging agent spend it is hard to beat.
  • Prompts cannot leave infrastructure you control: LiteLLM, potentially air-gapped on the Enterprise tier. OpenRouter by design sees the request, and no plan changes that.
  • A large org that wants a contract, SSO and an SLA without operating anything: OpenRouter Enterprise, priced by contract with fee discounts, SSO/SAML, contractual SLAs and invoicing.

The honest catch

Self-hosting a gateway makes it a dependency. Your application now fails when the proxy fails or when a model list update breaks a route, and rolling upgrades become your job. Teams routinely underestimate that, then discover the control they wanted already exists as an Enterprise feature they have to buy.

OpenRouter's cost is easy to lose track of precisely because it is invisible per request. You feel it at top-up, and a Business plan on purchased credits costs 8%, not 5.5%, which is easy to miss when comparing against a competitor's headline number. The free tier is a trial in practice: 50 requests a day goes quickly once an agent loop starts.

One more thing worth checking before either decision: OpenRouter's BYOK allowance is a commercial term, not an architectural guarantee. Verify the current threshold on the pricing page when you sign, since the number is what your cost model rests on.

At a glance

DimensionLiteLLMOpenRouter
What it isOpen-source gateway you deployHosted routing service
Platform feeNone on the open-source tier5.5% on credits (Standard), 8% (Business)
Bring your own keysNative; provider bills you directlyNo fee to $25,000/mo list price, then 5%
Model access100+ providers, one OpenAI-format API500+ models paid, 25+ free models
Spend trackingBudgets and spend by key, user, teamActivity logs and export
SSO, audit logs, RBACEnterprise tier, quote-onlySSO/SAML and SLAs on Enterprise, quote-only
Request pathYour infrastructure to the providerThrough OpenRouter's API
Ops burdenYou run upgrades, database, uptimeNone beyond your own app
LicenseMIT core; enterprise/ licensed separatelyProprietary service

FAQ

Is LiteLLM free?

The open-source gateway is $0 to self-host, including virtual keys, budgets, spend tracking, fallbacks and request logging. Code under the enterprise/ directory is licensed separately, and Enterprise adds SSO/SCIM, audit logs and org-level RBAC at an annual, quote-only price.

Does OpenRouter charge a fee when I use my own API keys?

No, up to $25,000 a month of list-price inference on Standard and Business. Above that allowance OpenRouter charges 5% of what the request would cost at list price on OpenRouter, deducted from your credits.

Can I run LiteLLM on a cheap VPS?

Yes. The proxy is a service you install and point at your provider keys, so a small VPS is enough to start; RackNerd lists VPS from $2.24/mo. Plan for the upgrade, backup and monitoring work, and for Postgres once you want spend logs to survive a restart.

Related reading

OpenRouter alternatives after the Stripe acquisition, Cloudflare AI Gateway pricing, cheapest LLM API pricing

Sources