Cut inference costs in seconds.

router.com · 2026-08-19 · by Long Nguyen ·generic
An LLM gateway that cuts inference costs by 40% on average. One endpoint for OpenAI, Anthropic, and open models – routed automatically. Free through 2026.

Cut inference costs in seconds.

Get the API KeyRead the docsLogin

Router

Router

Router

[](https://router.com/)

router.com saves you time and money

Cut inference costs in seconds.

One endpoint, one bill, every model — cut your AI costs by 40% on average. The missing piece to maximize ROI.

Get the API KeyRead the Docs

01Every model behind one key

02Cut inference costs by 40%

03Scale to Trillions of tokens

Free routing through 2026 | $26 in model credits

Router was built to reduce inference costs by matching every request to the lowest-cost model that meets your performance needs.

Copy for agent

`curl -fsSL https://agents.ramp.com/install.sh | sh && ~/.local/bin/ramp router configure`

A Router CLI session with Switchyard enabled, comparing a $45.62 Router run against $297.85 for a generic frontier model

CLISwitchyard enabled

Router$45.62

Frontier (Generic)$297.85

auto mode on

(shift+tab to cycle) · ← for agents

  • Anthropic
  • OpenAI
  • Grok
  • Fireworks
  • AWSComing soon
  • GoogleComing soon
  • together.aiComing soon
  • BasetenComing soon
  • Exa
  • CrusoeComing soon
  • Anthropic
  • OpenAI
  • Grok
  • Fireworks
  • AWSComing soon
  • GoogleComing soon
  • together.aiComing soon
  • BasetenComing soon
  • Exa
  • CrusoeComing soon
  • Built for CTOs.

    Loved by CFOs.

    Engineering gets the best model for every workload. Finance gets lower inference spend.

    See how it works

    Watch the video

    $200$150$100$50$0

    1/11/91/171/252/2

    40% Default60% Flex

    | Cost impact data across eighteen daily samples| Sample | Total cost index | Flexible routing share | | ------------------------------------------------------- | ---------------- | ---------------------- | | 1 | 100 | 1 | | 2 | 98 | 2 | | 3 | 97 | 5 | | 4 | 94 | 5 | | 5 | 93 | 8 | | 6 | 91 | 10 | | 7 | 90 | 12 | | 8 | 88 | 15 | | 9 | 85 | 19 | | 10 | 84 | 22 | | 11 | 82 | 26 | | 12 | 81 | 31 | | 13 | 79 | 39 | | 14 | 77 | 43 | | 15 | 75 | 48 | | 16 | 73 | 57 | | 17 | 72 | 65 | | 18 | 70 | 73 |

    Automatic savings.New cost-saving strategies roll into Ramp Router as they prove themselves. Your integration stays put.Smarter defaults.Router tests new models against real workloads, so the best fit becomes your default.More models. One endpoint.Access closed and open-source models from vetted providers, all US-hosted with options for ZDR.

    What teams say about Router

    Delphi

    Choosing the right model makes a meaningful difference to our AI spend. We run billions of tokens through Router, and have reduced our model costs by 92%.

    Valentin De MatosDelphi

    Genius AI

    Ramp Router has given us access to a safe one-stop-shop for model providers in a matter of minutes. I'm a big fan of the vision to help benchmark and manage costs as we go multi-model.

    Braden Allchingenius ai

    Arcanist

    It's just dead-simple. Between Flex tier and Switchyard this is free money with 0 effort, and it's saving me the headache of having to think about constantly switching models.

    Josiah ParappallyArcanist

    ScoreScore versus spendMetricsMetric distributionsSummaryModel summary

    Share

    Copy link

    CostModels (27)

    Select allClear

  • Claude Fable 5
  • Claude Opus 5
  • Kimi K3
  • Claude Opus 4.7
  • GPT-5.5
  • GPT-5.6 Sol
  • GLM 5.2
  • Grok 4.5
  • Kimi K2.7 Code
  • Claude Opus 4.6
  • DeepSeek V4 Flash
  • Claude Opus 4.8
  • GPT-5.6 Terra
  • Claude Sonnet 5
  • GPT-5.4
  • Gemini 3.1 Pro
  • GPT-5.6 Luna
  • Claude Sonnet 4.6
  • Kimi K2.6
  • GLM 5.1
  • Qwen3.6 Plus
  • DeepSeek V4 Pro
  • Qwen3.7 Plus
  • GPT-5.4 Mini
  • Claude Haiku 4.5
  • GPT-5.4 Nano
  • GPT-4.1

Average

90%75%60%45%30%15%$0.00$0.50$1.00$1.50$2.00$2.50$3.00Solve rateCost (Average)

Claude Fable 5Claude Opus 5

035$0.01$2.19$4.36FrequencyCost

| GPT-5.4 | 28 | 2.3 | 747K | 22K | 735 | $0.64 | | ------------------------------------------------------------------------------------------------------------------------------ | --- | --- | ---- | --- | ---- | ----- | | GPT-5.6 Terra | 29 | 2.3 | 455K | 9K | 301 | $0.26 | | GPT-5.4 Mini | 29 | 2.6 | 822K | 43K | 1324 | $0.22 | | GPT-5.6 Luna | 36 | 3.0 | 892K | 12K | 323 | $0.04 | | Claude Opus 4.8 | 39 | 5.3 | 984K | 13K | 313 | $1.09 | | GPT-5.6 Sol | 44 | 3.0 | 740K | 12K | 270 | $0.99 | | Claude Sonnet 4.6 | 48 | 4.6 | 1.3M | 14K | 279 | $0.72 | | Claude Fable 5 | 48 | 3.0 | 1.2M | 15K | 306 | $2.62 | | Claude Sonnet 5 | 49 | 2.4 | 2.2M | 15K | 299 | $1.19 | | Claude Opus 5 | 52 | 1.9 | 1.8M | 18K | 334 | $1.84 | | GPT-5.5 | 52 | 4.3 | 1.5M | 32K | 629 | $1.83 | | Qwen3.7 Plus | 53 | 4.9 | 1.2M | 19K | 351 | $0.15 | | Grok 4.5 | 54 | 2.3 | 1.6M | 41K | 791 | $1.09 | | GPT-5.4 Nano | 54 | 4.4 | 1.9M | 46K | 745 | $0.09 | | DeepSeek V4 Pro | 55 | 3.4 | 1.4M | 13K | 236 | $0.81 | | Gemini 3.1 Pro | 55 | 5.3 | 1.4M | 19K | 353 | $1.03 | | Claude Opus 4.6 | 57 | 5.3 | 1.6M | 11K | 196 | $1.41 | | Claude Opus 4.7 | 71 | 5.5 | 2.8M | 18K | 259 | $2.26 | | Claude Haiku 4.5 | 72 | 6.8 | 2.6M | 15K | 221 | $0.49 | | Kimi K2.7 Code | 77 | 5.3 | 2.5M | 20K | 260 | $0.88 | | GLM 5.1 | 78 | 3.9 | 2.5M | 12K | 158 | $1.09 | | Kimi K2.6 | 81 | 4.2 | 2.8M | 19K | 243 | $0.69 | | Kimi K3 | 91 | 2.0 | 2.9M | 27K | 287 | $1.60 | | DeepSeek V4 Flash | 92 | 2.1 | 3.3M | 27K | 296 | $0.12 | | GPT-4.1 | 94 | 8.5 | 2.7M | 5K | 69 | $1.48 | | GLM 5.2 | 96 | 3.4 | 3.8M | 34K | 338 | $1.84 | | Qwen3.6 Plus | 105 | 6.1 | 4.0M | 27K | 268 | $0.29 |

A benchmark built from real work.

We built Ramp SWE-Bench from real production engineering work because public leaderboards couldn’t answer the questions we had. It gives us a clearer view of what each model can solve and at what cost.

Explore the full benchmark

Put to work at Ramp.

Ramp gives Router a real-world proving ground. The lessons we learn in production feed directly back into the product.

Production value

2.75T+

Tokens routed monthly

How Ramp cut AI costs by 25%+ on internal workloads

Router responds to live latency and failure rates, cutting Ramp’s AI costs by more than 25% without sacrificing performance.

Read the blog post

NVIDIA NeMo Switchyard’s Stage Router for Coding Agents

Switchyard’s intelligent model selection reduces cost by 59% and run time by 35% without sacrificing performance.

Watch the video

“At Ramp, Router cut our overall LLM cost by 30% while making our features smarter and faster.”

Rahul Sengottuvelu

CTO, Ramp

More from the Lab

Jul 1, 2026

PorTAL: Portable Task Adaptation for LoRA

Learn a task adaptation once in a base-agnostic form, then port it to new frozen models by refitting only a thin per-base alignment — recovering \~98% of per-task LoRA's lift on an unseen model within the same family and \~94% across families.

Read the post

May 7, 2026

Building Fast & Accurate Agents with Prime-RL Post Training

How Prime-RL post training improves agent speed and accuracy for production workflows.

Read the post

Apr 21, 2026

Coding agents ignore their own budgets

Agents can't be trusted to manage their own token budgets. Spend control has to live in a separate, evidence-grounded system outside the agent doing the spending.

Read the post

Apr 10, 2026

Latent Briefing: Efficient Memory Sharing for Multi-Agent Systems via KV Cache Compaction

A Ramp Labs writeup on using KV cache compaction to share memory efficiently across multi-agent systems.

Read the post

Apr 2, 2026

How we built Steer, our interpretability playground

A deep dive into building Steer - an interactive tool for exploring and understanding how language models process information internally.

Read the post

Mar 23, 2026

How we made Ramp Sheets self-maintaining

How we built a system that lets Ramp Sheets automatically detect and fix its own issues - reducing manual maintenance and improving reliability.

Read the post

Nov 3, 2025

Post Training Ensemble vs. Singular Model Approaches with Tinker

Comparing ensemble and singular model strategies for post-training optimization, and what we learned building Tinker to explore these tradeoffs.

Read the post

Oct 2, 2025

We built an agent to prompt our internal finance agent

What happens when you build an AI agent whose job is to figure out how to prompt another AI agent? Lessons from recursive agent architectures.

Read the post

Aug 27, 2025

How we built Agent Fill

The story behind Agent Fill - an AI agent that automatically fills out forms by understanding context, extracting data, and navigating complex workflows.

Read the post

FAQ

What is Router?

One endpoint for accessing multiple AI models. Instead of wiring your app to one provider at a time, you send requests through our router which can choose the right model for the job based on quality, cost, and availability. No lock-in. One line to switch.

Wait, Ramp bought router.com?

We did. It was either this or spend the next year spelling out a longer URL on podcasts. More importantly, we build tools that help companies make better spending decisions and stop overpaying for things. AI tokens are the fastest-growing spend category, and we want every token you use to be worth it.

How does it work?

Your request goes to Ramp Router first. We’ll authenticate the request and help you track the usage, model, provider, and cost. We’ll route eligible requests to a more cost-efficient tier when it won’t affect quality. See our Router Strategies to save even more.

What models do you support?

Router supports the latest models from OpenAI, Anthropic, and select open-source models, including Kimi. We regularly add support for new models as they become available. See the full list of supported models in our docs.

How much does it cost?

Ramp Router is free through 2026. You’ll pay list price for the tokens you use. To mark free routing through 2026, your first $26 in credits are on us. Subject to offer terms.

Aren’t there already LLM routers?

There are, and they helped prove people want one endpoint for every model. What’s different here: Ramp has spent the last three years running and improving this technology on our own production workloads, cutting our AI costs by 30%. Saving businesses time and money is what Ramp does, so we built Router to give developers the tools Ramp used to lower its own AI costs. With Router Strategies, developers can define cost and performance priorities for different types of requests, or start with Ramp’s benchmarked defaults. Router is free through 2026. You’ll pay list price for the tokens you use, and your first $26 in credits are on us. Subject to offer terms.

What's the difference between using Router and going direct with a provider?

Going direct ties your application to one provider’s models, pricing, and release cycle. With Router, you connect once and use eligible models through a single endpoint. Use Router Strategies to set how Router balances cost and performance for different types of requests, or start with Ramp’s benchmarked defaults.

Who should use this?

Router is for individual developers and teams in the U.S. (with more countries coming soon) who want to get more from AI without overpaying for it. Whether you’re testing an idea on your own or building for a team, Router gives you one place to work across supported models. Enterprise features are coming soon.

Do I need to be a Ramp customer?

No. You don’t need a Ramp card, a company account, or even an LLC. Router is free through 2026. To mark the occasion, your first $26 in credits are on us. Enter your email at router.com and we’ll send you a sign-in link. Getting started takes two lines of code.

Do I have to rewrite my code to use this?

No. Ramp Router has an OpenAI and Anthropic compatible API, so if you’re already using the OpenAI or Anthropic SDKs or another compatible framework (which is basically all of them!), switching should be a one-line change: update your base URL to Ramp Router’s endpoint.

How does Router handle my data, credentials, and retention?

Please see the Ramp Router Privacy Policy for information on how Ramp manages personal information. Users can choose to use U.S.-hosted models that provide zero data retention (ZDR). Router itself stores model inputs, outputs, and metadata and uses this data to improve the service, but users may turn this off in settings. Some frontier models have provider-specific data retention policies — see our terms for details.

Does Router support bring-your-own API keys (BYOK)?

Yes. Router supports bring-your-own API keys (BYOK) for select model providers. See our technical documentation for more details.

Where are the models hosted?

Ramp Router uses models hosted on U.S.-based infrastructure by their underlying model providers. See our technical documentation for more details.

What happens if a provider has an outage or rate-limits me?

If a provider goes down or rate-limits you, Ramp Router can route eligible requests to another available model, so your app has a fallback when one provider cannot serve it.

Can I compare models side by side?

Yes. Give two models the same prompt and compare their responses, latency, and quality side by side. It’s a quick way to test models before integrating one into your product.

Tokens are money.

Save both.

Get the API KeyRead the docs

router.com · 34 images · 2 videos · 22 links

Comments (0)

No comments yet