Skip to content
Independent counter-quote desk for GPU clusters, bare-metal fleets & colocation · free on standard sourcing

Self-Hosted LLM Cost: When a Dedicated Server Beats an API

Enter your daily token volume and the API you would use. The calculator prices the same month on a dedicated, managed server and tells you plainly which one is cheaper, and by how much.

Self-hosted LLM cost calculator

API, per month

$250

Dedicated, per month

$1,399

Private LLM GPU

The API is cheaper by about $1,149 a month. Self-host for privacy or control, not for cost.

Dedicated prices are the fixed monthly price of a managed plan, including the server, the endpoint and operations. API prices are your daily tokens times the per-token price, times 30 days.

See private LLM plans

Self-hosted LLM vs API: worked examples

Monthly cost at a 3:1 input to output ratio for a model up to 14B, against two common APIs.

Output / input tokens per dayOpen 70B model API (Llama 3.3 70B)1GPT-4.1 mini2Dedicated plan
1M / 3M$125$84Private LLM Core, $649
10M / 30M$1,248$840Private LLM GPU, $1,399
30M / 90M$3,744$2,520Private LLM GPU, $1,399

The honest reading: at low and moderate volume an API is cheaper on cost alone, because providers batch many customers onto the same GPUs. A dedicated server wins on cost once volume is high and steady, as in the last row. Below that, it earns its place when your data cannot leave your control, when you want one fixed bill instead of a meter, or when you run a fine-tuned model no API offers.

Capacity per server

Planning estimates in output tokens per second. Monthly capacity uses 50% utilization so peaks have room. We benchmark your prompts before you sign. Past the largest plan, providers bid for the GPUs.

PlanPriceUp to 14BMonthly output at 50%15B to 32B
Private LLM Core$64925 tokens/s32MNot suited
Private LLM GPU$1,399700 tokens/s907M250 tokens/s

Questions

When does self-hosting an LLM pay off on cost?

When volume is high and steady enough that a fixed server bill undercuts per-token pricing, or when the API you would otherwise use is a premium closed model. For small open models, cheap APIs usually win on price; the calculator shows where the lines cross for your volume.

What does this calculator leave out?

Your own engineering time if you run the server yourself, idle hours when traffic is low, and quality differences between models. A managed plan covers the operations; quality you should test on your own prompts.

How are the capacity figures set?

They are planning estimates of output tokens per second per server, used at 50% so peak traffic has room. Before a contract we benchmark your prompts on the actual server and size from the measured numbers.

Why would a team self-host if the API is cheaper?

Data that cannot leave your control, a fixed and predictable monthly bill, no rate limits or model deprecations you did not choose, and the freedom to run fine-tuned or specialized open models.

What if my volume is bigger than one server?

Then the calculator shows a scale-up quote instead of a plan. Send the request and our quote desk gets at least three providers to bid blind on the GPU servers, each normalized to one 36-month cost, plus a managed price if you want us to run it.

Need private, not just cheap?

Tell us the model, the users and the data rules. We size a dedicated server, or get GPU counter-quotes if it is bigger than one, and reply within one business day.

Request a private LLM server