← Lab notes

GPU rental prices, early October 2026: list prices barely moved, but where you rent changes the price up to 4.7×

We collected on-demand GPU list prices from 16 cloud providers three times a day from October 7 to 19, 2026. List prices barely moved: 14 of 407 tracked offers changed. The spread between providers is the real story: H100 from $2.99 to $13.98 per GPU-hour (4.7×), A100 2.6×, L40S 2.1×. And 13 of 22 H100 listings didn't say whether the card is SXM, PCIe or NVL, a difference worth 2.25× in served tokens in our tests.

Choosing GPUs? Compare GPUs for your traffic · Get your node measured, free

Since October 7 we've collected on-demand GPU list prices three times a day: 42 snapshots so far, about 370 offers from 16 providers. Sources: the Lambda, DigitalOcean and Vultr APIs, and NVIDIA Brev's public catalog, which covers AWS, Google Cloud, Oracle Cloud, Nebius, Crusoe, Hyperstack, Massed Compute and others. The live table is on our GPU prices page. This is the first look at what twelve days of it show; the full October index follows on November 1.

List prices barely moved

Of 407 offers we tracked across the period, 14 changed price at all:

  • One real on-demand cut: an 8×A100 offer from Excess Supply dropped from $3.60 to $1.62 per GPU-hour on October 10 (−55%).
  • Back and forth: Google Cloud's 8×H100 alternated between $12.41 and $13.98 per GPU-hour, and its T4 offers moved by about 1%. This looks like the catalog reporting different regions on different days rather than price changes.
  • Spot prices moved more: DigitalOcean's spot price for AMD MI355X rose from $2.97 to $5.50 per GPU-hour (+85%), MI350X from $2.46 to $3.50 (+42%), and NVIDIA B300 fell from $8.00 to $6.17 (−23%).

On-demand list prices behave like price lists, not markets: they change in steps, rarely. Whatever is moving in GPU pricing week to week (availability, spot and marketplace prices, negotiated discounts) doesn't show up in the list.

Where you rent matters far more

The same GPU model costs very different amounts depending on the provider. Taking each provider's cheapest on-demand offer per GPU-hour on October 19:

GPU Providers Cheapest Median Most expensive Spread
H100 11 $2.99 (Vultr) $3.56 $13.98 (Google Cloud) 4.7×
A100 10 $1.62 (Hyperstack, Massed Compute, Excess Supply) $1.98 $4.18 (Google Cloud) 2.6×
L40S 9 $1.06 (Massed Compute) $1.86 $2.23 (AWS) 2.1×
H200 3 $4.47 (DigitalOcean) $4.80 $6.48 (Nebius) 1.4×
AMD MI300X 2 $2.59 (DigitalOcean) $3.29 $3.99 (Vultr) 1.5×

The big clouds sit at the top of each range. Most of the market clusters well below them: eight of eleven H100 providers list between $2.99 and $4.41.

The listing often doesn't say which GPU you get

Of 22 on-demand H100 offers, 13 don't say whether the card is SXM, PCIe or NVL. Eight say SXM, one says PCIe.

That gap matters more than most of the price differences above. In our H100 study, an H100 SXM served 2.25× as many tokens as an H100 NVL under the same latency target, and every NVL card we rented was set below NVIDIA's power range. The SXM was the cheapest per token although it cost the most per hour: $0.31 per million output tokens, against $0.43 on PCIe and $0.57 on NVL.

So a listing that is 25% cheaper per hour can be twice as expensive per token, and the listing alone won't tell you which case you're in.

What this means if you rent GPUs

  • Shop across providers, not across weeks. List prices hardly move; waiting rarely pays. The spread between providers for the same card is 1.4–4.7×.
  • Ask which variant before you compare. For H100s, ask SXM, PCIe or NVL, and the power limit. Then check it on the node: nvidia-smi -q -d POWER, or pip install tokenwatt-check (how to check a GPU's power limit).
  • Compare cost per token, not price per hour. Divide the hourly price by what the node actually serves at your latency target. Our cost per token page has measured numbers for common cards.

Limits

These are list prices at collection time for on-demand capacity. They exclude storage, egress, reserved and committed-use discounts, and they don't tell you whether capacity is available: most offers in the catalog carry no availability flag. Brev's catalog reports one region per offer, which can change between snapshots. Twelve days is a short window. RunPod and peer-to-peer marketplaces where hosts set their own prices aren't included.

Prices are each provider's published list prices, collected through the sources named above. A provider that wants its listings corrected or removed can email hello@tokenwatt.io.

Data: latest snapshot (JSON) · GPU prices page.

Keep reading

3 min read

H100 vs A100 for LLM inference: 7.8× the capacity for 2.2× the price

We served Qwen3-8B with vLLM on a rented H100 SXM and a rented A100 SXM 80GB under the same latency target. The H100 served 8.79 requests per second against 1.13 on the A100: 7.8× the capacity for 2.2× the hourly price, so each token cost 71% less ($0.31 against $1.06 per million output tokens). On raw specs the H100 is only 1.7–2.6× faster. The rest of the gap comes from slow tokens on the A100, which a serving setting can partly fix.

H100A100LLM inference
6 min read

RTX 4090 vs L40S vs A100 vs A40 for LLM inference: what an 8B model really costs per token

We served Qwen3-8B on four cheaper GPUs rented from RunPod Secure Cloud under the same latency target. An RTX 4090 with FP8 weights was cheapest at $0.90 per million output tokens; the A100, the 4090 in BF16 and the L40S landed at $1.06–1.13; the A40 cost $1.61. Every card was limited by occasional slow tokens rather than average speed, and a 30B mixture-of-experts model on an H100 was about 3× cheaper per token than any of them.

RTX 4090L40SA100
4 min read

MOSS-Image on rented GPUs: a 4-step LoRA makes it 14× faster, and the text survives

MOSS-Image, a 5B open text-to-image model known for legible Chinese and English text and JSON layouts, on an RTX 4090, L40S, RTX PRO 6000 and H100. The official 50-step sampler took 17–47 seconds per 1024×1024 image ($11.6–19 per 1,000 images). A community 4-step LoRA took 1.6–3 seconds ($0.74–2.22 per 1,000) and rendered text just as accurately by OCR, but photos lost the natural look the model is praised for. The cheapest card per image was the cheapest per hour.

image generationMOSS-ImageRTX 4090