NVIDIA · Updated daily · last refresh 2026-10-01

H100 SXM pricing

What the NVIDIA H100 SXM costs right now: 21 tracked on-demand rates, the spread between them, the used market, and what the hourly number turns into when you own the card instead.

$1.90 /hr
Cheapest · Hyperstack
$2.49 /hr
Median of 21
$5.90 /hr
Highest · GCP
$23.0k
Used unit price
$1.51 /hr
Owned, effective*

The headline on H100 SXM pricing is the spread: the same card costs 3.1x more at the top of the market than at the bottom. The floor comes from Hyperstack (a GPU-first neocloud), the ceiling from GCP, where you are paying for the ecosystem around the GPU as much as the silicon. Every rate below is an on-demand list price; commit to reserved or spot capacity and 30-70% comes off. The workhorse of the AI boom. Still the most widely available serious training and inference GPU.

H100 SXM rental prices by provider

Provider $/GPU-hr vs cheapest Notes
Hyperstack $1.90 cheapest neocloud
Nebius $1.95 1.0× neocloud
Genesis $1.99 1.0× neocloud
FluidStack $2.10 1.1× neocloud
Vast.ai $2.14 1.1× Verified-listing rate, refreshed daily; interruptible lower
DataCrunch $2.19 1.2× neocloud
TensorDock $2.25 1.2× marketplace
Together $2.39 1.3× neocloud
Crusoe $2.45 1.3× neocloud
Lambda $2.49 1.3× neocloud
Cudo $2.49 1.3× marketplace
RunPod $2.69 1.4× Secure Cloud; Community from ~$1.99
Massed $2.79 1.5× neocloud
DigitalOcean $2.99 1.6× neocloud
Jarvislabs $2.99 1.6× neocloud
CoreWeave $3.35 1.8× neocloud
Modal $3.95 2.1× Serverless, per-second billing
OCI $4.00 2.1× BM.GPU.H100.8 ÷ 8
AWS $4.90 2.6× p5.48xlarge ÷ 8, post-2025 price cut
Azure $5.70 3.0× ND H100 v5 ÷ 8
GCP $5.90 3.1× A3 ÷ 8

Buying instead: the used market

Working H100 SXM pulls currently trade around $23,000, with warrantied refurb channel units above that. Amortized over 36 months at 60% utilization with industrial power, that is an effective ~$1.51 per GPU-hour, below even the cheapest rental in the table above. The crossover depends entirely on your utilization: run your own numbers in the ROI calculator, and read the second-life guide before buying pulled hardware.

Put the price in context

H100 SXM specs and capability

What this card actually runs: memory, bandwidth, and the models that fit at each precision.

Convert to $/million tokens

Hourly pricing is the input. The estimator turns it into serving cost for any model.

H100 SXM vs H200

Head-to-head specs, pricing, and which models fit on one but not the other.

H100 SXM vs A100 80GB

Head-to-head specs, pricing, and which models fit on one but not the other.

H100 SXM vs B200

Head-to-head specs, pricing, and which models fit on one but not the other.

All GPU pricing

The full table: every accelerator we track, cheapest to priciest, updated monthly.

Common questions

How much does a H100 SXM cost to rent?

As of 2026-09, H100 SXM on-demand rental runs from $1.90 per GPU-hour at Hyperstack to $5.90 at Google Cloud, with a median of $2.49 across the 21 providers we track. Reserved and spot pricing typically runs 30-70% below these list rates.

How much does a used H100 SXM cost?

Working H100 SXM pulls trade around $23,000 as of 2026-09, with warrantied refurbished units priced higher. At that price and 60% utilization, ownership works out to roughly $1.51 per GPU-hour over three years including power.

*Owned effective rate: 36-month amortization, 60% utilization, $0.08/kWh with cooling overhead; hosting and ops labor excluded. Full methodology.