NVIDIA · Updated daily · last refresh 2026-10-01
A100 40GB pricing
What the NVIDIA A100 40GB costs right now: 6 tracked on-demand rates, the spread between them, the used market, and what the hourly number turns into when you own the card instead.
The headline on A100 40GB pricing is the spread: the same card costs 6.4x more at the top of the market than at the bottom. The floor comes from Vast.ai (a peer-to-peer marketplace, cheapest but with host-trust trade-offs), the ceiling from OCI, where you are paying for the ecosystem around the GPU as much as the silicon. Every rate below is an on-demand list price; commit to reserved or spot capacity and 30-70% comes off. Same silicon as the 80GB at roughly half the price, the best cost-per-token machine in the datacenter tier when the model fits.
A100 40GB rental prices by provider
| Provider | $/GPU-hr | Notes |
|---|---|---|
| Vast.ai | $0.48 | Verified-listing rate, refreshed daily |
| Thunder | $0.66 | Virtualized instances |
| Jarvislabs | $0.89 | neocloud |
| RunPod | $0.99 | neocloud |
| GCP | $2.93 | a2-highgpu ÷ 8 |
| OCI | $3.05 | hyperscaler |
Buying instead: the used market
Working A100 40GB pulls currently trade around $3,400, with warrantied refurb channel units above that. Amortized over 36 months at 60% utilization with industrial power, that is an effective ~$0.25 per GPU-hour, below even the cheapest rental in the table above. The crossover depends entirely on your utilization: run your own numbers in the ROI calculator, and read the second-life guide before buying pulled hardware.
Put the price in context
A100 40GB specs and capability
What this card actually runs: memory, bandwidth, and the models that fit at each precision.
Convert to $/million tokens
Hourly pricing is the input. The estimator turns it into serving cost for any model.
A100 80GB vs A100 40GB
Head-to-head specs, pricing, and which models fit on one but not the other.
A100 40GB vs RTX 5090
Head-to-head specs, pricing, and which models fit on one but not the other.
All GPU pricing
The full table: every accelerator we track, cheapest to priciest, updated monthly.
Common questions
How much does a A100 40GB cost to rent?
As of 2026-09, A100 40GB on-demand rental runs from $0.48 per GPU-hour at Vast.ai to $3.05 at Oracle Cloud Infrastructure, with a median of $0.94 across the 6 providers we track. Reserved and spot pricing typically runs 30-70% below these list rates.
How much does a used A100 40GB cost?
Working A100 40GB pulls trade around $3,400 as of 2026-09, with warrantied refurbished units priced higher. At that price and 60% utilization, ownership works out to roughly $0.25 per GPU-hour over three years including power.
*Owned effective rate: 36-month amortization, 60% utilization, $0.08/kWh with cooling overhead; hosting and ops labor excluded. Full methodology.