RTX 4090
GPU only · new $3.5k on Amazon, used ~$2.4k
NVIDIAAdd-in GPU$3,499 · Aug 31, 2026View on Amazonpaid link
- Memory
- 24 GB~22 GB usable
- Bandwidth
- 1.0kGB/s — sets decode speed
- Compute
- 83FP16 TFLOPS — sets prefill
- Power
- 450 Wunder sustained load
- Noise
- 45 dBAyou will hear it
- Price per GB
- $146of accelerator memory
Price history
tracking
Tracking since 2026-08-31 — not enough history for a trend yet.
1 observation recorded · Last checked 2026-08-31. Check the retailer before acting on this — we would rather say the data is old than pretend otherwise.
What it can run
2 of 6 reference workloads fit. The largest is 32B dense · Q4 (coding), at an estimated 34 tok/s of single-stream decode — #4 of the 17 machines here that can run it.
| Workload | Needs | Fits | Prefill t/s | Decode t/s | Batched t/s | $ per t/s |
|---|---|---|---|---|---|---|
8B dense · Q4 (chat, drafts) dense · 4.7 GB read per token | 5.4 GB | Yes | 1.8k | 139 | 723 | $25 |
32B dense · Q4 (coding) dense · 19 GB read per token | 21.8 GB | Yes | 454 | 34 | 177 | $103 |
70B dense · Q4 (strong general) dense · 40 GB read per token | 46 GB | No | 207 | 16 | 83 | — |
120B MoE A5B · MXFP4 (gpt-oss class) MoE · 2.9 GB read per token | 72.4 GB | No | 2.8k | 146 | 759 | — |
320B MoE A18B · FP8 (frontier-ish) MoE · 18 GB read per token | 368 GB | No | 807 | 24 | 125 | — |
671B MoE A37B · Q4 (DeepSeek class) MoE · 18.5 GB read per token | 437 GB | No | 393 | 23 | 120 | — |
Figures are modelled from this machine's bandwidth and compute, not measured on one. How they are derived →
Alternatives that also run 32B dense · Q4 (coding)
| Machine | Price | Memory | Decode t/s | $ per t/s |
|---|---|---|---|---|
| $650 | 24 GB | 16 | $41 | |
| $1,460 | 24 GB | 33 | $44 | |
| $1,400 | 24 GB | 20 | $70 | |
| $4,400 | 32 GB | 61 | $72 | |
| $1,700 | 32 GB | 22 | $77 | |
| $1,399 | 32 GB | 18 | $78 | |
| $1,300 | 32 GB | 16 | $81 | |
RTX 4090 — this machine | $3,499 | 24 GB | 34 | $103 |
| $3,899 | 48 GB | 30 | $130 | |
| $4,500 | 128 GB | 21 | $214 | |
| $2,199 | 48 GB | 9 | $244 | |
| $2,760 | 64 GB | 11 | $251 | |
| $15,499 | 96 GB | 61 | $254 | |
| $13,500 | 512 GB | 41 | $329 | |
| $9,499 | 512 GB | 28 | $339 | |
| $3,999 | 128 GB | 9 | $444 | |
| $5,199 | 128 GB | 9 | $578 |