Hardware Benchmarks — Gaming, AI & Synthetic Performance Data

Gaming FPS, AI inference tok/s, and synthetic benchmark data for 457 current-gen PC hardware SKUs. Sources: TechPowerUp, PassMark, Tom's Hardware, Geekbench, Phoronix, and the r/LocalLLaMA community.

Local-LLM GPU performance leaderboard

Aggregated from 1,500 source-cited community AI-inference measurements (plus 3,633 gaming + 3,290 synthetic benchmarks) across 207 GPUs / 457 tracked SKUs. Ranked by median single-stream generation throughput at Q4-class quantization — batch/aggregate throughput is excluded so cards are comparable.

7–9B class (Llama 3.1 8B, Qwen 2.5 7B) — median single-stream tok/s

#	GPU	Median tok/s	Data points
1	NVIDIA H100 NVL 94GB	280.7	1
2	NVIDIA GeForce RTX 5090	263.6	1
3	NVIDIA RTX PRO 6000 Blackwell	208.5	2
4	RTX 4500 Ada Generation	168.9	1
5	AMD Instinct MI300X 192GB	161.5	3
6	Quadro RTX 5000 (Mobile)	159.8	1
7	NVIDIA L40 48GB	152.0	3
8	Radeon RX 7900 XTX	151.1	2
9	NVIDIA GeForce RTX 4090	148.0	4
10	NVIDIA H100 PCIe 80GB	145.6	3
11	Quadro RTX 5000	143.1	2
12	NVIDIA A100 PCIe 80GB	138.3	1

70B class (Llama 3.3 70B, Qwen 2.5 72B) — median single-stream tok/s

#	GPU	Median tok/s	Data points
1	AMD Instinct MI300X 192GB	36.3	3
2	NVIDIA RTX PRO 6000 Blackwell	29.8	3
3	GeForce RTX 5070 SUPER	28.4	1
4	Quadro RTX 5000	26.1	5
5	NVIDIA H100 NVL 94GB	25.2	5
6	NVIDIA H100 PCIe 80GB	25.0	10
7	NVIDIA A100 PCIe 40GB	24.1	3
8	Quadro RTX 5000 (Mobile)	24.0	1
9	Radeon RX 7900 XTX	22.3	1
10	NVIDIA A100 PCIe 80GB	21.1	4
11	AMD Radeon Pro W7800 32GB	20.0	1
12	Radeon RX 7600	18.5	1

Methodology: median of source-cited, community-reported single-stream tok/s (1–300 range) at Q4-class quantization; each GPU links to its full benchmark page with per-row sources. Figures vary by runtime, context length, and quant — treat as directional.