Hardware Benchmarks — Gaming, AI & Synthetic Performance Data

Gaming FPS, AI inference tok/s, and synthetic benchmark data for 418 current-gen PC hardware SKUs. Sources: TechPowerUp, PassMark, Tom's Hardware, Geekbench, Phoronix, and the r/LocalLLaMA community.

Local-LLM GPU performance leaderboard

Aggregated from 835 source-cited community AI-inference measurements (plus 1,611 gaming + 1,678 synthetic benchmarks) across 190 GPUs / 458 tracked SKUs. Ranked by median single-stream generation throughput at Q4-class quantization — batch/aggregate throughput is excluded so cards are comparable.

7–9B class (Llama 3.1 8B, Qwen 2.5 7B) — median single-stream tok/s

#	GPU	Median tok/s	Data points
1	NVIDIA H100 NVL 94GB	280.7	1
2	NVIDIA GeForce RTX 5090	263.6	1
3	NVIDIA H100 PCIe 80GB	213.1	2
4	NVIDIA RTX PRO 6000 Blackwell	208.5	2
5	NVIDIA GeForce RTX 4090	165.0	1
6	AMD Instinct MI300X 192GB	161.5	1
7	RTX6000-Ada-3A	153.5	2
8	NVIDIA L40 48GB	152.0	1
9	NVIDIA A100 PCIe 80GB	138.3	1
10	NVIDIA RTX A5000 24GB	134.4	2
11	RTX 6000 Ada Generation	131.0	1
12	RTX6000-Ada-6Q	131.0	1

70B class (Llama 3.3 70B, Qwen 2.5 72B) — median single-stream tok/s

#	GPU	Median tok/s	Data points
1	AMD Instinct MI300X 192GB	36.4	2
2	NVIDIA RTX PRO 6000 Blackwell	29.8	3
3	GeForce RTX 5070 SUPER	28.4	1
4	NVIDIA H100 NVL 94GB	26.9	3
5	Quadro RTX 5000	26.1	3
6	NVIDIA H100 PCIe 80GB	25.0	5
7	NVIDIA A100 PCIe 40GB	24.1	1
8	Ryzen 7 7730U	22.7	1
9	Radeon RX 7900 XTX	22.3	1
10	NVIDIA A100 PCIe 80GB	22.1	1
11	Radeon RX 6650 XT	18.5	1
12	Ryzen 7 5800X	18.5	1

Methodology: median of source-cited, community-reported single-stream tok/s (1–300 range) at Q4-class quantization; each GPU links to its full benchmark page with per-row sources. Figures vary by runtime, context length, and quant — treat as directional.