Hardware Benchmarks — Gaming, AI & Synthetic Performance Data

Gaming FPS, AI inference tok/s, and synthetic benchmark data for 459 PC hardware SKUs, from current-gen GPUs and CPUs back to retro Pentium 4 and DDR-era parts. Sources: TechPowerUp, PassMark, Tom's Hardware, Geekbench, Phoronix, and the r/LocalLLaMA community.

Best local-LLM speed per dollar: every GPU ranked by cited 7-9B tok/s per $1,000 of a dated Amazon price (CSV).

Local-LLM GPU performance leaderboard

Aggregated from 3,538 source-cited community AI-inference measurements (plus 8,677 gaming + 6,864 synthetic benchmarks) across 210 GPUs / 459 tracked SKUs. Ranked by median single-stream generation throughput. The 7–9B board uses Q4_K files only, so a card measured on the smaller Llama 2 7B Q4_0 scoreboard file is not ranked against cards measured on Llama 3 / Qwen 3 8B. Batch/aggregate throughput is excluded so cards are comparable.

7–9B class (Llama 3.1 8B, Qwen 3 8B) at Q4_K — median single-stream tok/s

#	GPU	Median tok/s	Data points
1	NVIDIA RTX PRO 5000 Blackwell	143.1	4
2	NVIDIA GeForce RTX 4090	127.7	7
3	NVIDIA GeForce RTX 5070 Ti	116.3	4
4	NVIDIA A100 PCIe 40GB	108.2	3
5	GeForce RTX 4080	95.4	8
6	NVIDIA GeForce RTX 3090	93.9	6
7	NVIDIA GeForce RTX 3090 Ti	93.6	5
8	NVIDIA GeForce RTX 4080 SUPER	90.0	4
9	Radeon RX 9070 XT	90.0	5
10	NVIDIA GeForce RTX 3080 Ti	88.8	6
11	AMD Radeon Pro W7900 48GB	86.2	3
12	NVIDIA GeForce RTX 3080	79.2	7

Not ranked (fewer than 3 distinct runs, or runs more than 2.5x apart): NVIDIA GeForce RTX 5090 (2 runs, 167.9 tok/s), AMD Instinct MI300X 192GB (2 runs, 161.5 tok/s), NVIDIA H100 PCIe 80GB (2 runs, 145.0 tok/s), NVIDIA A100 PCIe 80GB (2 runs, 140.2 tok/s), NVIDIA RTX PRO 6000 Blackwell (1 run, 138.0 tok/s).

70B class (Llama 3.3 70B, Qwen 2.5 72B) — median single-stream tok/s

#	GPU	Median tok/s	Data points
1	AMD Instinct MI300X 192GB	36.3	3
2	NVIDIA RTX PRO 6000 Blackwell	29.1	8
3	NVIDIA H100 NVL 94GB	25.2	5
4	NVIDIA H100 PCIe 80GB	25.0	7
5	NVIDIA RTX PRO 5000 Blackwell	24.0	7
6	RTX 6000 Ada Generation	18.1	3
7	NVIDIA RTX A6000 48GB	14.6	3
8	AMD Radeon Pro W7900 48GB	11.3	9

Not ranked (fewer than 3 distinct runs, or runs more than 2.5x apart): NVIDIA A100 PCIe 80GB (1 run, 22.1 tok/s), AMD Radeon Pro W7800 32GB (2 runs, 16.4 tok/s), NVIDIA L40S 48GB (1 run, 15.3 tok/s).

Methodology: median of source-cited, community-reported single-stream tok/s (1–300 range), Q4_K files for the 7–9B board and any Q4 variant for 70B, at least 3 distinct runs per ranked card, no more than 2.5x apart, measured on the card itself rather than a same-bandwidth sibling; each GPU links to its full benchmark page with per-row sources. Figures vary by runtime, context length, and quant — treat as directional.