NVIDIA RTX 4000 SFF Ada Generation — Benchmarks & Specs
Short answer: the NVIDIA RTX 4000 SFF Ada Generation generates 24.7 tokens/sec on qwen2.5:14b (q4_K_M) under llama.cpp in a single cited run, per LocalScore.ai; there are too few comparable runs on file for a median. Its 20 GB of VRAM holds up to Gemma 2 27B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (16 of 23 models fit).
- Single cited run 24.7 tok/s qwen2.5:14b q4_K_M, per LocalScore.ai
- Fits in 20 GB up to Gemma 2 27B at Q4_K_M → at ~8K context; 16 of 23 models in the Will-It-Run matrix
Bottom line: how fast is the RTX 4000 SFF Ada Generation?
At 1440p Reviewer fixed settings (raster), the RTX 4000 SFF Ada Generation averages 99 fps in Forza Horizon 5, per Jisaku Hibi. For local LLM inference it generates 24.7 tokens/sec running qwen2.5:14b at q4_K_M under llama.cpp, per LocalScore.ai. In Geekbench 5 OpenCL it scores 124,926 points, per technical.city. Its 20 GB of VRAM is the binding constraint for local inference: the largest model on file at 4-bit quantization on this card is qwen2.5:32b (32B parameters, IQ4_XS), generating 16.4 tokens/sec under llama.cpp, per Hardware Corner. That run's source does not report a context length; the Will-It-Run matrix sizes each model at its listed quantization with an ~8K context, and by that measure Gemma 2 27B at Q4_K_M is the largest that fits in 20 GB.
Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.
Check what fits in 20 GB: by Q4-class file size, 16 of the 23 open-weight models in the SpecPicks Will-It-Run matrix load entirely into the NVIDIA RTX 4000 SFF Ada Generation's 20 GB with 1.5 GB left for an ~8K context, up to Gemma 2 27B (a 16.7 GB Q4_K_M file per its Hugging Face listing). Check a model in the Will-It-Run matrix →
The RTX 4000 SFF Ada Generation is a graphics card from the Ada Lovelace family from NVIDIA. Key on-paper specs include 20 GB of VRAM. Data on this page draws on 3 linked listings, 14 synthetic benchmark results (top 10 shown), 10 community AI inference reports, 20 game frame-rate results (top 14 shown), compiled from Jisaku Hibi, Hardware Corner, LocalScore.ai, CpuTronic, LocalLLaMA, technical.city, Zimaspace Docs, 3DMark, PassMark; each table row links to its source. Read this page when shopping the RTX 4000 SFF Ada Generation, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, synthetic benchmark scores, or local LLM inference).
Gaming Performance (reported FPS)
Average and 1% low frame rates by game, resolution, and quality preset. Bars are scaled against the fastest result on this page.
| Game | Resolution | Settings | Relative | Avg FPS | 1% low | Source |
|---|---|---|---|---|---|---|
| Death Stranding | 1080p | Reviewer fixed settings (raster) | 162 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Marvel's Guardians of the Galaxy | 1080p | Reviewer fixed settings (raster) | 155 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Shadow of the Tomb Raider | 1080p | Reviewer fixed settings (raster) | 145 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Apex Legends | 4K | High | 144 fps | — | CpuTronic 2026-07-11 | |
| Far Cry 6 | 1080p | Reviewer fixed settings (raster) | 130 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Death Stranding | 1440p | Reviewer fixed settings (raster) | 113 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Forza Horizon 5 | 1080p | Reviewer fixed settings (raster) | 113 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Marvel's Guardians of the Galaxy | 1440p | Reviewer fixed settings (raster) | 104 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Forza Horizon 5 | 1440p | Reviewer fixed settings (raster) | 99 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Shadow of the Tomb Raider | 1440p | Reviewer fixed settings (raster) | 93 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Far Cry 6 | 1440p | Reviewer fixed settings (raster) | 88 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Cyberpunk 2077 | 1080p | Reviewer fixed settings (raster) | 81 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 | |
| Cyberpunk 2077: Phantom Liberty | 4K | RT Ultra RT on DLSS Quality | 68 fps | — | CpuTronic 2026-07-11 | |
| Death Stranding | 4K | Reviewer fixed settings (raster) | 63 fps | — | Jisaku Hibi (cited by Tom's Hardware) 2023-05-09 |
AI Inference Performance
Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.
| Model | Quantization | Relative | Tokens/sec | VRAM used | Source |
|---|---|---|---|---|---|
| qwen3:30b | Q4 llama.cpp | 768.0 tok/s | — | LocalLLaMA 2026-02-25 | |
| llama3.2:1b | q4_K_M llama.cpp | 189.0 tok/s | — | LocalScore.ai retrieved 2026-08-26 | |
| qwen3.6:35b-a3b | Q3_K_S llama.cpp | 83.3 tok/s | 15.6 GB | Zimaspace Docs 2026-09-22 | |
| qwen3.6:35b-a3b | UD-IQ3_XXS llama.cpp | 74.5 tok/s | 14.9 GB | Zimaspace Docs 2026-09-22 | |
| llama3.1:8b | q4_K_M llama.cpp | 58.6 tok/s | — | Hardware Corner 2024-09-29 | |
| llama3.1:8b | q4_K_M llama.cpp | 44.4 tok/s | — | LocalScore.ai retrieved 2026-08-26 | |
| qwen2.5:14b | q4_K_M llama.cpp | 24.7 tok/s | — | LocalScore.ai retrieved 2026-08-26 | |
| llama3.1:8b | FP16 llama.cpp | 20.9 tok/s | — | Hardware Corner 2024-09-29 | |
| qwen2.5:32b | IQ4_XS llama.cpp | 16.4 tok/s | — | Hardware Corner 2024-09-29 | |
| qwen3:30b | — ollama | 13.0 tok/s | — | LocalLLaMA 2026-04-17 |
Synthetic Benchmarks
Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.
| Benchmark | Relative | Score | Source |
|---|---|---|---|
| Geekbench 5 OpenCL | 124,926 points | technical.city retrieved 2026-08-21 | |
| Geekbench 5 Vulkan | 110,912 points | technical.city retrieved 2026-08-21 | |
| 3DMark Fire Strike | 28,799 points | Jisaku Hibi 2023-05-09 | |
| PassMark G3D Mark | 20,605 points | PassMark VideoCardBenchmark retrieved 2026-08-26 | |
| PassMark G3D Mark | 20,492 pts | PassMark retrieved 2026-04-20 | |
| 3DMark Time Spy | 13,990 points | 3DMark 2023-06 | |
| 3DMark Fire Strike Extreme | 13,376 points | Jisaku Hibi 2023-05-09 | |
| 3DMark Time Spy | 10,603 points | Jisaku Hibi 2023-05-09 | |
| 3DMark Port Royal | 6,420 points | Jisaku Hibi 2023-05-09 | |
| 3DMark Fire Strike Ultra | 6,358 points | Jisaku Hibi 2023-05-09 |
Products Featuring the RTX 4000 SFF Ada Generation
Systems with the RTX 4000 SFF Ada Generation
Laptops and desktops that ship with the RTX 4000 SFF Ada Generation — whole systems, listed separately from the part itself.
Full Specifications
| VRAM | 20 GB |
|---|
RTX 4000 SFF Ada Generation — Frequently Asked Questions
What is the RTX 4000 SFF Ada Generation best used for?
Where do the RTX 4000 SFF Ada Generation benchmark numbers come from?
Can the RTX 4000 SFF Ada Generation run local LLMs?
Where can I buy the RTX 4000 SFF Ada Generation?
Buying guides that rank the RTX 4000 SFF Ada Generation's class
This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.
Editorial guides covering the RTX 4000 SFF Ada Generation
In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.
- Used RTX 3090 vs New GPU for Local LLMs: 2026 Reddit Consensus
- RTX 3060 12GB Local LLM: Reddit Consensus on What Runs (2026)
- gpt-oss on a 12GB GPU: 2026 Community Consensus (RTX 3060)
- Qwen 3.6 35B-A3B on a 16GB GPU: RTX 5060 Ti vs RX 9060 XT Quant Table
- FLUX.2 Klein 4B for Halloween Art: RTX 3060 12GB vs RTX 5060 8GB
- Qwen 3.6 27B on 16GB: RTX 5060 Ti 16GB vs RX 9060 XT 16GB by Quant (2026)
- Gemma 4 31B on a 16GB GPU: RTX 5060 Ti vs RX 9060 XT vs Arc A770 Quant Table (2026)
- Best Mini PC Deals 2026 for Local AI and Home Labs
- Browse all SpecPicks reviews →
More guides & deep dives from the SpecPicks archive
Browse all articles & guides →- Emulation Hardware in 2026: FPGA, Software, and Cart-Reader Ecosystems
- How to Build a Windows 98 Retro PC in 2026
- Best Retro Handhelds in 2026 — From $35 to $500
- The Complete Voodoo5 5500 AGP Driver Guide (2026 Edition)
- RTX 4070 Super vs RX 7800 XT — Which to Buy in 2026
- Best 1440p Gaming GPUs in 2026
- Best Budget Gaming PC Build 2026 — ~$1,000 ($800 on Sale)
More reviews from the SpecPicks archive
Browse all reviews →- Best SATA, IDE & CompactFlash Adapters for Retro PC Data Recovery in 2026
- Noctua NH-U12S vs ML240L RGB on a Ryzen 7 5800X
- Gaming PC Build 2026: The Reddit-Consensus Parts List
- Raspberry Pi 4 8GB Homelab in 2026: Jellyfin, Pi-hole and Home Assistant on One Board
- Best Controller for Retro Emulation on PC: 8BitDo Pro 2 vs GameSir G7 SE
- Best Streaming Setup for Sim Racing in 2026: Cam, Mic, Light
- RTX 5090 AI Cores: What the Specs Actually Mean in 2026
- Building a CompactFlash-Boot Win98 SE Retro PC: 2026 Workflow
- Intel Arc for Stable Diffusion: ComfyUI + A1111 setup (2026)
- Samsung's 256GB microSD Drops to $47.99 — and What It Means for Cheap Storage
- Ryzen 5 5600G vs Ryzen 7 5700X for a Budget Gaming + Streaming PC
- Jellyfin NVENC Transcodes + a Local LLM on One RTX 3060 12GB
- EU GPU Price Tracking: Why RTX 5090 Won't Get Cheaper
- Intel Panther Lake on Linux: First Core Ultra X7 Numbers Land
- Laguna XS.2 Lands in llama.cpp: What the Tiny Hybrid Model Means for Local Inference
- Ryzen 7 5800X vs Ryzen 5 5600G for a Budget Local-AI Workstation
- Best SSD for a Homelab NAS in 2026: Crucial BX500 vs Samsung 870 EVO vs WD Blue SN550
- LM Studio on an RTX 3060 12GB: A Zero-Terminal Local LLM Setup
- How nVidia Killed 3dfx — and Why Voodoo Still Haunts Every GPU Launch
- GeForce 3 Ti 500 vs Radeon 8500: The 2001 DirectX 8 GPU Showdown
- Best Raspberry Pi 5 Projects and Kits for 2026
- Can the RTX 3060 12GB Run Qwen3-27B Locally in 2026?
- Building a 1999 GeForce 256 + Pentium III Win98 Rig in 2026
- GeForce 4 Ti 4600 + Pentium 4 Northwood: Period-Correct 2002 Build Guide
More buying guides from SpecPicks
Browse all buying guides →- Best 4K Monitors for Content Creators in 2026
- Best Gaming Mice for 2026
- Best Graphics Cards for Gaming in 2026
- Best Gaming Monitors for 2026
- Best 1440p 240Hz Gaming Monitors in 2026
- Best DDR5 RAM for Gaming PCs in 2026
- Best NVMe SSDs for Gaming in 2026
- Best External SSDs for Content Creators in 2026
- Best NVMe External Enclosures for 2026
- Best GPUs for Running Local LLMs in 2026
- Best Mechanical Keyboards for Gaming in 2026
- Best PC Cases for Building in 2026
- Best Controllers for PC Gaming in 2026
- Best GPU for Running 27B-32B Local LLMs in 2026
- Best CPU Coolers for 2026
- Best Tools for Building and Repairing Retro PCs in 2026
- Best CPUs for Content Creators in 2026
- Best Retro Gaming Consoles & Handhelds for 2026
- Best AM5 Motherboards for 2026
- Best GPUs for 4K Gaming in 2026
- Best CPUs for Gaming in 2026
Hardware benchmark data on SpecPicks
All benchmarks →- Apple M2 Ultra 24 Core — benchmarks & specs
- Radeon RX 5500 XT — benchmarks & specs
- Ryzen 5 5625U — benchmarks & specs
- Quadro RTX 5000 (Mobile) — benchmarks & specs
- Intel Core i7-13700K — benchmarks & specs
- RTX 4000 SFF Ada Generation — benchmarks & specs
- AMD Ryzen 3 7440U — benchmarks & specs
- Apple M4 Max 16 Core — benchmarks & specs
- Intel Core Ultra 9 285K — benchmarks & specs
- AMD Ryzen 7 PRO 5750GE — benchmarks & specs
- AMD Ryzen 5 PRO 7545U — benchmarks & specs
- Crucial T705 2TB — benchmarks & specs
- GeForce RTX 4070 Ti — benchmarks & specs
- AMD Ryzen 7 7735H — benchmarks & specs
- Apple M1 8 Core 3200 MHz — benchmarks & specs
- AMD Ryzen 7 5800U — benchmarks & specs
- Apple M4 9 Core — benchmarks & specs
- Ryzen 5 3500X — benchmarks & specs
- Radeon RX 9070 XT — benchmarks & specs
- AMD Ryzen 7 5825C — benchmarks & specs
- NVIDIA GeForce GTX 1660 SUPER — benchmarks & specs
- NVIDIA L40 48GB — benchmarks & specs
- Ryzen 5 7535HS — benchmarks & specs
- Ryzen 7 7700 — benchmarks & specs