NVIDIA Quadro RTX 6000 — Benchmarks & Specs
Bottom line: how fast is the Quadro RTX 6000?
For local LLM inference it generates 102.8 tokens/sec running llama2:7b at q4_0 under llama.cpp, per llama.cpp GitHub. In PassMark G3D Mark it scores 17,830 points, per PassMark. It has 24 GB of VRAM, and the llama2:7b run above (7B parameters) is the largest model on file at 4-bit quantization on this card. Larger models have no sourced run on file.
Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.
The Quadro RTX 6000 is a graphics card from the Turing family released in 2018 from NVIDIA. Key on-paper specs include 24 GB of VRAM. Data on this page draws on 2 linked listings, 8 synthetic benchmark results, 4 community AI inference reports, compiled from PassMark, 3DMark, llama.cpp GitHub, LocalLLaMA, LocalScore, TopCPU; each table row links to its source. Read this page when shopping the Quadro RTX 6000, comparing it against other graphics cards in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).
AI Inference Performance
Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.
| Model | Quantization | Relative | Tokens/sec | VRAM used | Source |
|---|---|---|---|---|---|
| llama3.2:1b-instruct | q4_K_M llama.cpp | 253.0 tok/s | — | LocalScore (Mozilla llamafile benchmark) 2026-09-26 | |
| llama-2-7b | q4_0 llama.cpp | 102.8 tok/s | — | llama.cpp GitHub 2025-08-01 | |
| llama2:7b | Q4_0 llama.cpp | 102.8 tok/s | — | llama.cpp GitHub Performance Discussion 2025-08-01 | |
| qwen3:0.6b | — ollama | 47.1 tok/s | — | LocalLLaMA 2026-04-15 |
Synthetic Benchmarks
Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.
| Benchmark | Relative | Score | Source |
|---|---|---|---|
| PassMark G3D Mark | 17,830 points | PassMark Software 2026-05-06 | |
| PassMark G3D Mark | 17,826 pts | PassMark 2026-04-20 | |
| 3DMark Time Spy | 13,758 points | TopCPU (3DMark database aggregation) 2026-05-01 | |
| PassMark GPU Compute | 9,044 Ops/Sec | PassMark Software 2026-07-11 | |
| 3DMark Fire Strike Ultra Graphics | 8,245 points | 3DMark 2020-03-25 | |
| 3DMark Fire Strike Ultra | 8,190 points | 3DMark 2020-03-25 | |
| PassMark G2D Mark | 760 pts | PassMark 2026-04-20 | |
| PassMark G2D Mark | 748 points | PassMark Software 2026-09-25 |
Products Featuring the Quadro RTX 6000
Full Specifications
| vram gb | 24 |
|---|
Quadro RTX 6000 — Frequently Asked Questions
What is the Quadro RTX 6000 best used for?
When was the Quadro RTX 6000 released, and what was its launch MSRP?
Where do the Quadro RTX 6000 benchmark numbers come from?
Can the Quadro RTX 6000 run local LLMs?
Where can I buy the Quadro RTX 6000?
Buying guides that rank the Quadro RTX 6000's class
This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.
Editorial guides covering the Quadro RTX 6000
In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.
- Prime Big Deal Days 2026: Best Mini PC Deals for Local AI and Home Labs
- Raspberry Pi 4 8GB vs Ryzen 5 2600 for Gemma 3 4B: Which Cheap Box Wins?
- Arc Pro B60 Dual 48GB vs Dual RTX 3060 12GB for 70B Local LLMs (2026)
- Best Hardware for Local OCR and Document AI in 2026
- RTX 4090 vs RTX 5090 for Local LLM Inference: 24 GB vs 32 GB (2026)
- Best GPU for gpt-oss 20B in 2026
- Prime Big Deal Days 2026 GPU Deals for Local LLMs: 12GB vs 16GB Cards
- Ryzen 5 2600 vs Ryzen 5 5600X for CPU-Only gpt-oss 20B (2026)
- Browse all SpecPicks reviews →
More guides & deep dives from the SpecPicks archive
Browse all articles & guides →- The Complete Voodoo5 5500 AGP Driver Guide (2026 Edition)
- RTX 4070 Super vs RX 7800 XT — Which to Buy in 2026
- Best Budget Gaming PC Build 2026 — ~$1,000 ($800 on Sale)
- Best Retro Handhelds in 2026 — From $35 to $500
- Emulation Hardware in 2026: FPGA, Software, and Cart-Reader Ecosystems
- Best 1440p Gaming GPUs in 2026
- How to Build a Windows 98 Retro PC in 2026
More reviews from the SpecPicks archive
Browse all reviews →- The KVM That Runs a Pentium 4 Instead of a Raspberry Pi
- Which GPU Runs Which LLM in 2026: The RTX 3060 12GB Model-Fit Matrix
- Ryzen 5 5600G vs Ryzen 7 5700X for a Budget Gaming Build
- Building a CompactFlash-Boot Win98 SE Retro PC: 2026 Workflow
- Meta Is 'Token Managing' Now: Cut Local-LLM Cost on a Single RTX 3060
- Google's 'Frozen v2' Chip Bakes Gemini Into Silicon: What It Means for Local Rigs
- Best CPU Cooler for the Ryzen 7 5800X: Air vs 240mm AIO
- GPT and Claude Flunked Bridgewater's Finance Test — Why a Local RAG Box Fills the Gap
- Aider vs Cline vs Continue.dev for Local Coding on an RTX 3060 (2026)
- CUDA 13.3 Landed: What Local LLM Operators Need to Know for RTX 3060 / 4090 Rigs
- Troubleshooting Voodoo 5 5500 PCI Driver Hangs on Windows 98 SE: Field Guide
- Can a Ryzen 5 5600G Run Local LLMs With No GPU? CPU + iGPU Inference Tested
- UT99 OldUnreal 469 Patch in 2026: Migration, Servers, and Period-Correct Controller Mapping
- Asus ROG Harpe II Extreme: 24K-Gold, 65K-Sensor Gaming Mouse
- Best 4K Gaming Monitor in 2026: 5 Picks From Budget to Premium
- Best 32-Inch 4K Gaming Monitor for PS5 + PC 2026
- ASUS TUF 27" 1440p vs Samsung Odyssey G5 32": Best High-Refresh Esports Monitor
- LM Studio vs Ollama on an RTX 3060 12GB: Which Local Runtime in 2026?
- 10 Raspberry Pi Projects Worth Building in 2025
- NVIDIA Nemotron 3 Ultra: What It Takes to Run Locally
- Microsoft and Mistral Sign Multi-Billion Europe AI Infra Deal
- 2002 GeForce 4 Ti Win98 Build: CompactFlash Storage Done Right
- Aider vs Cline vs Continue.dev on a Local RTX 3060 (2026)
- Anthropic Shutdown Reignites the AI-Sovereignty Debate — and the Case for Local Inference
More buying guides from SpecPicks
Browse all buying guides →- Best NVMe External Enclosures for 2026
- Best Controllers for PC Gaming in 2026
- Best Graphics Cards for Gaming in 2026
- Best GPUs for 4K Gaming in 2026
- Best CPUs for Gaming in 2026
- Best DDR5 RAM for Gaming PCs in 2026
- Best AM5 Motherboards for 2026
- Best Gaming Mice for 2026
- Best Tools for Building and Repairing Retro PCs in 2026
- Best Gaming Monitors for 2026
- Best NVMe SSDs for Gaming in 2026
- Best CPU Coolers for 2026
- Best CPUs for Content Creators in 2026
- Best 4K Monitors for Content Creators in 2026
- Best Retro Gaming Consoles & Handhelds for 2026
- Best External SSDs for Content Creators in 2026
- Best GPU for Running 27B-32B Local LLMs in 2026
- Best Mechanical Keyboards for Gaming in 2026
- Best GPUs for Running Local LLMs in 2026
- Best 1440p 240Hz Gaming Monitors in 2026
- Best PC Cases for Building in 2026
Hardware benchmark data on SpecPicks
All benchmarks →- AMD Ryzen 7 7700X — benchmarks & specs
- Ryzen 7 5700 — benchmarks & specs
- Intel Arc A310 — benchmarks & specs
- AMD Instinct MI210 64GB — benchmarks & specs
- Radeon RX 7700 — benchmarks & specs
- Radeon RX 6650M — benchmarks & specs
- Google Coral USB Accelerator — benchmarks & specs
- GeForce RTX 4070 — benchmarks & specs
- NVIDIA GeForce RTX 4080 SUPER — benchmarks & specs
- Ryzen 5 9600X — benchmarks & specs
- AMD Ryzen 7 Pro 7735U — benchmarks & specs
- AMD Ryzen 5 7640S — benchmarks & specs
- AMD Ryzen 5 7430U — benchmarks & specs
- NVIDIA GeForce RTX 3080 Ti — benchmarks & specs
- GeForce RTX 3050 8 GB — benchmarks & specs
- GeForce RTX 4070 Ti — benchmarks & specs
- Radeon 9700 Pro — benchmarks & specs
- Apple M2 8 Core 3500 MHz — benchmarks & specs
- Radeon RX 6800 — benchmarks & specs
- Ryzen 5 5500 — benchmarks & specs
- Ryzen 7 5825U — benchmarks & specs
- Ryzen 5 5600X — benchmarks & specs
- NVIDIA GeForce RTX 2060 — benchmarks & specs
- Ryzen 7 7700 — benchmarks & specs