NVIDIA · GPU · Turing

NVIDIA Quadro RTX 6000 — Benchmarks & Specs

24 GB VRAM2018

Short answer: the NVIDIA Quadro RTX 6000 generates 103 tokens/sec on llama2:7b (q4_0) under llama.cpp in a single cited run, per llama.cpp GitHub; there are too few comparable runs on file for a median. Its 24 GB of VRAM holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (20 of 23 models fit). A refurbished eBay listing for it is $899.95, checked 2026-10-20 20:17 UTC (listings can end at any time).

Single cited run 103 tok/s llama2:7b q4_0, per llama.cpp GitHub
Fits in 24 GB up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M → at ~8K context; 20 of 23 models in the Will-It-Run matrix

View refurbished on eBay — $899.95 → View Current Price on Amazon → Details →

Bottom line: how fast is the Quadro RTX 6000?

For local LLM inference it generates 102.8 tokens/sec running llama2:7b at q4_0 under llama.cpp, per llama.cpp GitHub. In PassMark G3D Mark it scores 17,826–17,830 points, across two PassMark results (PassMark GPU benchmark listing, PassMark GPU benchmark listing). It has 24 GB of VRAM, and the llama2:7b run above (7B parameters) is the largest model on file at 4-bit quantization on this card. Larger models have no sourced run on file.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

eBay listing (Very Good - Refurbished): $899.95, checked 2026-10-20 20:17 UTC. eBay listings are third-party and can end at any time; as an eBay Partner Network member, SpecPicks may earn a commission.

Check what fits in 24 GB: by Q4-class file size, 20 of the 23 open-weight models in the SpecPicks Will-It-Run matrix load entirely into the NVIDIA Quadro RTX 6000's 24 GB with 1.5 GB left for an ~8K context, up to DeepSeek-R1-Distill-Qwen 32B (a 19.9 GB Q4_K_M file per its Hugging Face listing). Check a model in the Will-It-Run matrix →

The Quadro RTX 6000 is a graphics card from the Turing family released in 2018 from NVIDIA. Key on-paper specs include 24 GB of VRAM. Data on this page draws on 2 linked listings, 8 synthetic benchmark results, 4 community AI inference reports, compiled from PassMark, 3DMark, llama.cpp GitHub, LocalLLaMA, LocalScore, TopCPU; each table row links to its source. Read this page when shopping the Quadro RTX 6000, comparing it against other graphics cards in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the Quadro RTX 6000, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from.
Model	Quantization	Tokens/sec	VRAM used	Source
llama3.2:1b-instruct	q4_K_M llama.cpp	253.0 tok/s	—	LocalScore (Mozilla llamafile benchmark) retrieved 2026-09-26
llama-2-7b	q4_0 llama.cpp	102.8 tok/s	—	llama.cpp GitHub 2025-08
llama2:7b	q4_0 llama.cpp	102.8 tok/s	—	llama.cpp GitHub (CUDA performance scoreboard, Discussion #15013)
qwen3:0.6b	— ollama	47.1 tok/s	—	LocalLLaMA 2026-04-15

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the Quadro RTX 6000 — higher is better. Each row links to the public database the number was taken from. A benchmark listed more than once is separate published results, shown as published rather than averaged.
Benchmark	Score	Source
PassMark G3D Mark	17,830 points	PassMark Software retrieved 2026-05-07
PassMark G3D Mark	17,826 pts	PassMark retrieved 2026-04-20
3DMark Time Spy	13,758 points	TopCPU (3DMark database aggregation) retrieved 2026-06-11
PassMark GPU Compute	9,044 Ops/Sec	PassMark Software retrieved 2026-07-11
3DMark Fire Strike Ultra Graphics	8,245 points	3DMark 2020-03-25
3DMark Fire Strike Ultra	8,190 points	3DMark 2020-03-25
PassMark G2D Mark	760 pts	PassMark retrieved 2026-04-20
PassMark G2D Mark	748 points	PassMark Software retrieved 2026-09-26

Products Featuring the Quadro RTX 6000

PNY

NVIDIA Quadro RTX 6000

$1498.96

🛒 Find on eBay Check Price on Amazon Details

NVIDIA

PNY VCQRTX6000-PB Quadro RTX 6000 Graphic Card - 24 GB

$1495.00

🛒 Find on eBay Check Price on Amazon Details

Full Specifications

VRAM	24 GB

Quadro RTX 6000 — Frequently Asked Questions

What is the Quadro RTX 6000 best used for?

Quadro RTX 6000 is a 24 GB VRAM Turing-family workstation graphics card. Professional 3D modeling, CAD, rendering and simulation on certified drivers, plus local LLM inference in its large VRAM pool, are the headline use cases; the benchmark tables on this page place it within its generation.

When was the Quadro RTX 6000 released?

Quadro RTX 6000 was released in 2018, a Turing-generation part.

Where do the Quadro RTX 6000 benchmark numbers come from?

Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.

Can the Quadro RTX 6000 run local LLMs?

Yes — AI inference results for the Quadro RTX 6000 are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run. With 24 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization.

Where can I buy the Quadro RTX 6000?

Amazon listings for the Quadro RTX 6000 are linked at the top of this page and in the Products Featuring the Quadro RTX 6000 section. SpecPicks earns a small affiliate commission on qualifying purchases, at no extra cost to the buyer.