Skip to main content
RTX 6000 Ada Generation
NVIDIA · GPU · Ada Lovelace

NVIDIA RTX 6000 Ada Generation — Benchmarks & Specs

48 GB VRAM300W TDP$6,800 MSRP

Short answer: the NVIDIA RTX 6000 Ada Generation generates a median 18.1 tokens/sec on 65-73B dense models at 4-bit (Q4) under llama.cpp, across 3 cited runs from XiongjieDai/GPU-Benchmarks-on-LLM-Inference and Hardware Corner. Its 48 GB of VRAM holds up to DeepSeek-R1-Distill-Llama 70B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (23 of 23 models fit). At the $8,489.96 Amazon price checked 21 h ago (prices change), that is 2.13 tok/s per $1,000, the SpecPicks Value Index.

View used on eBay — $8,000.00 → View Current Price on Amazon → Details →

Bottom line: how fast is the RTX 6000 Ada Generation?

SpecPicks median: 18.1 tokens/sec across 3 cited single-user runs of 65-73B dense models at 4-bit (Q4) under llama.cpp (range 13.7–18.4 tok/s), from XiongjieDai/GPU-Benchmarks-on-LLM-Inference, Hardware Corner (2 runs). At the $8,489.96 Amazon price of the cheapest new linked listing (checked ; prices change), that is a SpecPicks Value Index of 2.13 tok/s per $1,000. One of those runs: llama3:70b at q4_K_M generates 18.4 tokens/sec under llama.cpp, per XiongjieDai/GPU-Benchmarks-on-LLM-Inference. At 4K Ultra with ray tracing and DLSS Quality upscaling, the RTX 6000 Ada Generation averages 64 fps in Alan Wake 2, per RadarGit. In 3DMark Fire Strike it scores 48,841 points, per RadarGit. Its 48 GB of VRAM is the binding constraint for local inference: the llama3:70b run above (70B parameters) is the largest model on file at 4-bit quantization on this card.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from; the SpecPicks median is computed here from the runs it names, each a row in the AI table, and the per-$1,000 figure divides it by the dated listing price. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

eBay listing (Open box): $8,000.00, checked . eBay listings are third-party and can end at any time; as an eBay Partner Network member, SpecPicks may earn a commission.

Amazon listing: $8,489.96

This Amazon listing is above the RTX 6000 Ada Generation's $6,800 launch MSRP. Compare reseller and used listings on eBay before buying.

*Price sourced from Amazon.com. Last updated 2026-10-20. Price and availability subject to change.

Check what fits in 48 GB: by Q4-class file size, 23 of the 23 open-weight models in the SpecPicks Will-It-Run matrix load entirely into the NVIDIA RTX 6000 Ada Generation's 48 GB with 1.5 GB left for an ~8K context, up to DeepSeek-R1-Distill-Llama 70B (a 42.5 GB Q4_K_M file per its Hugging Face listing). Check a model in the Will-It-Run matrix →

The RTX 6000 Ada Generation is a graphics card from the Ada Lovelace family from NVIDIA. Key on-paper specs include 48 GB of GDDR6 VRAM, 300W TDP. It launched with a $6,800 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current listings. Data on this page draws on 1 linked listing, 14 synthetic benchmark results (top 10 shown), 13 community AI inference reports, 6 game frame-rate results, compiled from RadarGit, Hardware Corner, XiongjieDai/GPU-Benchmarks-on-LLM-Inference, JarvisLabs AI FAQ, StorageReview, 3DMark, KitGuru, kunalganglani.com LLM Benchmarks, LocalLLaMA, MyAIHardware, PassMark; each table row links to its source. Read this page when shopping the RTX 6000 Ada Generation, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, synthetic benchmark scores, or local LLM inference).

Gaming Performance (reported FPS)

Average and 1% low frame rates by game, resolution, and quality preset. Bars are scaled against the fastest result on this page.

Gaming frame rates for the RTX 6000 Ada Generation by game, resolution, and quality preset. Rows from aggregator sites are estimates, not measured runs, dated by when SpecPicks fetched them. “1% low” is the frame-time floor that determines perceived smoothness. Each row links to its original review or benchmark database.
Game Resolution Settings Relative Avg FPS 1% low Source
Cyberpunk 2077 4K Path Traced RT on 72 fps — RadarGit 2025-03-11
Cyberpunk 2077 4K Path Traced RT on DLSS Quality 72 fps — RadarGit 2026-06-11
Alan Wake 2 4K Ultra 64 fps — RadarGit 2026-06-11
Alan Wake 2 4K Ultra RT on DLSS Quality 64 fps — RadarGit 2025-03-11
Starfield 4K Ultra 55 fps — RadarGit 2026-06-11
Starfield 4K Ultra RT on DLSS Quality 55 fps — RadarGit 2025-03-11

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the RTX 6000 Ada Generation, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from. Batched serving runs are listed separately below.
Model Quantization Relative Tokens/sec VRAM used Source
Llama 3 8B Q4_K_M llama.cpp 131.0 tok/s — GitHub: XiongjieDai/GPU-Benchmarks-on-LLM-Inference 2024-05
llama2:7b — ollama 115.0 tok/s — JarvisLabs AI FAQ 2024-03
llama3.1:8b q4_K_M llama.cpp 110.0 tok/s 5.5 GB MyAIHardware 2026-05-22
deepseekr1:32b — ollama 100.0 tok/s — LocalLLaMA 2026-04-18
Llama 3 8B F16 llama.cpp 52.0 tok/s — GitHub: XiongjieDai/GPU-Benchmarks-on-LLM-Inference 2024-05
mixtral:8x7b q4_K_M ollama 45.0 tok/s — JarvisLabs AI FAQ 2024-03
qwen3:32b q4_K_M llama.cpp 4K context 37.4 tok/s — Hardware Corner 2025-06
qwen3:32b q4_K_M llama.cpp 16K context 25.1 tok/s — Hardware Corner 2025-12-09
Llama 3 70B Q4_K_M llama.cpp 18.4 tok/s — GitHub: XiongjieDai/GPU-Benchmarks-on-LLM-Inference 2024-05
llama3:70b q4_K_M llama.cpp 18.4 tok/s — XiongjieDai/GPU-Benchmarks-on-LLM-Inference (GitHub)
llama3.3:70b q4_K_M llama.cpp 4K context 18.1 tok/s — Hardware Corner 2025-04
llama3.3:70b q4_K_M llama.cpp 16K context 13.7 tok/s — Hardware Corner 2025-12-09

Batched serving throughput

Aggregate output tokens per second on the RTX 6000 Ada Generation summed across many concurrent requests (serving runtimes such as vLLM). This is total server throughput, not one user's generation speed — each request generates far slower — so these rows are not comparable with the single-stream table above.
Model Quantization Relative Tokens/sec (aggregate) VRAM used Source
llama3.1:70b q5_K_M vllm batched 22.0 tok/s aggregate — kunalganglani.com LLM Benchmarks 2024-09

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the RTX 6000 Ada Generation — higher is better. Each row links to the public database the number was taken from. A benchmark listed more than once is separate published results, shown as published rather than averaged.
Benchmark Relative Score Source
3DMark Fire Strike 48,841 points RadarGit 2025-03-11
3DMark Steel Nomad Lite 32,929 points RadarGit 2025-03-11
3DMark Time Spy (Graphics Score) 30,518 points KitGuru 2023-02-03Same result reported by Tom's Hardware
PassMark G3D Mark 28,663 points PassMark VideoCardBenchmark retrieved 2026-06-11
PassMark G3D Mark 28,598 pts PassMark retrieved 2026-04-20
3DMark Time Spy 26,529 points RadarGit 2025-03-11
3DMark Time Spy 26,048 points 3DMark 2024-03
3DMark Time Spynvidia rtx 6000 ada vs rtx a6000 review 21,180 points StorageReview 2023-10-19
3DMark Port Royal 19,252 points RadarGit 2025-03-11
3DMark Port Royalnvidia rtx 6000 ada vs rtx a6000 review 19,160 points StorageReview 2023-10-19

Products Featuring the RTX 6000 Ada Generation

Full Specifications

TDP300 W
VRAM48 GB
CUDA cores18176
Memory typeGDDR6

RTX 6000 Ada Generation — Frequently Asked Questions

What is the RTX 6000 Ada Generation best used for?
RTX 6000 Ada Generation is a 48 GB VRAM Ada Lovelace-family workstation graphics card. Professional 3D modeling, CAD, rendering and simulation on certified drivers, plus local LLM inference in its large VRAM pool, are the headline use cases; the benchmark tables on this page place it within its generation.
Where do the RTX 6000 Ada Generation benchmark numbers come from?
Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.
Can the RTX 6000 Ada Generation run local LLMs?
Yes — AI inference results for the RTX 6000 Ada Generation are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run. With 48 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization.
Where can I buy the RTX 6000 Ada Generation?
Amazon listings for the RTX 6000 Ada Generation are linked at the top of this page and in the Products Featuring the RTX 6000 Ada Generation section. SpecPicks earns a small affiliate commission on qualifying purchases, at no extra cost to the buyer.

Buying guides that rank the RTX 6000 Ada Generation's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related GPUs

Editorial guides covering the RTX 6000 Ada Generation

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →
RTX 6000 Ada Generation
RTX 6000 Ada Generation
$8489.96
View on Amazon →