Skip to main content
NVIDIA RTX A6000 48GB
NVIDIA · GPU · Ampere Pro

NVIDIA RTX A6000 48GB — Benchmarks & Specs

48 GB VRAM300W TDP$4,650 MSRP2020
Find NVIDIA RTX A6000 48GB on eBay → Search Amazon for the NVIDIA RTX A6000 48GB →

Bottom line: how fast is the NVIDIA RTX A6000 48GB?

For local LLM inference it generates 14.5 tokens/sec running qwen2.5:72b at q4_K_M under ollama, per DatabaseMart. In 3DMark Fire Strike (Graphics Score) it scores 27,511 points, per Notebookcheck. Its 48 GB of VRAM is the binding constraint for local inference: the largest model on file at 4-bit quantization on this card is qwen:72b (72B parameters, q4_0), generating 14.5 tokens/sec under ollama, per DatabaseMart.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

The NVIDIA RTX A6000 48GB is a graphics card from the Ampere Pro family released in 2020 from NVIDIA. Key on-paper specs include 48 GB of GDDR6 VRAM, 300W TDP. It launched with a $4,650 MSRP, though street prices typically diverge meaningfully from launch pricing. Data on this page draws on 28 synthetic benchmark results (top 10 shown), 35 community AI inference reports (top 12 shown), compiled from DatabaseMart, Notebookcheck, StorageReview, 3DMark, CpuTronic, GPU-Benchmarks-on-LLM-Inference, llama.cpp GitHub, llama.cpp GitHub Discussion #15013, OpenLLMBenchmarks, PassMark, PassMark PerformanceTest, technical.city; each table row links to its source. Read this page when shopping the NVIDIA RTX A6000 48GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA RTX A6000 48GB, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from. Batched serving runs are listed separately below.
Model Quantization Relative Tokens/sec VRAM used Source
llama2:7b q4_0 llama.cpp 144.9 tok/s — llama.cpp GitHub Discussion #15013 2025-08-01
llama3:8b q4_K_M llama.cpp 102.2 tok/s — GPU-Benchmarks-on-LLM-Inference (GitHub, XiongjieDai) 2024-05-01
llama3:8b q4_K_M llama.cpp 102.2 tok/s — OpenLLMBenchmarks 2024-09-30
llama2:13b — ollama 63.6 tok/s 7.4 GB DatabaseMart 2025-03-01
phi4:14b q4_K_M ollama 52.6 tok/s 33.6 GB DatabaseMart 2026-07-08
Mixtral 8x7B Q4_K_M llama.cpp 52.0 tok/s 27.8 GB llama.cpp GitHub 2025-11-20
qwen2.5:14b q4_0 ollama 50.3 tok/s — DatabaseMart 2025-02-01

Batched serving throughput

Aggregate output tokens per second on the NVIDIA RTX A6000 48GB summed across 50 concurrent requests (serving runtimes such as vLLM). This is total server throughput, not one user's generation speed — each request generates far slower — so these rows are not comparable with the single-stream table above.
Model Quantization Relative Tokens/sec (aggregate) VRAM used Source
deepseek-r1-distill-llama:8b BF16 vllm 50 concurrent requests 1643.9 tok/s aggregate 15.0 GB DatabaseMart 2026-08-25
deepseek-r1-distill-llama:8b FP16 vllm 50 concurrent requests 1385.8 tok/s aggregate 15.0 GB DatabaseMart 2025-03-01
llama3.1:8b FP16 vllm 50 concurrent requests 1218.6 tok/s aggregate 15.0 GB DatabaseMart 2025-03-01
qwen2.5:14b FP16 vllm 50 concurrent requests 695.5 tok/s aggregate 28.0 GB DatabaseMart 2025-03-01
deepseek-r1-distill-qwen:14b FP16 vllm 50 concurrent requests 566.1 tok/s aggregate 28.0 GB DatabaseMart 2025-03-01

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA RTX A6000 48GB — higher is better. Each row links to the public database the number was taken from.
Benchmark Relative Score Source
3DMark Fire Strike (Graphics Score) 27,511 points Notebookcheck 2021-01-01
3DMark Fire Strike Graphics 27,511 points technical.city 2026-04-30
3DMark Fire Strike 25,280 points Notebookcheck 2021-01-01
PassMark G3D Mark 24,800 PassMark 2026-05-06
PassMark G3D Mark 22,767 points PassMark Software 2026-04-30
PassMark G3D Mark 22,657 points PassMark PerformanceTest 2026-06-09
3DMark Fire Strike Extreme 22,185 points StorageReview 2023-10-19
3DMark Time Spy 18,451 points StorageReview 2023-10-19
3DMark Time Spy 18,152 points CpuTronic 2022-01-01
3DMark Time Spy 17,796 points 3DMark 2022-01-01

Full Specifications

tdp w300
vram gb48
cuda cores10752
memory typeGDDR6

NVIDIA RTX A6000 48GB — Frequently Asked Questions

What is the NVIDIA RTX A6000 48GB best used for?
NVIDIA RTX A6000 48GB is a 48 GB VRAM Ampere Pro-family graphics card. High-end 4K gaming and local LLM inference are the headline use cases; the benchmark tables on this page place it within its generation.
When was the NVIDIA RTX A6000 48GB released, and what was its launch MSRP?
NVIDIA RTX A6000 48GB launched in 2020 at a $4,650 MSRP. Street prices drift from launch pricing over a product's life, so check the current listing before buying.
Where do the NVIDIA RTX A6000 48GB benchmark numbers come from?
Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.
Can the NVIDIA RTX A6000 48GB run local LLMs?
Yes — AI inference results for the NVIDIA RTX A6000 48GB are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run. With 48 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization.
Where can I buy the NVIDIA RTX A6000 48GB?
SpecPicks has no verified listing of the NVIDIA RTX A6000 48GB on file yet; the Amazon search link at the top of this page shows its current offers. SpecPicks earns a small affiliate commission on qualifying purchases.

Buying guides that rank the NVIDIA RTX A6000 48GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related GPUs

Editorial guides covering the NVIDIA RTX A6000 48GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →