NVIDIA · GPU · Ampere Pro

NVIDIA RTX A2000 12GB — Benchmarks & Specs

12 GB VRAM70W TDP$450 MSRP2021

Short answer: the NVIDIA RTX A2000 12GB generates 35.7 tokens/sec on llama3.1:8b-instruct (q4_K_M) under llamafile (llama.cpp) in a single cited run, per LocalScore; there are too few comparable runs on file for a median. Its 12 GB of VRAM holds up to Phi-4 14B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (13 of 27 models fit). A used eBay listing for it is $499.95, checked 2026-11-07 15:16 UTC (listings can end at any time).

Single cited run 35.7 tok/s llama3.1:8b-instruct q4_K_M, per LocalScore
Fits in 12 GB up to Phi-4 14B at Q4_K_M → at ~8K context; 13 of 27 models in the Will-It-Run matrix

View used on eBay — $499.95 → Search Amazon for the NVIDIA RTX A2000 12GB →

Who should buy this instead: the NVIDIA RTX A2000 12GB's 12 GB puts it in the 12 GB tier of the local-LLM GPU picks by VRAM (one card per tier, each with cited tok/s). If the models you run fit in 8 GB, compare the 8 GB pick. If they need more than 12 GB, start at the 16 GB pick.

NVIDIA RTX A2000 12GB: verdict by use case

For the largest model in 12 GB: Phi-4 14B at Q4_K_M with an ~8K context; 13 of the 27 models in the Will-It-Run matrix fit. By the same sizing, 65-73B models at Q4 do not fit, so 70B-class work needs a card with more VRAM or CPU offload.
For gaming: 43 fps average in Forza Horizon 5 at 1440p Ultra, per Notebookcheck.

Each verdict quotes a figure from a linked source or a row in the tables below. Where no cited figure exists for a use case, there is no verdict line for it.

Bottom line: how fast is the NVIDIA RTX A2000 12GB?

At 1440p Ultra, the NVIDIA RTX A2000 12GB averages 43 fps in Forza Horizon 5, per Notebookcheck. For local LLM inference it generates 35.7 tokens/sec running llama3.1:8b-instruct at q4_K_M under llamafile (llama.cpp), per LocalScore. In Geekbench 5 CUDA it scores 83,470 points, per HardwareDB. Its 12 GB of VRAM is the binding constraint for local inference: the largest model on file at 4-bit quantization on this card is qwen2.5:14b (14.8B parameters, q4_K_M), generating 19.5 tokens/sec under llama.cpp, per LocalScore. That run's source does not report a context length; the Will-It-Run matrix sizes each model at its listed quantization with an ~8K context, and by that measure Phi-4 14B at Q4_K_M is the largest that fits in 12 GB.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

eBay listing (Used): $499.95, checked 2026-11-07 15:16 UTC. eBay listings are third-party and can end at any time; as an eBay Partner Network member, SpecPicks may earn a commission.

Check what fits in 12 GB: by file size at each listed quantization, 13 of the 27 open-weight model files in the SpecPicks Will-It-Run matrix load entirely into the NVIDIA RTX A2000 12GB's 12 GB while keeping at least 1.5 GB reserved for an ~8K context; the largest that fits, Phi-4 14B (a 9.1 GB Q4_K_M file per its Hugging Face listing), leaves roughly 2.9 GB free. Check a model in the Will-It-Run matrix →

What fits in the NVIDIA RTX A2000 12GB's 12 GB, and what doesn't

2 of these 7 model files load whole into 12 GB with room for an ~8K context. A file fits when the card keeps at least 1.5 GB free after the weights; file sizes are the GGUF downloads on Hugging Face. Speeds are this card's single-user generation speed from cited community runs at the Q4-class file listed; a row with no cited run says so rather than estimating one.

Model	Quant	Fits in 12 GB?	Cited speed on this card
Llama 3.1 8B 4.9 GB file	Q4_K_M	Fits~7.1 GB left for context	35.7 tok/s1 cited run, llamafile (llama.cpp), per LocalScore (Mozilla Builders)
Qwen3 14B 9 GB file	Q4_K_M	Fits~3 GB left for context	No public measurement on file
gpt-oss-20b 21B-A3.6B · 12.1 GB file	MXFP4	Doesn't fit0.1 GB over; runs only with CPU offload	— (does not load into VRAM)
Qwen3 30B-A3B 18.6 GB file	Q4_K_M	Doesn't fit6.6 GB over; runs only with CPU offload	— (does not load into VRAM)
Qwen3 32B 19.8 GB file	Q4_K_M	Doesn't fit7.8 GB over; runs only with CPU offload	— (does not load into VRAM)
Gemma 3 27B 28.7 GB file	Q8_0	Doesn't fit16.7 GB over; runs only with CPU offload	— (does not load into VRAM)
Llama 3.3 70B 42.5 GB file	Q4_K_M	Doesn't fit30.5 GB over; runs only with CPU offload	— (does not load into VRAM)

The NVIDIA RTX A2000 12GB is a graphics card from the Ampere Pro family released in 2021 from NVIDIA. Key on-paper specs include 12 GB of GDDR6 VRAM, 70W TDP. It launched with a $450 MSRP, though street prices typically diverge meaningfully from launch pricing. Data on this page draws on 17 synthetic benchmark results (top 10 shown), 5 community AI inference reports, 28 game frame-rate results (top 14 shown), compiled from Notebookcheck, LocalScore, CpuTronic, HardwareDB, topcpu.net GPU Performance Rankings, knightli.com llama.cpp GPU Scoreboards, PassMark; each table row links to its source. Read this page when shopping the NVIDIA RTX A2000 12GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, synthetic benchmark scores, or local LLM inference).

Gaming Performance (reported FPS)

Average and 1% low frame rates by game, resolution, and quality preset. Bars are scaled against the fastest result on this page.

Gaming frame rates for the NVIDIA RTX A2000 12GB by game, resolution, and quality preset. Rows from aggregator sites are estimates, not measured runs, dated by when SpecPicks fetched them. “1% low” is the frame-time floor that determines perceived smoothness. Each row links to its original review or benchmark database.
Game	Resolution	Settings	Avg FPS	1% low	Source
Shadow of the Tomb Raider	1080p	Ultra	77 fps	—	Notebookcheck 2024-09-07
Shadow of the Tomb Raider	1080p	Highest	75 fps	—	topcpu.net GPU Performance Rankings 2026-04-29
Shadow of the Tomb Raider	1080p	Highest	73 fps	—	CpuTronic 2026-08-13
Shadow of the Tomb Raider	1080p	High	73 fps	—	CpuTronic 2026-07-09
Far Cry 6	1080p	Ultra	68 fps	—	Notebookcheck 2024-09-07
Forza Horizon 5	1080p	Ultra	59 fps	—	Notebookcheck 2024-09-07
Shadow of the Tomb Raider	1440p	Highest	55 fps	—	topcpu.net GPU Performance Rankings 2026-04-29
Shadow of the Tomb Raider	1440p	Highest	54 fps	—	CpuTronic 2026-08-13
Shadow of the Tomb Raider	1440p	High	54 fps	—	CpuTronic 2026-07-09
Cyberpunk 2077	1080p	High	52 fps	—	Notebookcheck 2024-09-07
Shadow of the Tomb Raider	1440p	Ultra	52 fps	—	Notebookcheck 2024-09-07
Baldur's Gate 3	1080p	Ultra	50 fps	—	Notebookcheck 2024-09-07
Cyberpunk 2077	1080p	Ultra	45 fps	—	Notebookcheck 2024-09-07
Forza Horizon 5	1440p	Ultra	43 fps	—	Notebookcheck 2024-09-07

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA RTX A2000 12GB, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from.
Model	Quantization	Tokens/sec	VRAM used	Source
llama3.2:1b-instruct	q4_K_M llamafile (llama.cpp)	140.0 tok/s	—	LocalScore (Mozilla Builders) retrieved 2026-10-16
llama2:7b	q4_0 llama.cpp	45.5 tok/s	—	knightli.com llama.cpp GPU Scoreboards 2026-04-23
llama3.1:8b-instruct	q4_K_M llamafile (llama.cpp)	35.7 tok/s	—	LocalScore (Mozilla Builders) retrieved 2026-10-16
qwen2.5:14b-instruct	q4_K_M llamafile (llama.cpp)	19.5 tok/s	—	LocalScore (Mozilla Builders) retrieved 2026-10-16
qwen2.5:14b	q4_K_M llama.cpp	19.5 tok/s	—	LocalScore (Mozilla Builders)

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA RTX A2000 12GB — higher is better. Each row links to the public database the number was taken from. A benchmark listed more than once is separate published results, shown as published rather than averaged.
Benchmark	Score	Source
Geekbench 5 CUDA	83,470 points	HardwareDB retrieved 2026-04-29
Geekbench 5 OpenCL	79,123 points	HardwareDB retrieved 2026-04-29
Geekbench 6 OpenCL	72,991 points	HardwareDB retrieved 2026-04-29
Geekbench 6 Vulkan	70,140 points	HardwareDB retrieved 2026-04-29
3DMark Solar Bay	26,502 points	Notebookcheck retrieved 2026-06-09
3DMark Fire Strike	14,566 points	Notebookcheck retrieved 2026-06-09
PassMark G3D Mark	13,672 points	PassMark PerformanceTest retrieved 2026-04-29
PassMark G3D Mark	13,670 points	PassMark retrieved 2026-06-09
3DMark Fire Strike Extreme	6,995 points	Notebookcheck 2024-09-07
3DMark Time Spy	6,282 points	Notebookcheck retrieved 2026-06-09

Full Specifications

TDP	70 W
VRAM	12 GB
CUDA cores	3328
Memory type	GDDR6

NVIDIA RTX A2000 12GB — Frequently Asked Questions

What is the NVIDIA RTX A2000 12GB best used for?

NVIDIA RTX A2000 12GB is a 12 GB VRAM Ampere Pro-family workstation graphics card. Professional 3D modeling, CAD, rendering and simulation on certified drivers are the headline use cases; the benchmark tables on this page place it within its generation.

When was the NVIDIA RTX A2000 12GB released, and what was its launch MSRP?

NVIDIA RTX A2000 12GB launched in 2021 at a $450 MSRP. Street prices drift from launch pricing over a product's life, so check the current listing before buying.

Where do the NVIDIA RTX A2000 12GB benchmark numbers come from?

Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.

Can the NVIDIA RTX A2000 12GB run local LLMs?

Yes — AI inference results for the NVIDIA RTX A2000 12GB are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run. 12 GB VRAM fits 8-13B-parameter models at Q4_K_M.

Where can I buy the NVIDIA RTX A2000 12GB?

SpecPicks has no verified listing of the NVIDIA RTX A2000 12GB on file yet; the Amazon search link at the top of this page shows its current offers. SpecPicks earns a small affiliate commission on qualifying purchases.

Buying guides that rank the NVIDIA RTX A2000 12GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Editorial guides covering the NVIDIA RTX A2000 12GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →