Skip to main content
AMD Instinct MI210 64GB
AMD · GPU · CDNA2

AMD Instinct MI210 64GB — Benchmarks & Specs

64 GB VRAM300W TDP$13,000 MSRP2021

Short answer: the AMD Instinct MI210 64GB generates 125 tokens/sec on llama2:7b (q4_0) under llama.cpp in a single cited run, per llama.cpp GitHub; there are too few comparable runs on file for a median. Its 64 GB of VRAM holds up to DeepSeek-R1-Distill-Llama 70B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (27 of 27 models fit). A used eBay listing for it is $3,927.02, checked (listings can end at any time).

Against the NVIDIA Tesla P40 24GB: The AMD Instinct MI210 64GB's 64 GB of VRAM holds up to DeepSeek-R1-Distill-Llama 70B at Q4_K_M; the NVIDIA Tesla P40 24GB's 24 GB holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M (Will-It-Run sizing, ~8K context). Which to pick: the AMD Instinct MI210 64GB if you run models larger than DeepSeek-R1-Distill-Qwen 32B at Q4_K_M (it holds up to DeepSeek-R1-Distill-Llama 70B at Q4_K_M); the NVIDIA Tesla P40 24GB if your models fit in 24 GB. NVIDIA Tesla P40 24GB benchmarks →

View used on eBay — $3,927.02 → Search Amazon for the AMD Instinct MI210 64GB →

Who should buy this instead: the AMD Instinct MI210 64GB's 64 GB puts it in the 48 GB+ tier of the local-LLM GPU picks by VRAM (one card per tier, each with cited tok/s). If the models you run fit in 24 GB, compare the 24 GB pick. If they need more than 64 GB, start at the 128 GB unified pick.

Bottom line: how fast is the AMD Instinct MI210 64GB?

For local LLM inference it generates 124.5 tokens/sec running llama2:7b at q4_0 under llama.cpp, per llama.cpp GitHub. In HBM2e L2 Cache Bandwidth (micro-benchmark) it scores 3,700 GB/s, per Chips and Cheese. It has 64 GB of VRAM, and the llama2:7b run above (7B parameters) is the largest model on file at 4-bit quantization on this card. A second published run of the same setup measured 143.8 tokens/sec, per llama.cpp GitHub again, so expect 124.5-143.8 tokens/sec. Larger models have no sourced run on file.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

eBay listing (Used): $3,927.02, checked . eBay listings are third-party and can end at any time; as an eBay Partner Network member, SpecPicks may earn a commission.

Check what fits in 64 GB: by file size at each listed quantization, 27 of the 27 open-weight model files in the SpecPicks Will-It-Run matrix load entirely into the AMD Instinct MI210 64GB's 64 GB while keeping at least 1.5 GB reserved for an ~8K context; the largest, DeepSeek-R1-Distill-Llama 70B (a 42.5 GB Q4_K_M file per its Hugging Face listing), leaves roughly 21.5 GB free. Will DeepSeek-R1-Distill-Llama 70B run on the Instinct MI210 64GB? → · Full Will-It-Run matrix

What fits in the AMD Instinct MI210 64GB's 64 GB, and what doesn't

7 of these 7 model files load whole into 64 GB with room for an ~8K context. A file fits when the card keeps at least 1.5 GB free after the weights; file sizes are the GGUF downloads on Hugging Face. Speeds are this card's single-user generation speed from cited community runs at the Q4-class file listed; a row with no cited run says so rather than estimating one.

ModelQuantFits in 64 GB?Cited speed on this card
Llama 3.1 8B 4.9 GB fileQ4_K_MFits~59.1 GB left for contextNo public measurement on file
Qwen3 14B 9 GB fileQ4_K_MFits~55 GB left for contextNo public measurement on file
gpt-oss-20b 21B-A3.6B · 12.1 GB fileMXFP4Fits~51.9 GB left for contextNo public measurement on file
Qwen3 30B-A3B 18.6 GB fileQ4_K_MFits~45.4 GB left for contextNo public measurement on file
Qwen3 32B 19.8 GB fileQ4_K_MFits~44.2 GB left for contextNo public measurement on file
Gemma 3 27B 28.7 GB fileQ8_0Fits~35.3 GB left for contextNo public measurement on file
Llama 3.3 70B 42.5 GB fileQ4_K_MFits~21.5 GB left for contextNo public measurement on file

The AMD Instinct MI210 64GB is a datacenter accelerator from the CDNA2 family released in 2021 from AMD. Key on-paper specs include 64 GB of HBM2e memory, 300W TDP. It launched with a $13,000 MSRP, though street prices typically diverge meaningfully from launch pricing. Data on this page draws on 2 synthetic benchmark results, 7 community AI inference reports, compiled from Apolo Multi-GPU Benchmarks Report, llama.cpp GitHub, AMD Official Specs, Chips and Cheese, EmbeddedLLM, ROCm GitHub Issues; each table row links to its source. Read this page when shopping the AMD Instinct MI210 64GB, comparing it against other datacenter accelerators for your server or cluster, or sizing it for a specific workload (LLM inference and serving, fine-tuning, or HPC compute).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the AMD Instinct MI210 64GB, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from. Batched serving runs are listed separately below.
Model Quantization Relative Tokens/sec VRAM used Source
llama2:7b q4_0 llama.cpp 143.8 tok/s — llama.cpp GitHub discussion #15021 (Performance of llama.cpp on AMD ROCm/HIP) 2026-06-16
llama2:7b Q4_0 llama.cpp 124.5 tok/s — llama.cpp GitHub (ROCm HIP scoreboard) 2024-06

Batched serving throughput

Aggregate output tokens per second on the AMD Instinct MI210 64GB summed across many concurrent requests (serving runtimes such as vLLM). This is total server throughput, not one user's generation speed — each request generates far slower — so these rows are not comparable with the single-stream table above.
Model Quantization Relative Tokens/sec (aggregate) VRAM used Source
llama2:7b BF16 vllm batched 718.1 tok/s aggregate — EmbeddedLLM 2023-10-27
qwen:1.5b FP16 vllm batched 618.5 tok/s aggregate — Apolo Multi-GPU Benchmarks Report 2025-03-03
llama3.2:3b FP16 vllm batched 545.3 tok/s aggregate — Apolo Multi-GPU Benchmarks Report 2025-03-03
llama3:8b FP16 vllm batched 400.0 tok/s aggregate — ROCm GitHub Issues 2024-06
llama3.1:8b FP16 vllm batched 397.2 tok/s aggregate — Apolo Multi-GPU Benchmarks Report 2025-03-03

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the AMD Instinct MI210 64GB — higher is better. Each row links to the public database the number was taken from.
Benchmark Relative Score Source
HBM2e L2 Cache Bandwidth (micro-benchmark) 3,700 GB/s Chips and Cheese 2023-07-28
HBM2e Peak Memory Bandwidth (theoretical) 1,638 GB/s AMD Official Specs 2022-01-14

Full Specifications

TDP300 W
VRAM64 GB
Memory typeHBM2e

AMD Instinct MI210 64GB — Frequently Asked Questions

What is the AMD Instinct MI210 64GB best used for?
AMD Instinct MI210 64GB is a 64 GB VRAM CDNA2-family graphics card. High-end 4K gaming and local LLM inference are the headline use cases; the benchmark tables on this page place it within its generation.
When was the AMD Instinct MI210 64GB released, and what was its launch MSRP?
AMD Instinct MI210 64GB launched in 2021 at a $13,000 MSRP. Street prices drift from launch pricing over a product's life, so check the current listing before buying.
Where do the AMD Instinct MI210 64GB benchmark numbers come from?
Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.
Can the AMD Instinct MI210 64GB run local LLMs?
Yes — AI inference results for the AMD Instinct MI210 64GB are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run. With 64 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization.
Where can I buy the AMD Instinct MI210 64GB?
SpecPicks has no verified listing of the AMD Instinct MI210 64GB on file yet; the Amazon search link at the top of this page shows its current offers. SpecPicks earns a small affiliate commission on qualifying purchases.

Buying guides that rank the AMD Instinct MI210 64GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related GPUs

Editorial guides covering the AMD Instinct MI210 64GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this datacenter accelerator.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →