Skip to main content
AMD Instinct MI300X 192GB
AMD · GPU · CDNA 3

AMD Instinct MI300X 192GB — Benchmarks & Specs

192 GB VRAM750W TDP$15,000 MSRP2023

The AMD Instinct MI300X 192GB is a graphics card from the CDNA 3 family released in 2023 from AMD. Key on-paper specs include 192 GB of GDDR VRAM, 750W TDP. It launched with a $15,000 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 2 synthetic benchmark results, 9 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the AMD Instinct MI300X 192GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

MLPerf Inference v4.1 — Llama-3.1-405B Server (8x MI300X) via AMD ROCm Blog / MLPerf
24,110 tokens/s
MLPerf Inference v4.1 — Llama-2-70B Server (8x MI300X) via AMD ROCm Blog / MLPerf
22,021 tokens/s

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

llama3.1:70b FP8 via AMD ROCm Blog
10505.0 tok/s
llama3.1:405b FP8 via AMD ROCm Blog
1999.0 tok/s
qwen3:8b via AMD ROCm Blog
1142.1 tok/s
qwen3:8b q4_K_M via llama.cpp GitHub
161.5 tok/s
deepseek-v3:671b q4_K_M via AMD ROCm Blog
43.0 tok/s
kimi-k2:671b q4_K_M via llama.cpp GitHub
38.1 tok/s
llama3.1:70b q4_K_M via AMD ROCm Blog
36.4 tok/s
deepseek-r1-distill-llama:70b q4_K_M via llama.cpp GitHub
36.3 tok/s
deepseek-r1:671b IQ1_S via llama.cpp GitHub
33.1 tok/s

Full Specifications

tdp w750
vram gb192
process nm5
bf16 tflops1307
fp16 tflops1307
memory typeHBM3
compute units304
shading units19456
memory bandwidth gbps5300

AMD Instinct MI300X 192GB — Frequently Asked Questions

What is the AMD Instinct MI300X 192GB best used for?
AMD Instinct MI300X 192GB is positioned as a 192 GB VRAM CDNA 3-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.
When was the AMD Instinct MI300X 192GB released, and what was its launch MSRP?
AMD Instinct MI300X 192GB launched in 2023 at a $15,000 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.
Where do the benchmark numbers on this page come from?
Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.
Can the AMD Instinct MI300X 192GB run local LLMs?
Yes — AMD Instinct MI300X 192GB has 9 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 192 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.
Where can I buy the AMD Instinct MI300X 192GB?
Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.

Related GPUs

Editorial guides covering the AMD Instinct MI300X 192GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →