Where do the AMD Instinct MI355X 288GB benchmark numbers come from?

Synthetic benchmarks are aggregated from TechPowerUp, PassMark, Geekbench Browser, and Cinebench leaderboards. AI inference tokens-per-second results come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs). Every benchmark row carries an inline source citation; click through to verify the original number.

AMD Instinct MI355X 288GB Benchmarks & Specs

Q: When was the AMD Instinct MI355X 288GB released, and what was its launch MSRP?

AMD Instinct MI355X 288GB was released in 2025. Launch MSRP isn't on file; current pricing is visible on the linked Amazon product cards.

Q: Can the AMD Instinct MI355X 288GB run local LLMs?

Yes — AMD Instinct MI355X 288GB has 26 AI inference benchmark results on file (model + tokens-per-second numbers visible in the AI Inference Performance section). With 288 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization comfortably.

Q: Where can I buy the AMD Instinct MI355X 288GB?

Active Amazon listings are linked at the top of this page and in the Products Featuring This Hardware section below. SpecPicks earns a small affiliate commission on qualifying purchases (no extra cost to the buyer).

Bottom line: how fast is the AMD Instinct MI355X 288GB?

For local LLM inference it generates 103480.0 tokens/sec running llama2:70b at FP4 under vllm, per AMD ROCm Blog. Its 288 GB of VRAM is the binding constraint for local inference: that capacity fits 70B-parameter open-weight models at Q4 without offloading.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

The AMD Instinct MI355X 288GB is a graphics card from the CDNA 4 family released in 2025 from AMD. Key on-paper specs include 288 GB of GDDR VRAM, 1400W TDP. Data on this page draws on 12 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the AMD Instinct MI355X 288GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the AMD Instinct MI355X 288GB, in generated tokens per second. Higher is better; each row links to the community report or benchmark database it came from.
Model	Quantization	Tokens/sec	VRAM used	Source
llama2:70b	FP4 vllm	103480.0 tok/s	—	AMD ROCm Blog 2026-04-01
llama2:70b	MXFP4 vllm	103480.0 tok/s	—	AMD ROCm Blog 2026-04-01
gpt-oss-120b	MXFP4 vllm	95004.0 tok/s	—	AMD ROCm Blog 2026-04-01
qwen3-235b-a22b	FP8 vllm	14043.0 tok/s	—	Metrum AI 2026-01-01
llama2:70b	FP4 other	12535.0 tok/s	—	StorageReview 2026-04-01
llama2:70b	FP4 vllm	12535.0 tok/s	—	AMD ROCm Blogs (MLPerf Inference v6.0) 2026-04-01
gpt-oss-120b	FP4 vllm	10267.0 tok/s	—	AMD ROCm Blogs (MLPerf Inference v6.0) 2026-04-01
kimi-k2.5	FP4 vllm	2687.0 tok/s	—	InferenceX by SemiAnalysis 2026-06-01
deepseek-r1-0528:671b	MXFP4 sglang	2436.0 tok/s	—	LMSYS Org 2026-05-28
deepseek-r1:671b	MXFP4 sglang	2436.0 tok/s	—	LMSYS Org 2026-05-28
deepseek-r1:671b	FP4 sglang	2436.0 tok/s	—	LMSYS 2026-05-28
deepseek-r1:671b	FP8 sglang	2378.0 tok/s	—	LMSYS 2026-05-28

Full Specifications

tdp w	1400
cooling	direct liquid
vram gb	288
fp4 tflops	20100
fp6 tflops	20100
fp8 tflops	10100
process nm	3
fp16 tflops	5000
fp64 tflops	78.6
memory type	HBM3E
compute units	256
memory bandwidth gbps	8000

AMD Instinct MI355X 288GB — Frequently Asked Questions

What is the AMD Instinct MI355X 288GB best used for?

AMD Instinct MI355X 288GB is positioned as a 288 GB VRAM CDNA 4-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.

When was the AMD Instinct MI355X 288GB released, and what was its launch MSRP?

AMD Instinct MI355X 288GB was released in 2025. MSRP isn't on file; current street prices are visible in the Amazon listings linked below.

Where do the benchmark numbers on this page come from?

Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.

Can the AMD Instinct MI355X 288GB run local LLMs?

Yes — AMD Instinct MI355X 288GB has 12 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 288 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.

Where can I buy the AMD Instinct MI355X 288GB?

Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.