Where do the NVIDIA B200 benchmark numbers come from?

Synthetic benchmarks are aggregated from TechPowerUp, PassMark, Geekbench Browser, and Cinebench leaderboards. AI inference tokens-per-second results come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs). Every benchmark row carries an inline source citation; click through to verify the original number.

NVIDIA · GPU · Blackwell

NVIDIA B200 — Benchmarks & Specs

Q: When was the NVIDIA B200 released, and what was its launch MSRP?

NVIDIA B200 was released in 2024. Launch MSRP isn't on file; current pricing is visible on the linked Amazon product cards.

Q: Can the NVIDIA B200 run local LLMs?

Yes — NVIDIA B200 has 35 AI inference benchmark results on file (model + tokens-per-second numbers visible in the AI Inference Performance section). With 192 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization comfortably.

Q: Where can I buy the NVIDIA B200?

Active Amazon listings are linked at the top of this page and in the Products Featuring This Hardware section below. SpecPicks earns a small affiliate commission on qualifying purchases (no extra cost to the buyer).

192 GB VRAM1000W TDP2024

The NVIDIA B200 is a graphics card from the Blackwell family released in 2024 from NVIDIA. Key on-paper specs include 192 GB of HBM3e VRAM, 1000W TDP. Data on this page draws on 3 synthetic benchmark results, 10 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA B200, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

MLPerf Inference v5.1 — Llama 2 70B Offline via Lambda AI / MLCommons MLPerf Inference v5.1

102,725 tok/s

MLPerf Inference v6.0 — gpt-oss 120B Offline via Nebius / MLCommons MLPerf Inference v6.0

85,921 tok/s

MLPerf Inference v6.0 — DeepSeek R1 Offline via Nebius / MLCommons MLPerf Inference v6.0

58,582 tok/s

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

llama3.1:8b FP4 via Lambda AI (MLPerf Inference v6.0)

160403.0 tok/s

Mixtral 8x7B FP4 via Supermicro (MLPerf Inference v5.0)

129047.0 tok/s

mixtral:8x7b FP4 via NVIDIA Developer Blog (MLPerf Inference v5.0)

128148.0 tok/s

llama2:70b FP4 via Lambda AI (MLPerf Inference v5.1)

102725.0 tok/s

llama2:70b FP8 via Lambda AI / MLPerf Inference v5.1

102725.0 tok/s

Llama 2 70B FP4 via Lambda AI (MLPerf Inference v5.1)

102725.0 tok/s

gpt-oss-120b NVFP4 via Nebius / MLPerf Inference v6.0

87444.0 tok/s

gpt-oss:120b FP4 via Nebius (MLPerf Inference v6.0)

85921.0 tok/s

llama4-maverick:400b NVFP4 via NVIDIA Developer Blog

72000.0 tok/s

deepseek-r1:671b FP4 via Nebius (MLPerf Inference v6.0)

58582.0 tok/s

Full Specifications

tdp w	1000
segment	data-center
vram gb	192
vram type	HBM3e
cuda cores	16896
process nm	5
form factor	SXM
l2 cache mb	50
architecture	Blackwell
interconnect	NVLink 5.0
memory bandwidth gbps	8000
nvlink bandwidth tbps	1.8

NVIDIA B200 — Frequently Asked Questions

What is the NVIDIA B200 best used for?

NVIDIA B200 is positioned as a 192 GB VRAM Blackwell-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.

When was the NVIDIA B200 released, and what was its launch MSRP?

NVIDIA B200 was released in 2024. MSRP isn't on file; current street prices are visible in the Amazon listings linked below.

Where do the benchmark numbers on this page come from?

Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.

Can the NVIDIA B200 run local LLMs?

Yes — NVIDIA B200 has 10 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 192 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.

Where can I buy the NVIDIA B200?

Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.