Where do the NVIDIA H200 SXM 141GB benchmark numbers come from?

Synthetic benchmarks are aggregated from TechPowerUp, PassMark, Geekbench Browser, and Cinebench leaderboards. AI inference tokens-per-second results come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs). Every benchmark row carries an inline source citation; click through to verify the original number.

NVIDIA · GPU · Hopper

NVIDIA H200 SXM 141GB — Benchmarks & Specs

Q: When was the NVIDIA H200 SXM 141GB released, and what was its launch MSRP?

NVIDIA H200 SXM 141GB was released in 2024. Launch MSRP isn't on file; current pricing is visible on the linked Amazon product cards.

Q: Can the NVIDIA H200 SXM 141GB run local LLMs?

Yes — NVIDIA H200 SXM 141GB has 16 AI inference benchmark results on file (model + tokens-per-second numbers visible in the AI Inference Performance section). With 141 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization comfortably.

Q: Where can I buy the NVIDIA H200 SXM 141GB?

Active Amazon listings are linked at the top of this page and in the Products Featuring This Hardware section below. SpecPicks earns a small affiliate commission on qualifying purchases (no extra cost to the buyer).

141 GB VRAM700W TDP2024

The NVIDIA H200 SXM 141GB is a graphics card from the Hopper family released in 2024 from NVIDIA. Key on-paper specs include 141 GB of HBM3e VRAM, 700W TDP. Data on this page draws on 4 synthetic benchmark results, 10 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA H200 SXM 141GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

MLPerf Inference v5.0 — Llama 2 70B Server Scenario via CoreWeave MLPerf v5.0 Blog

33,000 tokens/s

MLPerf Inference v4.0 — Llama 2 70B Offline Scenario via NVIDIA Developer — AI Inference Performance

31,712 tokens/s

3DMark Time Spy via 3DMark

15,200 points

Port Royal (RT) via 3DMark

11,800 points

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

llama2:13b FP8 via NVIDIA TensorRT-LLM Blog

11819.0 tok/s

llama4-maverick via Metrum AI

6694.0 tok/s

deepseek-r1:671b via dstack

6311.0 tok/s

llama-3.3-70b-instruct FP8 via NVIDIA NIM LLMs Benchmarking Docs

6202.0 tok/s

deepseek-r1:671b via dstack

4176.0 tok/s

llama2:70b FP8 via NVIDIA TensorRT-LLM Blog

3014.0 tok/s

deepseek-v3:671b FP8 via Verda

2864.0 tok/s

deepseek-v3:671b BF16 via Verda

2378.0 tok/s

deepseek-r1:671b via vLLM Blog

2200.0 tok/s

llama3.1:405b FP8 via NVIDIA Technical Blog

399.9 tok/s

Full Specifications

tdp w	700
vram gb	141
vram type	HBM3e
cuda cores	16896
fp8 tflops	3958
process nm	4
form factor	SXM5
nvlink gbps	900
architecture	Hopper GH100
tensor cores	528
memory bandwidth gbps	4800

NVIDIA H200 SXM 141GB — Frequently Asked Questions

What is the NVIDIA H200 SXM 141GB best used for?

NVIDIA H200 SXM 141GB is positioned as a 141 GB VRAM Hopper-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.

When was the NVIDIA H200 SXM 141GB released, and what was its launch MSRP?

NVIDIA H200 SXM 141GB was released in 2024. MSRP isn't on file; current street prices are visible in the Amazon listings linked below.

Where do the benchmark numbers on this page come from?

Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.

Can the NVIDIA H200 SXM 141GB run local LLMs?

Yes — NVIDIA H200 SXM 141GB has 10 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 141 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.

Where can I buy the NVIDIA H200 SXM 141GB?

Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.