Where do the NVIDIA H100 PCIe 80GB benchmark numbers come from?

Synthetic benchmarks are aggregated from TechPowerUp, PassMark, Geekbench Browser, and Cinebench leaderboards. AI inference tokens-per-second results come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs). Every benchmark row carries an inline source citation; click through to verify the original number.

NVIDIA · GPU · Hopper

NVIDIA H100 PCIe 80GB — Benchmarks & Specs

Name: NVIDIA H100 PCIe 80GB — Benchmarks & Specs
Brand: NVIDIA
SKU: nvidia-h100-pcie-80gb
Price: 32000 USD
Availability: InStock

80 GB VRAM350W TDP$32,000 MSRP2022

The NVIDIA H100 PCIe 80GB is a graphics card from the Hopper family released in 2022 from NVIDIA. Key on-paper specs include 80 GB of GDDR VRAM, 350W TDP. It launched with a $32,000 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 1 synthetic benchmark result, 10 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA H100 PCIe 80GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

3DMark Time Spy via TechSpot

2,681 points

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

deepseek-r1-distill-qwen:7b FP16 via DatabaseMart

6270.0 tok/s

deepseek-r1-distill-llama:8b FP16 via DatabaseMart

5561.0 tok/s

deepseek-r1-distill-qwen:14b FP16 via DatabaseMart

3689.0 tok/s

llama3.1:8b BF16 via VALDI Docs

3621.0 tok/s

llama3.1:8b FP16 via Koyeb GPU Benchmarks

3008.0 tok/s

gemma2:27b BF16 via DatabaseMart

1575.0 tok/s

deepseek-r1-distill-qwen:32b FP16 via DatabaseMart

1192.0 tok/s

deepseek-r1-distill-qwen:32b BF16 via DatabaseMart

1192.0 tok/s

llama2:7b Q4_0 via llama.cpp GitHub Discussions

280.7 tok/s

llama3:8b Q4_K_M via XiongjieDai/GPU-Benchmarks-on-LLM-Inference (GitHub)

145.6 tok/s

Full Specifications

tdp w	350
vram gb	80
cuda cores	14592
memory type	HBM2e

NVIDIA H100 PCIe 80GB — Frequently Asked Questions

What is the NVIDIA H100 PCIe 80GB best used for?

NVIDIA H100 PCIe 80GB is positioned as a 80 GB VRAM Hopper-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.

When was the NVIDIA H100 PCIe 80GB released, and what was its launch MSRP?

NVIDIA H100 PCIe 80GB launched in 2022 at a $32,000 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.

Where do the benchmark numbers on this page come from?

Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.

Can the NVIDIA H100 PCIe 80GB run local LLMs?

Yes — NVIDIA H100 PCIe 80GB has 10 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 80 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.

Where can I buy the NVIDIA H100 PCIe 80GB?

Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.