Skip to main content
NVIDIA H100 NVL 94GB
NVIDIA · GPU · Hopper

NVIDIA H100 NVL 94GB — Benchmarks & Specs

94 GB VRAM400W TDP$40,000 MSRP2023

The NVIDIA H100 NVL 94GB is a graphics card from the Hopper family released in 2023 from NVIDIA. Key on-paper specs include 94 GB of GDDR VRAM, 400W TDP. It launched with a $40,000 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 10 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA H100 NVL 94GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

llama3.1:8b BF16 via MorphLLM
12500.0 tok/s
llama3.3:70b FP8 via NVIDIA NIM Benchmarking Docs
8579.9 tok/s
deepseek-r1-distill-qwen:7b FP16 via DatabaseMart
7314.9 tok/s
deepseek-r1-distill-llama:8b FP16 via DatabaseMart
6488.4 tok/s
deepseek-r1-distill-qwen:14b FP16 via DatabaseMart
4304.1 tok/s
gemma2:27b FP16 via DatabaseMart
1574.7 tok/s
deepseek-r1-distill-qwen:32b FP16 via DatabaseMart
1390.6 tok/s
deepseek-r1-distill-qwen:32b FP16 via DatabaseMart
1192.0 tok/s
llama3.1:70b FP8 via MorphLLM
460.0 tok/s
llama2:7b q4_0 via llama.cpp GitHub Discussions
280.7 tok/s

Full Specifications

tdp w400
vram gb94
cuda cores14592
memory typeHBM2e

NVIDIA H100 NVL 94GB — Frequently Asked Questions

What is the NVIDIA H100 NVL 94GB best used for?
NVIDIA H100 NVL 94GB is positioned as a 94 GB VRAM Hopper-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.
When was the NVIDIA H100 NVL 94GB released, and what was its launch MSRP?
NVIDIA H100 NVL 94GB launched in 2023 at a $40,000 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.
Where do the benchmark numbers on this page come from?
Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.
Can the NVIDIA H100 NVL 94GB run local LLMs?
Yes — NVIDIA H100 NVL 94GB has 10 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 94 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.
Where can I buy the NVIDIA H100 NVL 94GB?
Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.

Related GPUs

Editorial guides covering the NVIDIA H100 NVL 94GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →