NVIDIA RTX PRO 5000 Blackwell — Benchmarks & Specs
Bottom line: how fast is the NVIDIA RTX PRO 5000 Blackwell?
For local LLM inference it generates 23.7 tokens/sec running qwen2.5:72b at q4_K_M under ollama, per DatabaseMart. In PassMark G3D Mark it scores 32,459 points, per PassMark Software. Its 48 GB of VRAM is the binding constraint for local inference: the qwen2.5:72b run above (72B parameters) is the largest model on file at 4-bit quantization on this card.
Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.
The NVIDIA RTX PRO 5000 Blackwell is a graphics card from the Blackwell Pro family released in 2025 from NVIDIA. Key on-paper specs include 48 GB of GDDR7 VRAM, 300W TDP. Data on this page draws on 2 synthetic benchmark results, 38 community AI inference reports (top 12 shown), compiled from DatabaseMart, PassMark Software, GPU Battle; each table row links to its source. Read this page when shopping the NVIDIA RTX PRO 5000 Blackwell, comparing it against other graphics cards in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).
AI Inference Performance
Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.
| Model | Quantization | Relative | Tokens/sec | VRAM used | Source |
|---|---|---|---|---|---|
| llama3.1:8b | FP16 vllm | 2462.5 tok/s | — | DatabaseMart 2025-10-01 | |
| qwen3:4b | q4_K_M llama.cpp | 298.8 tok/s | 3.1 GB | GPU Battle 2026-07-12 |
Batched serving throughput
| Model | Quantization | Relative | Tokens/sec (aggregate) | VRAM used | Source |
|---|---|---|---|---|---|
| qwen3:8b | FP16 vllm batched | 2479.5 tok/s aggregate | — | DatabaseMart 2025-10-01 | |
| qwen3:8b | FP16 vllm batched | 2125.3 tok/s aggregate | — | DatabaseMart 2026-01-29 | |
| llama3.1:8b | FP16 vllm 50 concurrent requests | 2113.8 tok/s aggregate | — | DatabaseMart 2026-01-01 | |
| gemma-3-12b-it | FP16 vllm batched | 1483.8 tok/s aggregate | — | DatabaseMart 2025-10-01 | |
| deepseek-r1-distill-qwen:14b | FP16 vllm batched | 1466.3 tok/s aggregate | — | DatabaseMart 2025-10-01 | |
| deepseek-r1:14b | FP16 vllm 50 concurrent requests | 1466.3 tok/s aggregate | 28.0 GB | DatabaseMart 2026-08-03 | |
| gemma3:12b | FP16 vllm 50 concurrent requests | 1273.7 tok/s aggregate | — | DatabaseMart 2026-08-25 | |
| deepseek-r1-distill-qwen:14b | FP16 vllm 50 concurrent requests | 1258.6 tok/s aggregate | — | DatabaseMart 2026-08-25 | |
| deepseek-r1:14b | FP16 vllm batched | 1258.6 tok/s aggregate | — | DatabaseMart 2026-01-29 | |
| qwen3:14b | FP16 vllm batched | 1251.2 tok/s aggregate | — | DatabaseMart 2026-01-29 |
Synthetic Benchmarks
Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.
| Benchmark | Relative | Score | Source |
|---|---|---|---|
| PassMark G3D Mark | 32,459 points | PassMark Software 2026-09-24 | |
| PassMark G2D Mark | 1,271 points | PassMark Software 2026-09-24 |
Full Specifications
| tdp w | 300 |
|---|---|
| vram gb | 48 |
| cuda cores | 14080 |
| memory type | GDDR7 |
NVIDIA RTX PRO 5000 Blackwell — Frequently Asked Questions
What is the NVIDIA RTX PRO 5000 Blackwell best used for?
When was the NVIDIA RTX PRO 5000 Blackwell released, and what was its launch MSRP?
Where do the NVIDIA RTX PRO 5000 Blackwell benchmark numbers come from?
Can the NVIDIA RTX PRO 5000 Blackwell run local LLMs?
Where can I buy the NVIDIA RTX PRO 5000 Blackwell?
Buying guides that rank the NVIDIA RTX PRO 5000 Blackwell's class
This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.
Editorial guides covering the NVIDIA RTX PRO 5000 Blackwell
In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.
- Prime Big Deal Days 2026: Best Mini PC Deals for Local AI and Home Labs
- Raspberry Pi 4 8GB vs Ryzen 5 2600 for Gemma 3 4B: Which Cheap Box Wins?
- RTX 4090 vs RTX 5090 for Local LLM Inference: 24 GB vs 32 GB (2026)
- Best Hardware for Local OCR and Document AI in 2026
- Best GPU for gpt-oss 20B in 2026
- Arc Pro B60 Dual 48GB vs Dual RTX 3060 12GB for 70B Local LLMs (2026)
- Ryzen 5 5600X vs Ryzen 5 5600G for CPU-Only Gemma 3 12B
- Prime Big Deal Days 2026 GPU Deals for Local LLMs: 12GB vs 16GB Cards
- Browse all SpecPicks reviews →
More guides & deep dives from the SpecPicks archive
Browse all articles & guides →- RTX 4070 Super vs RX 7800 XT — Which to Buy in 2026
- How to Build a Windows 98 Retro PC in 2026
- Best Budget Gaming PC Build 2026 — ~$1,000 ($800 on Sale)
- The Complete Voodoo5 5500 AGP Driver Guide (2026 Edition)
- Best 1440p Gaming GPUs in 2026
- Best Retro Handhelds in 2026 — From $35 to $500
- Emulation Hardware in 2026: FPGA, Software, and Cart-Reader Ecosystems
More reviews from the SpecPicks archive
Browse all reviews →- Best Cooling Solutions for Modern Gaming PCs (2026)
- Best budget SSD for a gaming PC in 2026: BX500 vs 970 EVO Plus vs SSD Plus
- Logitech G29 / G920 Not Detected on Windows 11: Step-by-Step Driver Fix Guide (2026)
- AI-Driven Win98 Voodoo Driver Install: A Repeatable Vision-LLM Playbook for the Sound Blaster Audigy FX
- Self-hosting a Claude proxy — cache, rate-limit, and audit every request
- Best SSD for Steam Deck and Handheld Gaming Storage Expansion 2026
- GPT-5.6 Rollout Now Requires US Government Sign-Off, Customer by Customer
- Razer Blade 16 (2026) Review: Gaming Performance and Endurance
- Llama 3.3 70B: Dual RTX 3060 12GB vs Ryzen 7 5800X CPU Offload (2026)
- LM Studio vs Ollama on an RTX 3060 12GB: Which Local Runtime in 2026?
- Ideogram 4.0 Open Weights: Running It Locally on an RTX 3060 12GB
- Qwen3.6-35B-A3B VRAM Optimization: Why Bigger Quants Win
- GLM-5.2 Review: The Most Powerful Open-Weights LLM You Can Self-Host in 2026
- Ideogram 4.0 Open Weights: Running Text-to-Image on a 12GB GPU
- Raspberry Pi 5 Power Supply: What You Actually Need (2026)
- Run DeepSeek & Qwen Locally on an RTX 3060 12GB (2026 Guide)
- Jensen Huang Heads to Tokyo as Sega's 1996 Bet on Nvidia Is Remembered
- GPU Benchmark Data Freshness and Source Attribution in 2026
- A DIY Wireless Fingerprint Authorization Device Turns Heads on Hackaday
- Best CPU Cooler for Ryzen 7 5800X Heavy Workloads (2026)
- Unified RAM for LLMs: 2025-2026 Hardware Guide
- Best Budget Streaming Starter Kit for Twitch & YouTube in 2026
- RTX 3060 12GB vs RTX 4070 Super for Local LLMs (2026): Same VRAM, 40% More Bandwidth
- Beijing's $295B AI Buildout Wants 80% Domestic Chips — What It Means for GPU Buyers
More buying guides from SpecPicks
Browse all buying guides →- Best Retro Gaming Consoles & Handhelds for 2026
- Best CPU Coolers for 2026
- Best 4K Monitors for Content Creators in 2026
- Best 1440p 240Hz Gaming Monitors in 2026
- Best Gaming Monitors for 2026
- Best Controllers for PC Gaming in 2026
- Best PC Cases for Building in 2026
- Best DDR5 RAM for Gaming PCs in 2026
- Best Tools for Building and Repairing Retro PCs in 2026
- Best AM5 Motherboards for 2026
- Best GPU for Running 27B-32B Local LLMs in 2026
- Best NVMe External Enclosures for 2026
- Best Graphics Cards for Gaming in 2026
- Best CPUs for Gaming in 2026
- Best NVMe SSDs for Gaming in 2026
- Best GPUs for 4K Gaming in 2026
- Best CPUs for Content Creators in 2026
- Best GPUs for Running Local LLMs in 2026
- Best External SSDs for Content Creators in 2026
- Best Gaming Mice for 2026
- Best Mechanical Keyboards for Gaming in 2026
Hardware benchmark data on SpecPicks
All benchmarks →- AMD Ryzen 5 PRO 5655GE — benchmarks & specs
- AMD Ryzen Threadripper PRO 9965WX — benchmarks & specs
- ARM Apple M1 (Virtual) 4 Core 0 MHz — benchmarks & specs
- Ryzen 5 5600G — benchmarks & specs
- AMD Ryzen 5 PRO 7640HS — benchmarks & specs
- WD Black SN850X 2TB — benchmarks & specs
- AMD Ryzen 9 PRO 7945 — benchmarks & specs
- Radeon RX 9070 GRE — benchmarks & specs
- GeForce RTX 4070 SUPER — benchmarks & specs
- Ryzen 7 5800H — benchmarks & specs
- AMD Ryzen 3 7335U — benchmarks & specs
- AMD Ryzen 7 PRO 5800H — benchmarks & specs
- Apple M4 Max — benchmarks & specs
- GeForce RTX 4060 Ti 16GB — benchmarks & specs
- Intel Core i7-14700K — benchmarks & specs
- Radeon RX 5700 XT — benchmarks & specs
- NVIDIA A100 PCIe 80GB — benchmarks & specs
- AMD Ryzen 9 7940H — benchmarks & specs
- Ryzen 5 5500 — benchmarks & specs
- Ryzen 5 4600G — benchmarks & specs
- Ryzen 7 5700X — benchmarks & specs
- Intel Arc B570 — benchmarks & specs
- AMD Ryzen 5 5600U — benchmarks & specs
- Intel Arc A750 — benchmarks & specs