NVIDIA Tesla P40 24GB — Benchmarks & Specs
Short answer: the NVIDIA Tesla P40 24GB generates a median 48.9 tokens/sec on 7-9B dense models at 4-bit (Q4) under llama.cpp, across 5 cited runs from llama.cpp GitHub, ComputingForGeeks and Like2Byte Tesla P40 LLM Guide. Its 24 GB of VRAM holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (20 of 27 models fit). A used eBay listing for it is $258.00, checked (listings can end at any time).
Against the NVIDIA GeForce RTX 3060 12 GB: on 7-9B dense models at 4-bit (Q4) under llama.cpp, the NVIDIA Tesla P40 24GB posts a median 48.9 tok/s (5 cited runs, llama.cpp GitHub, ComputingForGeeks) against 55.2 tok/s on the NVIDIA GeForce RTX 3060 12 GB (21 cited runs, llama.cpp GitHub, GitHub XiongjieDai/GPU-Benchmarks-on-LLM-Inference). Its 24 GB of VRAM holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M; the NVIDIA GeForce RTX 3060 12 GB's 12 GB holds up to Phi-4 14B at Q4_K_M (Will-It-Run sizing, ~8K context). Which to pick: the NVIDIA Tesla P40 24GB if you run models larger than Phi-4 14B at Q4_K_M (it holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M); the NVIDIA GeForce RTX 3060 12 GB if your models fit in 12 GB. The two medians pool runs from different sources and setups, so they are not a matched head-to-head. NVIDIA GeForce RTX 3060 12 GB benchmarks → Full head-to-head: Tesla P40 vs RTX 3090: Used 24GB GPUs for Local LLMs in 2026 →
- Median speed 48.9 tok/s 5 cited runs, 7-9B at Q4, llama.cpp
- Fits in 24 GB up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M → at ~8K context; 20 of 27 models in the Will-It-Run matrix
Who should buy this instead: the NVIDIA Tesla P40 24GB's 24 GB puts it in the 24 GB tier of the local-LLM GPU picks by VRAM (one card per tier, each with cited tok/s). If the models you run fit in 16 GB, compare the 16 GB pick. If they need more than 24 GB, start at the 48 GB+ pick.
NVIDIA Tesla P40 24GB: verdict by use case
- For everyday local models (7-9B dense): a median 48.9 tok/s at 4-bit (Q4) under llama.cpp, across 5 cited runs (llama.cpp GitHub, ComputingForGeeks). The NVIDIA GeForce RTX 3060 12 GB is the faster pick at this size: 55.2 against 48.9 tok/s median (7-9B dense, Q4, llama.cpp; pooled from different sources, not a matched test), about 13% higher.
- For the largest model in 24 GB: DeepSeek-R1-Distill-Qwen 32B at Q4_K_M with an ~8K context; 20 of the 27 models in the Will-It-Run matrix fit. By the same sizing, 65-73B models at Q4 do not fit, so 70B-class work needs a card with more VRAM or CPU offload.
Each verdict quotes a figure from a linked source or a row in the tables below. Where no cited figure exists for a use case, there is no verdict line for it.
Bottom line: how fast is the NVIDIA Tesla P40 24GB?
SpecPicks median: 48.9 tokens/sec across 5 cited single-user runs of 7-9B dense models at 4-bit (Q4) under llama.cpp (range 45.0–54.7 tok/s), from llama.cpp GitHub (3 runs), ComputingForGeeks, Like2Byte Tesla P40 LLM Guide. For local LLM inference it generates 12.4 tokens/sec running qwen3:32b at q4_K_M under llama.cpp, per ComputingForGeeks. In Geekbench 5 OpenCL it scores 62,287 points, per Geekbench Browser. Its 24 GB of VRAM is the binding constraint for local inference: the qwen3:32b run above (32.8B parameters) is the largest model on file at 4-bit quantization on this card. That run's source does not report a context length; the Will-It-Run matrix sizes each model at its listed quantization with an ~8K context, and by that measure DeepSeek-R1-Distill-Qwen 32B at Q4_K_M is the largest that fits in 24 GB.
Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from; the SpecPicks median is computed here from the runs it names, each a row in the AI table. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.
eBay listing (Used): $258.00, checked . eBay listings are third-party and can end at any time; as an eBay Partner Network member, SpecPicks may earn a commission.
Read the full comparison → Tesla P40 vs RTX 3090: Used 24GB GPUs for Local LLMs in 2026
Check what fits in 24 GB: by file size at each listed quantization, 20 of the 27 open-weight model files in the SpecPicks Will-It-Run matrix load entirely into the NVIDIA Tesla P40 24GB's 24 GB while keeping at least 1.5 GB reserved for an ~8K context; the largest that fits, DeepSeek-R1-Distill-Qwen 32B (a 19.9 GB Q4_K_M file per its Hugging Face listing), leaves roughly 5.9 GB of the card's 25.8 GB (24 GiB) free. Will DeepSeek-R1-Distill-Qwen 32B run on the Tesla P40 24GB? → · Full Will-It-Run matrix
What fits in the NVIDIA Tesla P40 24GB's 24 GB, and what doesn't
5 of these 7 model files load whole into 24 GB with room for an ~8K context. A file fits when the card keeps at least 1.5 GB free after the weights; file sizes are the GGUF downloads on Hugging Face in decimal GB, and the card's 24 GB (binary GiB) is 25.8 GB in the same units. Speeds are this card's single-user generation speed from cited community runs at the file listed; a row with no cited run says so rather than estimating one.
| Model | Quant | Fits in 24 GB? | Cited speed on this card |
|---|---|---|---|
| Llama 3.1 8B 4.9 GB file | Q4_K_M | Fits~20.8 GB left for context | 50.6 tok/smedian of 2 cited runs, per llama.cpp GitHub (Issue #30334) |
| Qwen3 14B 9 GB file | Q4_K_M | Fits~16.8 GB left for context | No public measurement on file |
| gpt-oss-20b 21B-A3.6B · 12.1 GB file | MXFP4 | Fits~13.7 GB left for context | 62.7 tok/s1 cited run, llama.cpp, per ComputingForGeeks |
| Qwen3 30B-A3B 18.6 GB file | Q4_K_M | Fits~7.2 GB left for context | 29.2 tok/s1 cited run, llama.cpp, per LocalScore (Mozilla Builders) |
| Qwen3 32B 19.8 GB file | Q4_K_M | Fits~6 GB left for context | 12.4 tok/s1 cited run, llama.cpp, per ComputingForGeeks |
| Gemma 3 27B 28.7 GB file | Q8_0 | Doesn't fit2.9 GB over; runs only with CPU offload | — (does not load into VRAM) |
| Llama 3.3 70B 42.5 GB file | Q4_K_M | Doesn't fit16.8 GB over; runs only with CPU offload | — (does not load into VRAM) |
The NVIDIA Tesla P40 24GB is a graphics card from the Pascal Pro family released in 2016 from NVIDIA. Key on-paper specs include 24 GB of GDDR5 VRAM, 250W TDP. Data on this page draws on 8 synthetic benchmark results, 28 community AI inference reports (top 13 shown), compiled from ComputingForGeeks, llama.cpp GitHub, TinyComputers.io, Like2Byte Tesla P40 LLM Guide, LocalScore, 3DMark, TopCPU, Geekbench Browser, KnightLi llama.cpp GPU Benchmark Scoreboard, PassMark Software; each table row links to its source. Read this page when shopping the NVIDIA Tesla P40 24GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).
AI Inference Performance
Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.
| Model | Quantization | Relative | Tokens/sec | VRAM used | Source |
|---|---|---|---|---|---|
| llama3.2:1b | q4_K_M llamafile (LocalScore) | 105.0 tok/s | — | LocalScore (Mozilla Builders) retrieved 2026-10-16 | |
| llama3.2:3b | — ollama | 94.3 tok/s | — | TinyComputers.io 2026-03 | |
| llama3.2:1b | q4_K_M llama.cpp | 90.5 tok/s | — | LocalScore (Mozilla Builders) retrieved 2026-05-01 | |
| gpt-oss:20b | MXFP4 llama.cpp | 62.7 tok/s | — | ComputingForGeeks 2026-10-22 | |
| llama2:7b | q4_0 llama.cpp | 54.7 tok/s | — | llama.cpp GitHub Discussions 2024-12 | |
| llama2:7b | q4_0 llama.cpp | 54.7 tok/s | — | KnightLi llama.cpp GPU Benchmark Scoreboard 2026-04-23 | |
| qwen2.5:7b | — ollama | 52.7 tok/s | — | TinyComputers.io 2026-03 | |
| llama3.1:8b | q4_0 llama.cpp | 52.3 tok/s | — | llama.cpp GitHub (Issue #30334) 2026-10-11 | |
| llama3.1:8b | q4_K_M llama.cpp | 48.9 tok/s | — | llama.cpp GitHub (Issue #30334) 2026-10-11 | |
| llama3.1:8b | — ollama | 47.8 tok/s | — | TinyComputers.io 2026-03 | |
| qwen3:8b | q4_K_M llama.cpp | 47.0 tok/s | — | ComputingForGeeks 2026-10-22 | |
| mistral:7b | q4_K_M llama.cpp | 45.0 tok/s | — | Like2Byte Tesla P40 LLM Guide 2026-02-20 | |
| qwen3:32b | q4_K_M llama.cpp | 12.4 tok/s | 19.8 GB | ComputingForGeeks 2026-10-22 |
Synthetic Benchmarks
Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.
| Benchmark | Relative | Score | Source |
|---|---|---|---|
| Geekbench 5 OpenCL | 62,287 points | Geekbench Browser retrieved 2026-05-01Same result reported by Geekbench Browser / askgeek.io | |
| PassMark G3D Mark | 11,596 points | PassMark Software retrieved 2026-06-10 | |
| 3DMark Time Spy | 8,079 points | 3DMark 2023-01Same result reported by TopCPU | |
| 3DMark Time Spy | 7,418 points | 3DMark (UL Benchmarks) 2020-01 | |
| PassMark GPU Compute | 4,082 Ops/Sec | PassMark PerformanceTest retrieved 2026-05-01 | |
| 3DMark Time Spy Extreme | 3,894 points | TopCPU retrieved 2026-09-16 | |
| Blender | 797 points | Blender Benchmark / topcpu.net retrieved 2026-08-14 | |
| OctaneBench | 166 points | OctaneBench / topcpu.net retrieved 2026-08-14 |
Full Specifications
| TDP | 250 W |
|---|---|
| VRAM | 24 GB |
| CUDA cores | 3840 |
| Memory type | GDDR5 |
NVIDIA Tesla P40 24GB — Frequently Asked Questions
What is the NVIDIA Tesla P40 24GB best used for?
When was the NVIDIA Tesla P40 24GB released?
Where do the NVIDIA Tesla P40 24GB benchmark numbers come from?
Can the NVIDIA Tesla P40 24GB run local LLMs?
Where can I buy the NVIDIA Tesla P40 24GB?
Buying guides that rank the NVIDIA Tesla P40 24GB's class
This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.
Editorial guides covering the NVIDIA Tesla P40 24GB
In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.
- Tesla P40 vs RTX 3090: Used 24GB GPUs for Local LLMs in 2026
- RTX 3060 12GB Local LLM: Reddit Consensus on What Runs (2026)
- gpt-oss on a 12GB GPU: 2026 Community Consensus (RTX 3060)
- Used RTX 3090 vs New GPU for Local LLMs: 2026 Reddit Consensus
- Best GPU for Local LLMs by VRAM: 2026 Reddit Consensus
- RTX PRO 6000 vs RTX 5090 for Local 70B LLMs: 96GB vs 32GB
- Best Mini PC Deals 2026 for Local AI and Home Labs
- GeForce Tensor-Throttle Unlock: RTX 3060 12GB vs RTX 4090 for Local LLMs
- Browse all SpecPicks reviews →
More guides & deep dives from the SpecPicks archive
Browse all articles & guides →- RTX 4070 Super vs RX 7800 XT — Which to Buy in 2026
- The Complete Voodoo5 5500 AGP Driver Guide (2026 Edition)
- Best 1440p Gaming GPUs in 2026
- Best Budget Gaming PC Build 2026 — ~$1,000 Parts List
- How to Build a Windows 98 Retro PC in 2026
- Best Retro Handhelds in 2026: Pocket, Mid-Tier and FPGA Picks
- Emulation Hardware in 2026: FPGA, Software, and Cart-Reader Ecosystems
More reviews from the SpecPicks archive
Browse all reviews →- vLLM on Windows in 2026: What Actually Works on a 12GB Card
- Mouse Wheel Scrolling Wrong Direction? Here's the Fix
- AVX-512 Software RAID on AMD Ryzen: Up to 41% Faster Linux md-RAID
- How to run DeepSeek-R1 32B on NVIDIA GeForce RTX 5080
- Best GPU Upgrade From a GTX 1050 Ti for Local LLMs in 2026
- Best Sim Racing Wheel Setup 2026: G920 vs HORI vs TH8A
- Best SSD for Local LLM Model Storage in 2026: NVMe vs SATA
- ComfyUI on an RTX 3060 12GB: Flux and SDXL Speeds in 2026
- Best Wireless Productivity Keyboards for Home Office in 2026
- Best SSDs & Cloning Tools for Gaming PC Upgrades 2026
- Best SSD for a Raspberry Pi 4 Media Server in 2026
- Jan.ai vs LM Studio vs Ollama: Easiest Local-LLM App for a 12GB Card in 2026
- Best SATA SSD to Upgrade a PlayStation 4 Pro in 2026
- Best Parts for a Local Speech and Vision AI Box in 2026
- How to run DeepSeek-R1 32B on Apple M3 Ultra
- Transcend CF133 CompactFlash as a Win98 Boot Drive: Speed Tests, Compatibility, and the Adapter That…
- Amstrad CPC 464/6128 Emulator on Raspberry Pi Pico 2
- Best Gaming Headsets and Streaming Mics for Console + PC (2026)
- PiKVM Hardware Guide 2026: Boards, Kits & Storage
- Zero-CPU-Overhead OV7725 Camera Streaming on RP2350
- Best 4K Monitor for Reviewing AI-Generated Images on an RTX 3060
- Best SSD for a Steam Deck or ROG Ally Upgrade (2026)
- RTX 5070 Ti vs RTX 5080: Is the $250 MSRP Step-Up Worth It at 1440p and 4K?
- CPU Cooler Bracket Fix: How to Secure Your CPU When It Fails
More buying guides from SpecPicks
Browse all buying guides →- Best Retro Gaming Consoles & Handhelds for 2026
- Best CPUs for Gaming in 2026
- Best NVMe External Enclosures for 2026
- Best GPUs for Running Local LLMs in 2026
- Best CPUs for Content Creators in 2026
- Best Mechanical Keyboards for Gaming in 2026
- Best DDR5 RAM for Gaming PCs in 2026
- Best Tools for Building and Repairing Retro PCs in 2026
- Best Gaming Monitors for 2026
- Best Controllers for PC Gaming in 2026
- Best AM5 Motherboards for 2026
- Best GPU for Running 27B-32B Local LLMs in 2026
- Best 4K Monitors for Content Creators in 2026
- Best External SSDs for Content Creators in 2026
- Best Gaming Mice for 2026
- Best NVMe SSDs for Gaming in 2026
- Best CPU Coolers for 2026
- Best GPUs for 4K Gaming in 2026
- Best PC Cases for Building in 2026
- Best Graphics Cards for Gaming in 2026
- Best 1440p 240Hz Gaming Monitors in 2026
Hardware benchmark data on SpecPicks
All benchmarks →- Radeon RX 6400 — benchmarks & specs
- Intel Arc A380E — benchmarks & specs
- GeForce RTX 6070 — benchmarks & specs
- Intel Core i5-13600K — benchmarks & specs
- NVIDIA GeForce RTX 3070 Ti — benchmarks & specs
- Radeon RX 9070 — benchmarks & specs
- AMD Ryzen 3 7320C — benchmarks & specs
- AMD Ryzen 7 7735U — benchmarks & specs
- Ryzen 7 7735HS — benchmarks & specs
- AMD Ryzen 9 5900 — benchmarks & specs
- Ryzen 7 4800H — benchmarks & specs
- AMD Ryzen 5 7530U — benchmarks & specs
- AMD Ryzen 9 5980HS — benchmarks & specs
- Ryzen 5 7500X3D — benchmarks & specs
- AMD Ryzen 3 5400U — benchmarks & specs
- AMD Instinct MI355X 288GB — benchmarks & specs
- Intel Arc A750 — benchmarks & specs
- AMD Ryzen 7 PRO 5750GE — benchmarks & specs
- AMD Ryzen 3 PRO 5355G — benchmarks & specs
- Intel Arc A310 — benchmarks & specs
- GeForce RTX 5060 — benchmarks & specs
- Ryzen 7 5800X — benchmarks & specs
- AMD Ryzen 5 Pro 7535U — benchmarks & specs
- Radeon RX 6800 — benchmarks & specs