Skip to main content
NVIDIA Tesla P40 24GB
NVIDIA · GPU · Pascal Pro

NVIDIA Tesla P40 24GB — Benchmarks & Specs

24 GB VRAM250W TDP2016

Short answer: the NVIDIA Tesla P40 24GB generates a median 48.9 tokens/sec on 7-9B dense models at 4-bit (Q4) under llama.cpp, across 5 cited runs from llama.cpp GitHub, ComputingForGeeks and Like2Byte Tesla P40 LLM Guide. Its 24 GB of VRAM holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M with an ~8K context, by the Will-It-Run matrix's sizing (20 of 27 models fit). A used eBay listing for it is $258.00, checked (listings can end at any time).

Against the NVIDIA GeForce RTX 3060 12 GB: on 7-9B dense models at 4-bit (Q4) under llama.cpp, the NVIDIA Tesla P40 24GB posts a median 48.9 tok/s (5 cited runs, llama.cpp GitHub, ComputingForGeeks) against 55.2 tok/s on the NVIDIA GeForce RTX 3060 12 GB (21 cited runs, llama.cpp GitHub, GitHub XiongjieDai/GPU-Benchmarks-on-LLM-Inference). Its 24 GB of VRAM holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M; the NVIDIA GeForce RTX 3060 12 GB's 12 GB holds up to Phi-4 14B at Q4_K_M (Will-It-Run sizing, ~8K context). Which to pick: the NVIDIA Tesla P40 24GB if you run models larger than Phi-4 14B at Q4_K_M (it holds up to DeepSeek-R1-Distill-Qwen 32B at Q4_K_M); the NVIDIA GeForce RTX 3060 12 GB if your models fit in 12 GB. The two medians pool runs from different sources and setups, so they are not a matched head-to-head. NVIDIA GeForce RTX 3060 12 GB benchmarks → Full head-to-head: Tesla P40 vs RTX 3090: Used 24GB GPUs for Local LLMs in 2026 →

Who should buy this instead: the NVIDIA Tesla P40 24GB's 24 GB puts it in the 24 GB tier of the local-LLM GPU picks by VRAM (one card per tier, each with cited tok/s). If the models you run fit in 16 GB, compare the 16 GB pick. If they need more than 24 GB, start at the 48 GB+ pick.

NVIDIA Tesla P40 24GB: verdict by use case

  • For everyday local models (7-9B dense): a median 48.9 tok/s at 4-bit (Q4) under llama.cpp, across 5 cited runs (llama.cpp GitHub, ComputingForGeeks). The NVIDIA GeForce RTX 3060 12 GB is the faster pick at this size: 55.2 against 48.9 tok/s median (7-9B dense, Q4, llama.cpp; pooled from different sources, not a matched test), about 13% higher.
  • For the largest model in 24 GB: DeepSeek-R1-Distill-Qwen 32B at Q4_K_M with an ~8K context; 20 of the 27 models in the Will-It-Run matrix fit. By the same sizing, 65-73B models at Q4 do not fit, so 70B-class work needs a card with more VRAM or CPU offload.

Each verdict quotes a figure from a linked source or a row in the tables below. Where no cited figure exists for a use case, there is no verdict line for it.

Bottom line: how fast is the NVIDIA Tesla P40 24GB?

SpecPicks median: 48.9 tokens/sec across 5 cited single-user runs of 7-9B dense models at 4-bit (Q4) under llama.cpp (range 45.0–54.7 tok/s), from llama.cpp GitHub (3 runs), ComputingForGeeks, Like2Byte Tesla P40 LLM Guide. For local LLM inference it generates 12.4 tokens/sec running qwen3:32b at q4_K_M under llama.cpp, per ComputingForGeeks. In Geekbench 5 OpenCL it scores 62,287 points, per Geekbench Browser. Its 24 GB of VRAM is the binding constraint for local inference: the qwen3:32b run above (32.8B parameters) is the largest model on file at 4-bit quantization on this card. That run's source does not report a context length; the Will-It-Run matrix sizes each model at its listed quantization with an ~8K context, and by that measure DeepSeek-R1-Distill-Qwen 32B at Q4_K_M is the largest that fits in 24 GB.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from; the SpecPicks median is computed here from the runs it names, each a row in the AI table. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

eBay listing (Used): $258.00, checked . eBay listings are third-party and can end at any time; as an eBay Partner Network member, SpecPicks may earn a commission.

Read the full comparison → Tesla P40 vs RTX 3090: Used 24GB GPUs for Local LLMs in 2026

Check what fits in 24 GB: by file size at each listed quantization, 20 of the 27 open-weight model files in the SpecPicks Will-It-Run matrix load entirely into the NVIDIA Tesla P40 24GB's 24 GB while keeping at least 1.5 GB reserved for an ~8K context; the largest that fits, DeepSeek-R1-Distill-Qwen 32B (a 19.9 GB Q4_K_M file per its Hugging Face listing), leaves roughly 5.9 GB of the card's 25.8 GB (24 GiB) free. Will DeepSeek-R1-Distill-Qwen 32B run on the Tesla P40 24GB? → · Full Will-It-Run matrix

What fits in the NVIDIA Tesla P40 24GB's 24 GB, and what doesn't

5 of these 7 model files load whole into 24 GB with room for an ~8K context. A file fits when the card keeps at least 1.5 GB free after the weights; file sizes are the GGUF downloads on Hugging Face in decimal GB, and the card's 24 GB (binary GiB) is 25.8 GB in the same units. Speeds are this card's single-user generation speed from cited community runs at the file listed; a row with no cited run says so rather than estimating one.

ModelQuantFits in 24 GB?Cited speed on this card
Llama 3.1 8B 4.9 GB fileQ4_K_MFits~20.8 GB left for context50.6 tok/smedian of 2 cited runs, per llama.cpp GitHub (Issue #30334)
Qwen3 14B 9 GB fileQ4_K_MFits~16.8 GB left for contextNo public measurement on file
gpt-oss-20b 21B-A3.6B · 12.1 GB fileMXFP4Fits~13.7 GB left for context62.7 tok/s1 cited run, llama.cpp, per ComputingForGeeks
Qwen3 30B-A3B 18.6 GB fileQ4_K_MFits~7.2 GB left for context29.2 tok/s1 cited run, llama.cpp, per LocalScore (Mozilla Builders)
Qwen3 32B 19.8 GB fileQ4_K_MFits~6 GB left for context12.4 tok/s1 cited run, llama.cpp, per ComputingForGeeks
Gemma 3 27B 28.7 GB fileQ8_0Doesn't fit2.9 GB over; runs only with CPU offload— (does not load into VRAM)
Llama 3.3 70B 42.5 GB fileQ4_K_MDoesn't fit16.8 GB over; runs only with CPU offload— (does not load into VRAM)

The NVIDIA Tesla P40 24GB is a graphics card from the Pascal Pro family released in 2016 from NVIDIA. Key on-paper specs include 24 GB of GDDR5 VRAM, 250W TDP. Data on this page draws on 8 synthetic benchmark results, 28 community AI inference reports (top 13 shown), compiled from ComputingForGeeks, llama.cpp GitHub, TinyComputers.io, Like2Byte Tesla P40 LLM Guide, LocalScore, 3DMark, TopCPU, Geekbench Browser, KnightLi llama.cpp GPU Benchmark Scoreboard, PassMark Software; each table row links to its source. Read this page when shopping the NVIDIA Tesla P40 24GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA Tesla P40 24GB, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from.
Model Quantization Relative Tokens/sec VRAM used Source
llama3.2:1b q4_K_M llamafile (LocalScore) 105.0 tok/s — LocalScore (Mozilla Builders) retrieved 2026-10-16
llama3.2:3b — ollama 94.3 tok/s — TinyComputers.io 2026-03
llama3.2:1b q4_K_M llama.cpp 90.5 tok/s — LocalScore (Mozilla Builders) retrieved 2026-05-01
gpt-oss:20b MXFP4 llama.cpp 62.7 tok/s — ComputingForGeeks 2026-10-22
llama2:7b q4_0 llama.cpp 54.7 tok/s — llama.cpp GitHub Discussions 2024-12
llama2:7b q4_0 llama.cpp 54.7 tok/s — KnightLi llama.cpp GPU Benchmark Scoreboard 2026-04-23
qwen2.5:7b — ollama 52.7 tok/s — TinyComputers.io 2026-03
llama3.1:8b q4_0 llama.cpp 52.3 tok/s — llama.cpp GitHub (Issue #30334) 2026-10-11
llama3.1:8b q4_K_M llama.cpp 48.9 tok/s — llama.cpp GitHub (Issue #30334) 2026-10-11
llama3.1:8b — ollama 47.8 tok/s — TinyComputers.io 2026-03
qwen3:8b q4_K_M llama.cpp 47.0 tok/s — ComputingForGeeks 2026-10-22
mistral:7b q4_K_M llama.cpp 45.0 tok/s — Like2Byte Tesla P40 LLM Guide 2026-02-20
qwen3:32b q4_K_M llama.cpp 12.4 tok/s 19.8 GB ComputingForGeeks 2026-10-22

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA Tesla P40 24GB — higher is better. Each row links to the public database the number was taken from. A benchmark listed more than once is separate published results, shown as published rather than averaged.
Benchmark Relative Score Source
Geekbench 5 OpenCL 62,287 points Geekbench Browser retrieved 2026-05-01Same result reported by Geekbench Browser / askgeek.io
PassMark G3D Mark 11,596 points PassMark Software retrieved 2026-06-10
3DMark Time Spy 8,079 points 3DMark 2023-01Same result reported by TopCPU
3DMark Time Spy 7,418 points 3DMark (UL Benchmarks) 2020-01
PassMark GPU Compute 4,082 Ops/Sec PassMark PerformanceTest retrieved 2026-05-01
3DMark Time Spy Extreme 3,894 points TopCPU retrieved 2026-09-16
Blender 797 points Blender Benchmark / topcpu.net retrieved 2026-08-14
OctaneBench 166 points OctaneBench / topcpu.net retrieved 2026-08-14

Full Specifications

TDP250 W
VRAM24 GB
CUDA cores3840
Memory typeGDDR5

NVIDIA Tesla P40 24GB — Frequently Asked Questions

What is the NVIDIA Tesla P40 24GB best used for?
NVIDIA Tesla P40 24GB is a 24 GB VRAM Pascal Pro-family graphics card. High-end 4K gaming and local LLM inference are the headline use cases; the benchmark tables on this page place it within its generation.
When was the NVIDIA Tesla P40 24GB released?
NVIDIA Tesla P40 24GB was released in 2016, a Pascal Pro-generation part.
Where do the NVIDIA Tesla P40 24GB benchmark numbers come from?
Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.
Can the NVIDIA Tesla P40 24GB run local LLMs?
Yes — AI inference results for the NVIDIA Tesla P40 24GB are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run. With 24 GB VRAM, 32B-parameter open-weight models fit at Q4 quantization.
Where can I buy the NVIDIA Tesla P40 24GB?
SpecPicks has no verified listing of the NVIDIA Tesla P40 24GB on file yet; the Amazon search link at the top of this page shows its current offers. SpecPicks earns a small affiliate commission on qualifying purchases.

Buying guides that rank the NVIDIA Tesla P40 24GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Editorial guides covering the NVIDIA Tesla P40 24GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this graphics card.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →