Where do the NVIDIA L40 48GB benchmark numbers come from?

Synthetic benchmarks are aggregated from TechPowerUp, PassMark, Geekbench Browser, and Cinebench leaderboards. AI inference tokens-per-second results come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs). Every benchmark row carries an inline source citation; click through to verify the original number.

NVIDIA · GPU · Ada Lovelace Pro

NVIDIA L40 48GB — Benchmarks & Specs

Name: NVIDIA L40 48GB — Benchmarks & Specs
Brand: NVIDIA
SKU: nvidia-l40
Price: 18000 USD
Availability: InStock

48 GB VRAM300W TDP$18,000 MSRP2023

The NVIDIA L40 48GB is a graphics card from the Ada Lovelace Pro family released in 2023 from NVIDIA. Key on-paper specs include 48 GB of GDDR VRAM, 300W TDP. It launched with a $18,000 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 5 synthetic benchmark results, 6 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA L40 48GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Geekbench 5 OpenCL via technical.city (Geekbench Browser community)

333,904 points

Geekbench 5 Vulkan via technical.city (Geekbench Browser community)

237,295 points

PassMark G3D Mark via PassMark VideoCardBenchmark

27,355 points

PassMark G3D Mark via PassMark Software

27,355 points

PassMark GPU Compute via PassMark VideoCardBenchmark

23,067 points

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

llama2:7b Q4_0 via llama.cpp GitHub (CUDA perf thread)

152.0 tok/s

llama2:7b q4_0 via llama.cpp GitHub Discussion #15013

152.0 tok/s

llama3:8b Q4_K_M via GPU-Benchmarks-on-LLM-Inference (GitHub)

113.6 tok/s

llama3:8b FP16 via VMware Cloud Foundation Blog

54.1 tok/s

llama3:8b FP16 via GPU-Benchmarks-on-LLM-Inference (GitHub)

43.4 tok/s

llama3.1:70b Q4_K_M via GPU-Benchmarks-on-LLM-Inference (GitHub)

15.3 tok/s

Full Specifications

tdp w	300
vram gb	48
cuda cores	18176
memory type	GDDR6

NVIDIA L40 48GB — Frequently Asked Questions

What is the NVIDIA L40 48GB best used for?

NVIDIA L40 48GB is positioned as a 48 GB VRAM Ada Lovelace Pro-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.

When was the NVIDIA L40 48GB released, and what was its launch MSRP?

NVIDIA L40 48GB launched in 2023 at a $18,000 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.

Where do the benchmark numbers on this page come from?

Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.

Can the NVIDIA L40 48GB run local LLMs?

Yes — NVIDIA L40 48GB has 6 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 48 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.

Where can I buy the NVIDIA L40 48GB?

Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.