Where do the NVIDIA L40S 48GB benchmark numbers come from?

Synthetic benchmarks are aggregated from TechPowerUp, PassMark, Geekbench Browser, and Cinebench leaderboards. AI inference tokens-per-second results come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs). Every benchmark row carries an inline source citation; click through to verify the original number.

NVIDIA · GPU · Ada Lovelace Pro

NVIDIA L40S 48GB — Benchmarks & Specs

Name: NVIDIA L40S 48GB — Benchmarks & Specs
Brand: NVIDIA
SKU: nvidia-l40s
Price: 22000 USD
Availability: InStock

48 GB VRAM350W TDP$22,000 MSRP2023

The NVIDIA L40S 48GB is a graphics card from the Ada Lovelace Pro family released in 2023 from NVIDIA. Key on-paper specs include 48 GB of GDDR VRAM, 350W TDP. It launched with a $22,000 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 2 synthetic benchmark results, 10 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA L40S 48GB, comparing it against other graphics cards in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Geekbench 6 OpenCL via Tom's Hardware

352,507 points

PassMark G3D Mark via PassMark Software

20,023 points

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Llama 3 8B Instruct W4A8KV4 (QServe) via Crusoe

3568.8 tok/s

Llama 3.1 8B Instruct FP8 via Red Hat (MLPerf Inference v5.1)

1642.0 tok/s

Llama 3.1 8B Instruct FP8 via Red Hat (MLPerf Inference v5.1)

1207.0 tok/s

Llama 3.1 8B FP16 via Fluence

325.1 tok/s

Llama 3 8B Q4_K_M via GPU-Benchmarks-on-LLM-Inference (GitHub)

113.6 tok/s

llama3:8b q4_K_M via XiongjieDai/GPU-Benchmarks-on-LLM-Inference (GitHub)

113.6 tok/s

llama3.1:8b FP8 via NVIDIA NIM LLMs Benchmarking

72.6 tok/s

qwen2.5:7b via Koyeb GPU Benchmarks

49.0 tok/s

deepseek-r1-distill-llama-8b via Koyeb GPU Benchmarks

46.0 tok/s

llama3.1:8b q4_K_M via LocalScore.ai

45.9 tok/s

Full Specifications

tdp w	350
vram gb	48
cuda cores	18176
memory type	GDDR6

NVIDIA L40S 48GB — Frequently Asked Questions

What is the NVIDIA L40S 48GB best used for?

NVIDIA L40S 48GB is positioned as a 48 GB VRAM Ada Lovelace Pro-family graphics card. Use it for high-end 4K gaming and local LLM inference. See the synthetic + AI benchmark tables below for measured performance.

When was the NVIDIA L40S 48GB released, and what was its launch MSRP?

NVIDIA L40S 48GB launched in 2023 at a $22,000 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.

Where do the benchmark numbers on this page come from?

Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.

Can the NVIDIA L40S 48GB run local LLMs?

Yes — NVIDIA L40S 48GB has 10 AI inference benchmarks on file (see the AI Inference Performance section above for model + tokens-per-second numbers). With 48 GB VRAM, it fits the popular 32B-parameter open-weight models at Q4 quantization comfortably.

Where can I buy the NVIDIA L40S 48GB?

Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.