NVIDIA · GPU

NVIDIA GeForce RTX 6090 — Benchmarks & Specs

Short answer: the NVIDIA GeForce RTX 6090 generates 5.0 tokens/sec on gemma:26b (q4_0) under llama.cpp in a single cited run, per LocalLLaMA; there are too few comparable runs on file for a median.

Bottom line: how fast is the GeForce RTX 6090?

For local LLM inference it generates 5.0 tokens/sec running gemma:26b at q4_0 under llama.cpp, per LocalLLaMA.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

The GeForce RTX 6090 is a graphics card from NVIDIA. Data on this page draws on 2 community AI inference reports, compiled from LocalLLaMA; each table row links to its source. Read this page when shopping the GeForce RTX 6090, comparing it against other graphics cards in your build, or sizing it for a specific workload (local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the GeForce RTX 6090, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from.
Model	Quantization	Relative	Tokens/sec	VRAM used	Source
qwen3:0.6b	— ollama		47.1 tok/s	—	LocalLLaMA 2026-04-15
gemma:26b	q4_0 llama.cpp		5.0 tok/s	—	LocalLLaMA 2026-04-16

GeForce RTX 6090 — Frequently Asked Questions

Where do the GeForce RTX 6090 benchmark numbers come from?

Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.

Can the GeForce RTX 6090 run local LLMs?

Yes — AI inference results for the GeForce RTX 6090 are on file; the AI Inference Performance section on this page lists model, quantization and tokens-per-second for each run.

Where can I buy the GeForce RTX 6090?

No verified listing for this exact part is on file yet. The Compare tool and the /benchmarks index cover adjacent parts that are in stock.