RTX 5090 AI Build Guide: CPU, RAM, PSU & Cooling for Local Inference

An RTX 5090 local-inference build wants a modern 8-16 core CPU, 64GB of DDR5, a 1000W-class ATX 3.1 power supply with a native 12V-2x6 connector, and either a large air cooler or a 240mm+ AIO on the CPU. Budget roughly $3,500 all-in with the card. The GPU is the star; the rest of the parts list exists to keep it fed without becoming the bottleneck or the failure point.

Editorial intro: who buys a 5090 for AI

The 5090 arrived in early 2025 with 32GB of GDDR7 and, more importantly for local-LLM work, memory bandwidth north of 1.7 TB/s per NVIDIA's 50-series page — roughly double the RTX 4090 it replaced. That bandwidth is what makes a Q4-quantized 32B model like Qwen 3.6 32B or Llama 3.5 34B run at 40-50 tok/s on a single card. It's also what makes the card 575W TGP and, therefore, an interesting build challenge.

The audience for a 5090-centric AI build is not the tinkerer with a 12GB card who wants to run 27B models — that person is served by our Qwen 3.6 on RTX 3060 guide and probably shouldn't be spending $2,000+ on a GPU. The 5090 build is for the developer or small-team ML engineer who wants a workstation that runs the current generation of 30B/70B-quantized models at productive speeds without spinning up cloud GPUs, and who's willing to spec the rest of the rig around one very hot, very power-hungry card. This guide walks that parts list, notes where the money is well spent, and — importantly — flags the places builders reflexively over-spec.

If you want an on-ramp with the same platform and lower up-front cost, an AMD Ryzen 7 5800X plus MSI RTX 3060 Ventus 3X 12G build shares the same CPU, PSU, and cooling class and lets you drop in the 5090 later. That's a legitimate strategy given 5090 supply, and we'll return to it in the bottom line.

Key takeaways

• CPU class: 8-16 cores at high boost. A Ryzen 7 5800X, Ryzen 9 7900X, or Core i7-14700K are all fine — this workload does not reward a Threadripper.
• RAM: 64GB DDR5-5600 minimum, 96GB or 128GB if you plan to CPU-offload 70B models. Dual-channel matters more than capacity beyond 64GB.
• PSU: 1000W minimum with ATX 3.1 and a native 16-pin 12V-2x6 cable. Do NOT use an adapter.
• Cooling: Air (Noctua NH-D15 class) or a good 240mm AIO like the Cooler Master ML240L on the CPU; the GPU cools itself. A 360mm is only warranted for very high-core CPUs sustained at 100%.
• Storage: A single 1TB Samsung 970 EVO Plus NVMe or newer PCIe 4.0 drive is fine; larger models want 2TB to hold multiple quants comfortably.
• Case: 45L+ ATX with good top exhaust. The 5090's 3-slot cooler is huge; measure before you buy.

Step 0 — diagnose the workload

The single biggest parts-list mistake with a 5090 AI build is speccing for a workload the builder doesn't actually have.

• Inference-only chat/RAG: 8-core CPU, 64GB RAM, single NVMe. The GPU does everything. Overspending on CPU here is money set on fire.
• Fine-tuning small (7B) models on a single 5090: Still fine on 8-16 cores, but you'll want 96-128GB of RAM to hold datasets in memory.
• Fine-tuning larger (30B+) models with LoRA/QLoRA: You want fast NVMe for checkpoints and 128GB of RAM. Still no need for Threadripper.
• Gaming + AI on the same rig: This is where high single-thread perf earns its keep. A 7800X3D or 14700K makes sense over a 5800X.
• Multi-GPU expansion: Different story entirely. You need PCIe lane counts and a HEDT-class platform. Not the 5090-single-card guide.

If you don't need multi-GPU or heavy CPU-side data pipelines, the workload is bandwidth-bound to the GPU and everything else exists to keep that GPU fed.

Which CPU pairs sensibly with an RTX 5090 for inference?

Community measurements collected on r/LocalLLaMA show that single-user local inference is remarkably CPU-insensitive when the model fits fully in VRAM. Going from a 6-core Ryzen 5 5600G to a 16-core 9950X changes generation throughput by a few percent at most, per the same workload — the CPU's job is orchestration, not compute.

The honest recommendation: buy the Ryzen 7 5800X if you're primarily doing inference. It's mature, cheap, and does not become the bottleneck. Save the CPU-budget delta for the 5090 you're actually optimizing around.

How much system RAM does a 5090-class build need?

The 5090 has 32GB of VRAM — enough to hold a Q4_K_M-quantized 34B model with 8k context fully resident. For that workload, system RAM is orchestration only, and 64GB is plenty.

The two scenarios that push you past 64GB:

1. CPU-offloaded 70B models. A Q4_K_M 70B model weighs ~40GB — most of it lives in RAM if you want to load it at all. Add OS + tooling overhead and you're using 60-64GB of system RAM before you start.
2. Heavy fine-tuning data pipelines. Batching 100k+ conversational examples in memory beats hitting SSD every epoch.

Skip the "buy fastest RAM you can" reflex. DDR5-5600 CL36 is well under $200 for a 64GB kit and 6000 CL30 costs 20-30% more for a real-world 2-3% inference gain. That money buys better cooling.

PSU wattage and connectors for a 575W-TGP card

The 5090's rated TGP is 575W with reported transient spikes to 900W+, according to reviews from Tom's Hardware. Add ~200W for a modern CPU + drives + fans and the rated system draw sits around 800W under a worst-case load.

PSU sizing rule: total sustained draw + 30-40% headroom for transients. That puts a 5090 build at 1000W minimum, with 1200W a safe pick for anyone who wants the transient margin. Older PSUs work electrically but produce two failure modes:

1. Melting 12VHPWR connectors. The original 12VHPWR spec had genuine contact-quality problems and burned a handful of 4090 cables. The ATX 3.1 revision — 12V-2x6 — moves the sense pins and is safer. You want a PSU with a native 12V-2x6 cable, not an adapter.
2. Transient shutdowns. Older PSUs OCP-trip on the 5090's spikes even when average draw is well below rating. Buy an ATX 3.1 unit rated for GPU transients.

Best-practice PSU spec for a 5090 build:

• 1000-1200W
• ATX 3.1 compliant
• Native 12V-2x6 cable (no adapter)
• 80 Plus Gold or better
• Single-rail preferred for GPU-heavy builds

Do not skimp here. This is the component whose failure kills every other component.

Spec-delta table: CPU options for the build

Community-published inference measurements aren't always apples-to-apples, but the pattern is consistent: with the model fully in VRAM, generation throughput varies within 5% across sane modern desktop CPUs.

Those tok/s numbers are noisy — the takeaway is that on inference-only workloads the CPU is not the bottleneck. Prompt-eval throughput scales better with CPU cores but even there the delta is 10-15%, not 2x.

Benchmark table: expected tok/s tiers by model size on 32GB VRAM

Rough tiers for the 5090 based on community measurements of comparable 32-38B GGUF models on the card:

A 5090's honest workload sweet spot is 14B-34B models at high quant. It runs 70B models via CPU offload, but the moment you spill to system RAM the throughput drops to what a 3090 does — cheaper hardware would have gotten you there.

Cooling: air vs 240mm AIO

The 5090 cools itself. Your cooling budget is for the CPU and case airflow.

If you're chasing quiet, the Cooler Master MasterLiquid ML240L puts the fans up top and out of the GPU's exhaust column, which noticeably lowers case temps when the 5090 is dumping 500W of heat sideways. The GPU is the room heater; keep the case's top and rear paths clear and don't stack the CPU cooler where it re-ingests the GPU's hot air.

Perf-per-dollar: 5090 build vs a dual-3060 budget alternative

If you priced this out today (mid-2026):

The 5090's headline win versus a used 3090 is roughly 2.2x the throughput for 4x the money. That's a real regression on pure perf-per-dollar. What it buys you: 32GB of VRAM (34B Q4 comfortably), current architecture (fp8, tensor-core generation 5), full warranty, and no need to source used cards.

Dual-3060 rigs are miserable to configure for LLM inference. VRAM doesn't pool the way GPU memory does across model-parallel workloads — you need either tensor parallelism (llama.cpp supports it partially, vLLM does better) or run separate model instances. It's a legitimate answer for hobbyists; it is not a productivity build.

Common pitfalls

1. Buying a 750W PSU because the RTX 5090 "rated draw is 575W". Transient spikes trip OCP; average draw isn't the metric to size against.
2. Adapting an old 12VHPWR cable. Even if it "fits", the sense-pin geometry changed. Buy an ATX 3.1 PSU with a native 12V-2x6 or accept a small but real fire risk.
3. 32GB of RAM. Every 5090 build with 32GB ends up upgrading within a month once the owner tries a 70B offload.
4. A 4-slot case. The 5090 reference cooler is 3 slots and 336mm long. Measure the case. Twice.
5. Overspending on the CPU. A 9950X does not make inference faster than a 5800X. It makes you $370 poorer.
6. DDR5-8000+ RAM kits. The XMP/EXPO stability at extreme speeds isn't worth the bragging rights on this workload.

When NOT to build a 5090-centric rig

• You only run 7B/8B models. A 12GB 3060 or even an M-series Mac Mini is dramatically better $/tok.
• You're renting cloud GPUs at $2/hour and running <1000 hours a year. Cloud math wins.
• You want to fine-tune 30B+ models seriously. A 5090 handles small LoRA runs but you'll want an H100/A100 for real training.
• You're on a stock 550W PSU and 350L case. The path to a 5090 build includes replacing those; that's a bigger project than swapping a card.

Bottom line: the balanced parts list

For a productivity local-inference workstation targeting 30B/34B-class models at Q4:

• GPU: RTX 5090 32GB
• CPU: AMD Ryzen 7 5800X or a 7800X3D if the rig also games
• RAM: 64GB DDR5-5600 CL36 (upgrade to 96/128 if 70B is on the roadmap)
• PSU: 1000-1200W ATX 3.1 with native 12V-2x6 (do NOT downgrade)
• CPU Cooler: Cooler Master ML240L or Noctua NH-D15
• Storage: Samsung 970 EVO Plus 1TB NVMe as scratch, plus a 2TB PCIe 4.0 drive for model weights
• Case: 45L+ ATX with good top exhaust; a mesh front panel is doing real work with a 5090 inside
• Backup path: If a 5090 is out of stock (still happening), buy the CPU/PSU/RAM/case now with a Ryzen 5 5600G or Ryzen 7 5800X and an MSI RTX 3060 Ventus 3X 12G and drop the 5090 in later.

Skip the $349 CPU and the $250 360mm AIO. Spend the delta on RAM headroom or the 2TB weight drive.

Related reading

• Run Qwen 3.6 27B Locally on a 12GB RTX 3060
• llama.cpp vs Ollama vs vLLM on a 12GB RTX 3060
• Best Mini PC for Local LLMs in 2026

Citations and sources

• NVIDIA — GeForce RTX 5090 official product page
• TechPowerUp — GeForce RTX 5090 specifications
• Tom's Hardware — GPU reviews and 12V-2x6 connector coverage
• r/LocalLLaMA — community measurement threads for 5090 and 34B/70B workloads

This piece is editorial synthesis based on publicly available information. No independent first-party benchmarking is reported.