Direct answer: For a local LLM library in 2026, run a small NVMe drive for the model you use right now and a large SATA drive for everything else. A 250GB NVMe like the Samsung 970 EVO Plus 250GB is fast enough to make cold-load latency invisible; a 1TB SATA drive like the Crucial BX500 1TB holds the archive at a fraction of the cost per gigabyte. Buying one big NVMe drive for both roles is almost always the wrong tradeoff.
Step 0 diagnostic: are you load-time-bound or capacity-bound?
Two questions decide the entire storage layout. Both have honest answers.
How often do you switch models? If you load one model, use it for hours, and rarely switch, load-time latency is a rounding error and you are capacity-bound. Buy for capacity. If you switch models several times an hour — running comparison harnesses, evaluating quantization deltas, testing a coding agent's behavior across three different backbones — cold-load latency is what you feel and you are latency-bound.
How much are you willing to spend per gigabyte? As of July 2026, decent 4TB NVMe drives cost roughly $180 to $250 street. Decent 4TB SATA drives cost $130 to $180. The delta is smaller than it used to be but it is not zero. If you plan a library that will grow to multiple terabytes, the price-per-gigabyte gap matters more than the interface-speed gap.
How model libraries actually grow
A local LLM library grows faster than most people plan for. A single 14B model at q6 is roughly 10GB on disk. The same model at q4, q5, and q8 is another 20 to 25GB combined. A 32B model at q4 alone is 18GB, at q6 it is 26GB, and if you keep the fp16 version around for reference it is another 60GB. Four models across three quantizations is a quarter of a terabyte, and that is before you have added embedding models, sentence-transformer variants, LoRA adapters, or GGUF-plus-safetensors of the same weights.
Below is a table of typical footprints per model size class, at the quantizations people actually use in practice. These numbers are approximate; the exact bytes-per-parameter for each quantization scheme varies by tokenizer and by whether embeddings are quantized separately.
| Model class | q4 | q6 | q8 | fp16 |
|---|---|---|---|---|
| 8B | 4.5 GB | 6.5 GB | 8.5 GB | 16 GB |
| 14B | 8 GB | 10.5 GB | 14 GB | 28 GB |
| 32B | 18 GB | 24 GB | 32 GB | 64 GB |
| 70B | 40 GB | 52 GB | 70 GB | 140 GB |
| MoE with 8 experts | 45 GB | 65 GB | 90 GB | 180 GB |
Multiply by the number of distinct model families you follow and it is easy to end up with a 500GB to 1TB library within a year of casual model-shopping. That is why capacity dominates the storage decision for most people, not sequential-read throughput.
Key takeaways
- Model library size doubles yearly for anyone who is actively following the open-weights space; plan for a terabyte, not a couple of hundred gigabytes.
- Cold-load time on a 14B q6 model: roughly 3 seconds on a fast NVMe, 12 seconds on a SATA SSD, 55 seconds on a hard drive.
- Second-load time is free on any SSD because the operating system's page cache holds the weights in RAM after the first load.
- Endurance ratings on cheap TLC drives are more than enough for a read-heavy workload like a model library.
- The two-tier split is the only layout that gives you both cheap capacity and comfortable cold-load latency.
How big does a model library actually get?
Beyond the raw model-size table above, the real driver of library growth is the pattern of keeping multiple quantizations of the same weights. A serious local user typically holds q4 and q6 side by side because q4 is what runs fast and q6 is the fallback when q4 misbehaves on a specific prompt. Anyone doing quantization research holds q3, q4, q5, q6, and q8 of the same weights so they can measure the exact quality delta. Anyone doing production deployment holds fp16 as the archive-of-truth so that they can requantize from a known-good baseline if a downstream tool changes its GGUF format.
Add embedding models — bge, gte, nomic, jina, and the newest closed-model APIs' open equivalents — plus sentence-transformer variants and you have another 20 to 40GB of small-model overhead. Add LoRA adapters and small fine-tunes and it grows again. Add multi-modal models — vision-and-language, audio-and-language — and each of those adds 15 to 60GB per checkpoint.
A conservative estimate for a serious local user's library one year in is 400GB. An aggressive estimate is 1.2TB. Either way, storage is not something you buy in fifty-gigabyte increments.
Does NVMe actually load models faster than SATA?
Yes, meaningfully, on a cold load. No, at all, on a warm load. That distinction is the point.
Sequential read speeds on the Samsung 970 EVO Plus run to about 3,500 MB/s. On the Crucial BX500, sequential read runs to about 550 MB/s. That is a real six-to-seven-times difference on paper, and it shows up on the first load of a model from disk.
A 10GB model loaded cold from NVMe takes about 3 seconds. The same model loaded cold from SATA takes about 18 seconds. The same model loaded from a hard drive takes about 55 seconds. On the second and every subsequent load in the same session, the model is in the operating system's page cache and load time is under a second regardless of the underlying interface. That is why the load-time argument for NVMe is real for cold starts and disappears for the warm-cache case.
The SanDisk SSD Plus 480GB is priced between the two and is a fair pick when a specific slot in the case wants a middle-capacity SATA drive; sequential read behavior is similar to the BX500.
Spec-delta: three consumer picks side by side
| Drive | Interface | Sequential read | Capacity | Endurance (TBW) | Best role |
|---|---|---|---|---|---|
| Samsung 970 EVO Plus 250GB | NVMe PCIe 3.0 | 3,500 MB/s | 250 GB | 150 TBW | Hot model, cold-load matters |
| Crucial BX500 1TB | SATA III | 550 MB/s | 1 TB | 360 TBW | Archive, capacity matters |
| SanDisk SSD Plus 480GB | SATA III | 535 MB/s | 480 GB | 200 TBW | Middle-capacity SATA |
Two takeaways. First, endurance is not a real concern on any of these drives for a model library, which is a read-heavy workload. The BX500's 360 TBW rating would take you a decade of active model rotation to burn through. Second, price-per-gigabyte matters more than sequential-read numbers once the working model is loaded, which is why the SATA archive drive is the right role for the big cheap drive.
The two-tier layout that most people should run
The layout is boring on purpose. A 250GB NVMe drive holds the model you are actively using — the one you loaded five minutes ago and will load again in an hour. A 1TB SATA drive holds everything else: the models you might use next week, the alternate quantizations for comparison, the embedding models, the LoRA adapters, and the fp16 archive-of-truth files. Swap the hot model to NVMe when you switch backbones. The mv takes a few seconds and it is a tiny fraction of the wall-clock time you would spend running the new model anyway.
For anyone with two NVMe slots available and a bigger budget, the pattern scales: a 1TB or 2TB NVMe as the hot tier and a 4TB SATA as the archive. The interface-speed premium on the hot drive gets you nothing if the model is already page-cached, and it gets you a few seconds if it is not.
Does storage affect tokens per second once the model is loaded?
Almost never. Once the model weights are in VRAM, storage is out of the loop. There is exactly one exception: an offloaded model with mmap enabled and heavy CPU offload can, on rare configurations, page weight blocks in and out of the file cache during inference. In that specific case a fast underlying drive helps because the paged blocks are re-read from disk. In every other configuration — everything fits in VRAM, or the CPU-offloaded blocks are held resident in system RAM — the drive interface speed is irrelevant during inference.
If you find yourself in the mmap-plus-heavy-offload configuration, the correct fix is more VRAM or more system RAM, not a faster drive. The drive is doing what a drive should do; the model is the wrong shape for your hardware.
Endurance and write amplification: not the constraint you think
A model library is a read-heavy workload. Weights are written once — either downloaded from Hugging Face or produced by a quantization run — and then read hundreds or thousands of times. TBW (total bytes written) endurance ratings on modern TLC and QLC drives are dominated by the write side of the workload, so a read-heavy model library barely dents them.
The Crucial SSD family documents 360 TBW for the BX500 1TB. To burn that in five years, you would need to write 200GB per day, every day. A model library that grew by 200GB per day for five years would be more than 360TB by the end, which is not a library, that is a career.
Write amplification is a related concern that also is not a concern here. Amplification matters when small random writes overwrite large flash blocks. A model download is a sequential write of tens of gigabytes into empty space; the amplification factor is close to 1.0. Ignore endurance and buy the cheapest drive that meets your capacity target.
Perf-per-dollar math
Compare the two picks on their actual value per role. At approximate July 2026 street prices, the 250GB Samsung 970 EVO Plus is roughly $45 and the 1TB Crucial BX500 is roughly $75. That is $0.18 per gigabyte for the NVMe and $0.075 per gigabyte for the SATA drive — a 2.4x premium for the interface upgrade. On cold-load latency the NVMe pays back on its role; on archive capacity, the SATA drive pays back on its role. Combined, the two drives cost $120 and give you both properties at once.
Buying the equivalent capacity as a single 1TB NVMe drive is roughly $110 at the same street pricing, which looks cheaper, but you have then paid for interface speed you cannot use on the 750GB of archive that will never be page-cached. The two-drive split is not more expensive; it is more honest about which byte gets which interface.
When NOT to upgrade
Three cases where staying on the drive you have today is the right call. First, if your current drive has more than 200GB of free space and you rarely switch models, cold-load latency is not your problem and you should spend the money on more VRAM or more system RAM. Second, if you are running a single model in production and it stays loaded for weeks at a time, storage is out of the loop and the case for any upgrade is theoretical. Third, if you are still on a hard-disk drive: any SATA SSD is a giant upgrade for cold-load times, so start there rather than jumping straight to NVMe.
Bottom line
Local LLM libraries want two drives. A Samsung 970 EVO Plus 250GB NVMe as the hot tier and a Crucial BX500 1TB SATA SSD as the archive is the honest starting point for a serious local user, and it is priced so that the two-drive split is cheaper than the single-drive alternative once you match total capacity. Pair the storage with a decent CPU and GPU — the MSI GeForce RTX 3060 Ventus 3X 12G and an AMD Ryzen 7 5800X are the reference workhorses — and you have a rig that runs the models you want to run without ever hitting the wrong bottleneck.
Related guides
- Ryzen 7 5800X vs 5700X for a Dual-Duty Gaming and Local-LLM Build
- Open-Weight Models Caught Up on Cyber Benchmarks in Four Months
- Inkling 975B Open Weights
- Open WebUI on a Raspberry Pi 4, Inference on an RTX 3060
Citations and sources
- Crucial SSD product line — endurance ratings and sequential-read specs for the BX500 family, accessed July 2026.
- Samsung consumer internal SSDs — reference specs for the 970 EVO Plus, accessed July 2026.
- Tom's Hardware best SSDs roundup — third-party benchmark corroboration for the picks cited, accessed July 2026.
_This is an editorial synthesis of published product specifications and benchmark data. Verify current pricing and capacity availability with the retailer before making a purchase decision._
