NVIDIA Jetson Orin NX 8GB — Benchmarks & Specs
Short answer: the NVIDIA Jetson Orin NX 8GB generates 7.5 tokens/sec on gemma4:12b (q4_K_M) under llama.cpp in a single cited run, per NVIDIA Developer Forums; there are too few comparable runs on file for a median.
Bottom line: how fast is the NVIDIA Jetson Orin NX 8GB?
For local LLM inference it generates 7.5 tokens/sec running gemma4:12b at q4_K_M under llama.cpp, per NVIDIA Developer Forums. Its 8 GB of memory, shared by the CPU and GPU, is the binding constraint for local inference: the gemma4:12b run above (12B parameters) is the largest model on file at 4-bit quantization on it.
Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from; the memory size is the on-paper spec. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.
The NVIDIA Jetson Orin NX 8GB is an APU from the Jetson Orin family released in 2023 from NVIDIA. Key on-paper specs include 6 CPU cores, 512 GPU cores, 8 GB of memory shared by the CPU and GPU. It launched with a $399 MSRP, though street prices typically diverge meaningfully from launch pricing. Data on this page draws on 16 community AI inference reports (top 13 shown), compiled from NVIDIA Developer Blog, NVIDIA Developer Forums, Advantech-Containers, ProventusNova; each table row links to its source. Read this page when shopping the NVIDIA Jetson Orin NX 8GB, comparing it against other APUs in your build, or sizing it for a specific workload (local LLM inference).
AI Inference Performance
Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.
| Model | Quantization | Relative | Tokens/sec | VRAM used | Source |
|---|---|---|---|---|---|
| smollm2:1.7b | INT4 mlc | 51.5 tok/s | — | NVIDIA Technical Blog 2025-01-16 | |
| llama3.2:3b | INT4 mlc | 34.5 tok/s | — | NVIDIA Technical Blog 2025-01-16 | |
| phi3.5-mini:3.8b | INT4 mlc | 30.8 tok/s | — | NVIDIA Technical Blog 2025-01-16 | |
| phi3.5:3.8b | — MLC | 30.8 tok/s | — | NVIDIA Developer Blog 2025-01-16 | |
| gemma2:2b | INT4 mlc | 26.6 tok/s | — | NVIDIA Technical Blog 2025-01-16 | |
| llama3.2:1b | Q8_0 llama.cpp | 18.5 tok/s | 1.3 GB | Advantech-Containers (GitHub) 2025-05 | |
| qwen2.5:7b | INT4 mlc | 17.1 tok/s | — | NVIDIA Technical Blog 2025-01-16 | |
| llama3.2:1b | q4_K_M llama.cpp | 16.5 tok/s | 1.0 GB | Advantech-Containers (GitHub) 2025-05 | |
| qwen2.5:1.5b | q4_K_M llama.cpp | 16.0 tok/s | 1.0 GB | Advantech-Containers (GitHub) 2025-05 | |
| llama3.1:8b | INT4 mlc | 15.9 tok/s | — | NVIDIA Technical Blog 2025-01-16 | |
| gemma4:4b | q4_K_M llama.cpp | 13.0 tok/s | — | NVIDIA Developer Forums 2026-06-06 | |
| llama3.1:8b | q4_K_M llama.cpp | 11.0 tok/s | — | ProventusNova 2025-01 | |
| gemma4:12b | q4_K_M llama.cpp | 7.5 tok/s | — | NVIDIA Developer Forums 2026-06-06 |
Full Specifications
| Memory | 8 GB |
|---|---|
| AI TOPS | 70 |
| CPU cores | 6 |
| GPU cores | 512 |
NVIDIA Jetson Orin NX 8GB — Frequently Asked Questions
What is the NVIDIA Jetson Orin NX 8GB best used for?
When was the NVIDIA Jetson Orin NX 8GB released, and what was its launch MSRP?
Where do the NVIDIA Jetson Orin NX 8GB benchmark numbers come from?
How many cores does the NVIDIA Jetson Orin NX 8GB have, and how does it benchmark?
Where can I buy the NVIDIA Jetson Orin NX 8GB?
Buying guides that rank the NVIDIA Jetson Orin NX 8GB's class
This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.
Editorial guides covering the NVIDIA Jetson Orin NX 8GB
In-depth SpecPicks reviews, build guides, and head-to-heads referencing this APU.
- $1,500 Gaming PC Build 2026: Parts, Cost, 1440p FPS
- RX 9060 XT 16GB vs 8GB: Which One to Buy (Benchmarks)
- Can You Build an $800 Gaming PC in 2026? Parts + Cost
- 9800X3D + RTX 5070 Ti PC Build 2026: 1440p High-Refresh
- 1080p Gaming PC Build 2026: Cost, Parts, FPS
- 1440p Gaming PC Build 2026: Cost, Parts, FPS
- $2,000 Gaming PC Build 2026: Parts, Cost, 1440p FPS
- 4K Gaming PC Build 2026: Cost, Parts, FPS
- Browse all SpecPicks reviews →
More guides & deep dives from the SpecPicks archive
Browse all articles & guides →- Best 1440p Gaming GPUs in 2026
- Emulation Hardware in 2026: FPGA, Software, and Cart-Reader Ecosystems
- The Complete Voodoo5 5500 AGP Driver Guide (2026 Edition)
- Best Retro Handhelds in 2026: Pocket, Mid-Tier and FPGA Picks
- RTX 4070 Super vs RX 7800 XT — Which to Buy in 2026
- How to Build a Windows 98 Retro PC in 2026
- Best Budget Gaming PC Build 2026 — ~$1,000 Parts List
More reviews from the SpecPicks archive
Browse all reviews →- GitHub Copilot vs Claude Code vs OpenCode Benchmark 2026
- Best Budget SSD for Gaming PC Builds in 2026: 5 Picks
- Mistral Leanstral 1.5: Running the New Open Math Model on a 12GB RTX 3060
- How to run DeepSeek-R1 32B on Apple M4 Pro
- Best Gaming PC Upgrades Under $200 in 2026: 5 Picks That Move the Needle
- Best Budget Gaming PC Parts in 2026: A 5-Pick Build List
- Best Parts for a Budget Ryzen + RTX 3060 Gaming PC Build in 2026
- Logitech G920 vs HORI Racing Wheel: Best Sim Racing Wheel for PS5 & PC
- Ryzen 7 5800X vs Core i7-9700K: Best Budget 1080p Gaming CPU in 2026
- The Best Retro Game Emulators for Mac in 2026
- Building a period-correct Windows 98 gaming rig in 2026
- G4-Meromero 31B: Running the Uncensored Gemma 4 Finetune on a 12GB RTX 3060
- M5 vs DGX Spark vs Strix Halo vs RTX 6000: AI Workload Guide
- Ryzen 7 5800X3D Hard to Find: DDR5 CPU Alternatives Worth It?
- GTX 1050 Ti in 2026: Performance, Use Cases, and Modern Comparisons
- Upgrading a Ryzen 7 5800X + RTX 4080 Build in 2026
- Ryzen 7 9800X3D vs Ryzen 9 9900X3D: Which Zen 5 X3D Chip Wins in 2026?
- Voodoo5 5500 PCI Boots on a Modern Z77 Board: Retro-on-Modern Just Got Easier
- Best Budget 4K Gaming Monitor 2026: SANSUI 27" vs KOORUI QD-Mini LED vs ASUS TUF
- Raspberry Pi vs AMD GPUs for Local LLMs: What the Specs Show
- Raspberry Pi Zero 2 W Powers a Privacy-First Ring-Camera Alternative
- Linux Gaming Keeps Closing the Gap: Kernel and Windows-API Work Behind the Gains
- Asus ROG Xreal R1 Brings 240 Hz to AR Glasses — What PC Gamers Should Know
- Best Game Controller for PC in 2026: 5 Picks From DualSense to Arcade Stick
More buying guides from SpecPicks
Browse all buying guides →- Best Graphics Cards for Gaming in 2026
- Best DDR5 RAM for Gaming PCs in 2026
- Best NVMe External Enclosures for 2026
- Best 1440p 240Hz Gaming Monitors in 2026
- Best CPU Coolers for 2026
- Best CPUs for Content Creators in 2026
- Best Gaming Mice for 2026
- Best Mechanical Keyboards for Gaming in 2026
- Best NVMe SSDs for Gaming in 2026
- Best PC Cases for Building in 2026
- Best External SSDs for Content Creators in 2026
- Best GPUs for Running Local LLMs in 2026
- Best GPUs for 4K Gaming in 2026
- Best Gaming Monitors for 2026
- Best GPU for Running 27B-32B Local LLMs in 2026
- Best Retro Gaming Consoles & Handhelds for 2026
- Best Controllers for PC Gaming in 2026
- Best CPUs for Gaming in 2026
- Best AM5 Motherboards for 2026
- Best 4K Monitors for Content Creators in 2026
- Best Tools for Building and Repairing Retro PCs in 2026
Hardware benchmark data on SpecPicks
All benchmarks →- AMD Ryzen 7 PRO 7840U — benchmarks & specs
- Ryzen 5 4500 — benchmarks & specs
- NVIDIA H100 NVL 94GB — benchmarks & specs
- AMD Ryzen 7 PRO 9745 — benchmarks & specs
- AMD Ryzen 5 9500F — benchmarks & specs
- NVIDIA RTX PRO 5000 Blackwell — benchmarks & specs
- AMD Ryzen 5 9600 — benchmarks & specs
- Radeon RX 6600 LE — benchmarks & specs
- AMD Ryzen 9 PRO 7940HS — benchmarks & specs
- NVIDIA GB300 Grace Blackwell Ultra Desktop (DGX Station) — benchmarks & specs
- Ryzen 5 7500F — benchmarks & specs
- AMD Ryzen Threadripper PRO 5975WX — benchmarks & specs
- NVIDIA RTX A5500 24GB — benchmarks & specs
- Ryzen 9 9950X — benchmarks & specs
- Meta Quest 3 128GB — benchmarks & specs
- AMD Ryzen Threadripper PRO 5955WX — benchmarks & specs
- GRID RTX6000-1Q — benchmarks & specs
- AMD Ryzen Threadripper PRO 7945WX — benchmarks & specs
- AMD Ryzen 5 5600F — benchmarks & specs
- AMD Ryzen 9 5900HX — benchmarks & specs
- AMD Ryzen 7 7840H — benchmarks & specs
- Radeon RX 5600 XT — benchmarks & specs
- Ryzen 7 4800H — benchmarks & specs
- Ryzen 3 3200G — benchmarks & specs