Skip to main content
NVIDIA Jetson Orin NX 16GB
NVIDIA · APU · Jetson Orin

NVIDIA Jetson Orin NX 16GB — Benchmarks & Specs

$599 MSRP2023

Bottom line: how fast is the NVIDIA Jetson Orin NX 16GB?

For local LLM inference it generates 68.8 tokens/sec running smollm2:1.7b under mlc-llm, per NVIDIA Developer Blog. In MLPerf v3.1 ResNet-50 Image Classification it scores 1,681.87 samples/s, per NVIDIA Developer.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

The NVIDIA Jetson Orin NX 16GB is an APU from the Jetson Orin family released in 2023 from NVIDIA. It launched with a $599 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 5 synthetic benchmark results, 12 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA Jetson Orin NX 16GB, comparing it against other APUs in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA Jetson Orin NX 16GB, in generated tokens per second. Higher is better; each row links to the community report or benchmark database it came from.
Model Quantization Relative Tokens/sec VRAM used Source
smollm2:1.7b — mlc-llm 68.8 tok/s — NVIDIA Developer Blog 2025-01-16
smollm2:1.7b — other 59.5 tok/s — NVIDIA Technical Blog 2025-01-21
smollm2:1.7b INT4 MLC 59.5 tok/s — Edge AI and Vision Alliance 2025-01-01
llama3.2:3b — mlc-llm 45.8 tok/s — NVIDIA Developer Blog 2025-01-16
phi3.5-mini:3.8b — mlc-llm 40.9 tok/s — NVIDIA Developer Blog 2025-01-16
llama3.2:3b — other 40.4 tok/s — NVIDIA Technical Blog 2025-01-21
llama3.2:3b INT4 MLC 40.4 tok/s — Edge AI and Vision Alliance 2025-01-01
gemma2:2b — mlc-llm 39.0 tok/s — NVIDIA Developer Blog 2025-01-16
phi3.5:mini INT4 MLC 35.9 tok/s — Edge AI and Vision Alliance 2025-01-01
phi3.5:3.8b — other 35.9 tok/s — NVIDIA Technical Blog 2025-01-21
gemma2:2b — other 31.6 tok/s — NVIDIA Technical Blog 2025-01-21
gemma2:2b INT4 MLC 31.6 tok/s — Edge AI and Vision Alliance 2025-01-01

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA Jetson Orin NX 16GB — higher is better. Each row links to the public database the number was taken from.
Benchmark Relative Score Source
MLPerf v3.1 ResNet-50 Image Classification 1,681.87 samples/s NVIDIA Developer 2023-11-01
MLPerf v3.1 RNN-T Speech-to-Text 327.79 samples/s NVIDIA Developer 2023-11-01
MLPerf v3.1 BERT NLP Inference 136.59 samples/s NVIDIA Developer 2023-11-01
YOLOv8 TensorRT Inference 125.15 FPS Seeed Studio Forum 2023-06-01
MLPerf v3.1 RetinaNet Object Detection 47.59 samples/s NVIDIA Developer 2023-11-01

Full Specifications

ram gb16
ai tops100
cpu cores8
gpu cores1024

NVIDIA Jetson Orin NX 16GB — Frequently Asked Questions

What is the NVIDIA Jetson Orin NX 16GB best used for?
NVIDIA Jetson Orin NX 16GB is a Jetson Orin-family integrated CPU+GPU SoC. Use it for mainstream desktops and gaming-focused builds. Check the synthetic benchmark scores below for at-a-glance comparison.
When was the NVIDIA Jetson Orin NX 16GB released, and what was its launch MSRP?
NVIDIA Jetson Orin NX 16GB launched in 2023 at a $599 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.
Where do the benchmark numbers on this page come from?
Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.
How does the NVIDIA Jetson Orin NX 16GB compare to its predecessor?
Compare NVIDIA Jetson Orin NX 16GB side-by-side against other APUs on the Compare tool below. Synthetic benchmark scores let you place this SKU within its generation; the spec table shows the architectural and process-node differences from one generation to the next.
Where can I buy the NVIDIA Jetson Orin NX 16GB?
Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.

Buying guides that rank the NVIDIA Jetson Orin NX 16GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related APUs

Editorial guides covering the NVIDIA Jetson Orin NX 16GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this APU.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →