Skip to main content
NVIDIA Jetson Orin NX 16GB
NVIDIA · APU · Jetson Orin

NVIDIA Jetson Orin NX 16GB — Benchmarks & Specs

$599 MSRP2023

Short answer: the NVIDIA Jetson Orin NX 16GB generates 18.0 tokens/sec on llama3.1:8b (q4_K_M) under llama.cpp in a single cited run, per ProventusNova; there are too few comparable runs on file for a median.

  • Single cited run 18.0 tok/s llama3.1:8b q4_K_M, per ProventusNova
  • Lowest linked price $1,389.99 Amazon, checked ; prices change
Compare 8 current listings ↓ Find NVIDIA Jetson Orin NX 16GB on eBay → View Current Price on Amazon → Details →

Bottom line: how fast is the NVIDIA Jetson Orin NX 16GB?

For local LLM inference it generates 18.0 tokens/sec running llama3.1:8b at q4_K_M under llama.cpp, per ProventusNova. In MLPerf v3.1 ResNet-50 Image Classification it scores 1,681.87 samples/s, per NVIDIA Developer. It has 16 GB of memory shared by the CPU and GPU, and the largest model on file at 4-bit quantization on it is gemma2:9b (9B parameters, INT4), generating 10.6 tokens/sec under MLC, per Edge AI and Vision Alliance. Larger models have no sourced run on file.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from; the memory size is the on-paper spec. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

Amazon listing: $1,389.99

This Amazon listing is above the NVIDIA Jetson Orin NX 16GB's $599 launch MSRP. Compare new and used listings on eBay before buying.

*Price sourced from Amazon.com. Last updated 2026-10-21. Price and availability subject to change.

The NVIDIA Jetson Orin NX 16GB is an APU from the Jetson Orin family released in 2023 from NVIDIA. Key on-paper specs include 8 CPU cores, 1024 GPU cores, 16 GB of memory shared by the CPU and GPU. It launched with a $599 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current listings. Data on this page draws on 9 linked listings, 5 synthetic benchmark results, 21 community AI inference reports (top 14 shown), compiled from NVIDIA Developer, Edge AI and Vision Alliance, ProventusNova, Seeed Studio Forum; each table row links to its source. Read this page when shopping the NVIDIA Jetson Orin NX 16GB, comparing it against other APUs in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA Jetson Orin NX 16GB, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from.
Model Quantization Relative Tokens/sec VRAM used Source
smollm2:1.7b — mlc-llm 68.8 tok/s — NVIDIA Developer Blog 2025-01-16
smollm2:1.7b INT4 MLC 59.5 tok/s — NVIDIA Technical Blog 2025-01-16
llama3.2:3b — mlc-llm 45.8 tok/s — NVIDIA Developer Blog 2025-01-16
phi3.5-mini:3.8b — mlc-llm 40.9 tok/s — NVIDIA Developer Blog 2025-01-16
llama3.2:3b INT4 MLC 40.4 tok/s — NVIDIA Technical Blog 2025-01-16
gemma2:2b — mlc-llm 39.0 tok/s — NVIDIA Developer Blog 2025-01-16
phi3.5:mini INT4 MLC 35.9 tok/s — Edge AI and Vision Alliance 2025-01
phi3.5:3.8b INT4 MLC 35.9 tok/s — NVIDIA Technical Blog 2025-01-16
gemma2:2b INT4 MLC 31.6 tok/s — NVIDIA Technical Blog 2025-01-16
qwen2.5:7b — mlc-llm 23.5 tok/s — NVIDIA Developer Blog 2025-01-16
llama3.1:8b — mlc-llm 22.8 tok/s — NVIDIA Developer Blog 2025-01-16
qwen2.5:7b INT4 MLC 20.8 tok/s — NVIDIA Technical Blog 2025-01-16
llama3.1:8b q4_K_M llama.cpp 18.0 tok/s — ProventusNova 2026-06-10
gemma2:9b INT4 MLC 10.6 tok/s — NVIDIA Technical Blog 2025-01-16

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA Jetson Orin NX 16GB — higher is better. Each row links to the public database the number was taken from.
Benchmark Relative Score Source
MLPerf v3.1 ResNet-50 Image Classification 1,681.87 samples/s NVIDIA Developer 2023-11
MLPerf v3.1 RNN-T Speech-to-Text 327.79 samples/s NVIDIA Developer 2023-11
MLPerf v3.1 BERT NLP Inference 136.59 samples/s NVIDIA Developer 2023-11
YOLOv8 TensorRT Inference 125.15 FPS Seeed Studio Forum 2023-06
MLPerf v3.1 RetinaNet Object Detection 47.59 samples/s NVIDIA Developer 2023-11

Products Featuring the NVIDIA Jetson Orin NX 16GB

Systems with the NVIDIA Jetson Orin NX 16GB

Laptops and desktops that ship with the NVIDIA Jetson Orin NX 16GB — whole systems, listed separately from the part itself.

Full Specifications

Memory16 GB
AI TOPS100
CPU cores8
GPU cores1024

NVIDIA Jetson Orin NX 16GB — Frequently Asked Questions

What is the NVIDIA Jetson Orin NX 16GB best used for?
NVIDIA Jetson Orin NX 16GB is a Jetson Orin-family integrated CPU+GPU. Mainstream desktops and gaming builds are the typical workloads.
When was the NVIDIA Jetson Orin NX 16GB released, and what was its launch MSRP?
NVIDIA Jetson Orin NX 16GB launched in 2023 at a $599 MSRP. Street prices drift from launch pricing over a product's life, so check the current listing before buying.
Where do the NVIDIA Jetson Orin NX 16GB benchmark numbers come from?
Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.
How many cores does the NVIDIA Jetson Orin NX 16GB have, and how does it benchmark?
Core and thread counts for NVIDIA Jetson Orin NX 16GB aren't on file. Synthetic benchmark results (PassMark CPU Mark, Cinebench, Geekbench) are in the Synthetic Benchmarks section.
Where can I buy the NVIDIA Jetson Orin NX 16GB?
Amazon listings for the NVIDIA Jetson Orin NX 16GB are linked at the top of this page and in the Products Featuring the NVIDIA Jetson Orin NX 16GB section. SpecPicks earns a small affiliate commission on qualifying purchases, at no extra cost to the buyer.

Buying guides that rank the NVIDIA Jetson Orin NX 16GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related APUs

Editorial guides covering the NVIDIA Jetson Orin NX 16GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this APU.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →
NVIDIA Jetson Orin NX 16GB
NVIDIA Jetson Orin NX 16GB
$1389.99
View on Amazon →