Skip to main content
NVIDIA Jetson Orin Nano 8GB
NVIDIA · APU · Jetson Orin

NVIDIA Jetson Orin Nano 8GB — Benchmarks & Specs

$149 MSRP2023

Short answer: the NVIDIA Jetson Orin Nano 8GB generates 14.0 tokens/sec on llama3.1:8b (q4_0) under mlc in a single cited run, per Edge AI and Vision Alliance; there are too few comparable runs on file for a median.

Search Amazon for the NVIDIA Jetson Orin Nano 8GB → Find the NVIDIA Jetson Orin Nano 8GB on eBay →

Bottom line: how fast is the NVIDIA Jetson Orin Nano 8GB?

For local LLM inference it generates 14.0 tokens/sec running llama3.1:8b at q4_0 under mlc, per Edge AI and Vision Alliance. In Geekbench 5 multi-core it scores 2,866 points, per Magazin Mehatronika. Its 8 GB of memory, shared by the CPU and GPU, is the binding constraint for local inference: the llama3.1:8b run above (8B parameters) is the largest model on file at 4-bit quantization on it.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from; the memory size is the on-paper spec. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

The NVIDIA Jetson Orin Nano 8GB is an APU from the Jetson Orin family released in 2023 from NVIDIA. Key on-paper specs include 6 CPU cores, 512 GPU cores, 8 GB of memory shared by the CPU and GPU. It launched with a $149 MSRP, though street prices typically diverge meaningfully from launch pricing. Data on this page draws on 2 synthetic benchmark results, 34 community AI inference reports (top 13 shown), compiled from Edge AI and Vision Alliance, Yuvraj Singh, Magazin Mehatronika, NavyaAI, Eric X. Liu Personal Page, HeyyTechy, Jeremy Morgan Blog, NVIDIA Jetson AI Lab, Turing Pi; each table row links to its source. Read this page when shopping the NVIDIA Jetson Orin Nano 8GB, comparing it against other APUs in your build, or sizing it for a specific workload (synthetic benchmark scores or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA Jetson Orin Nano 8GB, in generated tokens per second for a single request (one user's generation speed). Higher is better; each row links to the community report or benchmark database it came from. Batched serving runs are listed separately below.
Model Quantization Relative Tokens/sec VRAM used Source
qwen2.5:0.5b q4_K_M llama.cpp 92.9 tok/s 0.5 GB Yuvraj Singh (independent blog benchmark) 2026-05-29
llama3.2:1b q4_K_M ollama 58.0 tok/s 1.4 GB HeyyTechy 2026-06-17
qwen3:0.6b q8_0 llama.cpp 49.4 tok/s — SmolHub / Yuvraj Singh 2026-05-29
llama3.2:1b q4_K_M llama.cpp 47.1 tok/s — SmolHub / Yuvraj Singh 2026-05-29
qwen2:0.5b — ollama 44.9 tok/s — Jeremy Morgan Blog 2024-12-29
llama3.2:1b q4_K_M ollama 44.8 tok/s 0.8 GB Yuvraj Singh (independent blog benchmark) 2026-05-29
smollm2:1.7b q4_0 mlc 41.0 tok/s — Edge AI and Vision Alliance 2025-01
gemma3:1b q4_K_M llama.cpp 40.8 tok/s 0.8 GB Yuvraj Singh (independent blog benchmark) 2026-05-29
qwen3:1.7b q4_K_M llama.cpp 39.4 tok/s — Turing Pi 2026-09-26
qwen3:0.6b FP8 ollama 38.8 tok/s 0.6 GB Eric X. Liu Personal Page 2025-10-04
llama3.1:8b — MLC 14.0 tok/s — NVIDIA Jetson AI Lab 2024-12

Batched serving throughput

Aggregate output tokens per second on the NVIDIA Jetson Orin Nano 8GB summed across 16 concurrent requests (serving runtimes such as vLLM). This is total server throughput, not one user's generation speed — each request generates far slower — so these rows are not comparable with the single-stream table above.
Model Quantization Relative Tokens/sec (aggregate) VRAM used Source
gemma3:270m q4_K_M ollama 16 concurrent requests 12.8 tok/s aggregate — NavyaAI 2026-06-10
gemma3:1b q4_K_M ollama 16 concurrent requests 11.8 tok/s aggregate — NavyaAI 2026-06-10

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA Jetson Orin Nano 8GB — higher is better. Each row links to the public database the number was taken from.
Benchmark Relative Score Source
Geekbench 5 multi-core 2,866 points Magazin Mehatronika 2023-04-25
Geekbench 5 single-core 538 points Magazin Mehatronika 2023-04-25

Full Specifications

Memory8 GB
AI TOPS40
CPU cores6
GPU cores512

NVIDIA Jetson Orin Nano 8GB — Frequently Asked Questions

What is the NVIDIA Jetson Orin Nano 8GB best used for?
NVIDIA Jetson Orin Nano 8GB is a Jetson Orin-family integrated CPU+GPU. Mainstream desktops and gaming builds are the typical workloads.
When was the NVIDIA Jetson Orin Nano 8GB released, and what was its launch MSRP?
NVIDIA Jetson Orin Nano 8GB launched in 2023 at a $149 MSRP. Street prices drift from launch pricing over a product's life, so check the current listing before buying.
Where do the NVIDIA Jetson Orin Nano 8GB benchmark numbers come from?
Each benchmark row on this page names its source (public benchmark databases such as TechPowerUp, PassMark, Geekbench and Cinebench, and community reports such as r/LocalLLaMA threads) and links to it, so every number can be checked against the original.
How many cores does the NVIDIA Jetson Orin Nano 8GB have, and how does it benchmark?
Core and thread counts for NVIDIA Jetson Orin Nano 8GB aren't on file. Synthetic benchmark results (PassMark CPU Mark, Cinebench, Geekbench) are in the Synthetic Benchmarks section.
Where can I buy the NVIDIA Jetson Orin Nano 8GB?
SpecPicks has no verified listing of the NVIDIA Jetson Orin Nano 8GB on file yet; the Amazon search link at the top of this page shows its current offers. SpecPicks earns a small affiliate commission on qualifying purchases.

Buying guides that rank the NVIDIA Jetson Orin Nano 8GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related APUs

Editorial guides covering the NVIDIA Jetson Orin Nano 8GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this APU.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →

Hardware benchmark data on SpecPicks

All benchmarks →