Skip to main content
NVIDIA Jetson AGX Orin 64GB
NVIDIA · APU · Jetson Orin

NVIDIA Jetson AGX Orin 64GB — Benchmarks & Specs

$1,999 MSRP2022

Bottom line: how fast is the NVIDIA Jetson AGX Orin 64GB?

For local LLM inference it generates 300.0 tokens/sec running Mistral-7B at unspecified under llama.cpp (CUDA 12.9), per NVIDIA Developer Forums. In MLPerf v3.1 ResNet-50 Image Classification Offline it scores 6,423.63 samples/s, per NVIDIA Developer.

Every figure above is a row in the tables below, and each row links out to the review or public benchmark database the number was taken from. SpecPicks aggregates published measurements; it does not report first-party benchmark runs.

The NVIDIA Jetson AGX Orin 64GB is an APU from the Jetson Orin family released in 2022 from NVIDIA. It launched with a $1,999 MSRP, though street prices typically diverge meaningfully from launch pricing — see the linked product cards below for current Amazon listings. Data on this page draws on 7 synthetic benchmark results, 12 community AI inference reports, aggregated from public benchmark databases (TechPowerUp, PassMark, Geekbench, Cinebench) and the LocalLLaMA community. Read this page when shopping the NVIDIA Jetson AGX Orin 64GB, comparing it against other APUs in your build, or sizing it for a specific workload (gaming at 1080p/1440p/4K, productivity benchmarks, or local LLM inference).

AI Inference Performance

Tokens per second under each model + quantization. Higher = faster generation. Bars compare runs across the same model.

Local LLM inference throughput on the NVIDIA Jetson AGX Orin 64GB, in generated tokens per second. Higher is better; each row links to the community report or benchmark database it came from.
Model Quantization Relative Tokens/sec VRAM used Source
Mistral-7B unspecified llama.cpp (CUDA 12.9) 300.0 tok/s — NVIDIA Developer Forums 2026-01-24
qwen2.5-vl:3b — tensorrt-llm 225.7 tok/s — NVIDIA Developer Forums 2025-03-01
deepseek-r1-distill-qwen:7b — vllm 180.4 tok/s — NVIDIA Developer Forums 2025-02-01
gemma2:2b FP16 tensorrt-llm 120.0 tok/s — IoT Digital Twin PLM 2026-06-01
gemma2:2b FP16 TensorRT-LLM 120.0 tok/s — IoT Digital Twin PLM 2026-04-24
llama3.2:3b INT4 TensorRT-LLM 85.0 tok/s — IoT Digital Twin PLM 2026-04-24
llama3.2:3b INT4 tensorrt-llm 85.0 tok/s 3.2 GB IoT Digital Twin PLM 2026-06-01
phi3.5:mini INT4 tensorrt-llm 62.0 tok/s — IoT Digital Twin PLM 2026-06-01
phi3.5:mini INT4 TensorRT-LLM 62.0 tok/s — IoT Digital Twin PLM 2026-04-24
llama3.1:8b q4_K_M llama.cpp 52.0 tok/s — ProventusNova Blog 2026-06-10
phi3:mini q4_K_M llama.cpp 47.0 tok/s 2.8 GB MultimodalFlow Blog 2026-05-01
llama2:7b q4f16_ft mlc 46.9 tok/s — jetson-containers (NVIDIA/dusty-nv) 2024-04-01

Synthetic Benchmarks

Higher is better. Bars are scaled within each benchmark family (multi-thread, single-thread, etc.) so you can compare like-with-like at a glance.

Synthetic benchmark scores for the NVIDIA Jetson AGX Orin 64GB — higher is better. Each row links to the public database the number was taken from.
Benchmark Relative Score Source
MLPerf v3.1 ResNet-50 Image Classification Offline 6,423.63 samples/s NVIDIA Developer 2023-11-01
MLPerf v3.1 RNN-T Speech-to-Text Offline 1,169.98 samples/s NVIDIA Developer 2023-11-01
MLPerf v3.1 BERT-Large NLP Offline 553.69 samples/s NVIDIA Developer 2023-11-01
MLPerf Inference v4.0 Edge - YOLOv8n 383 FPS lowtouch.ai 2025-02-27
YOLOv8l (TensorRT, 60W) 95 FPS lowtouch.ai 2025-02-27
MLPerf v4.0 GPT-J 6B Summarization Offline 0.15 samples/s NVIDIA Developer 2024-10-01
GPT-J 6B (MLPerf) 0.15 samples/sec lowtouch.ai 2025-02-27

Full Specifications

ram gb64
ai tops275
cpu cores12
gpu cores2048

NVIDIA Jetson AGX Orin 64GB — Frequently Asked Questions

What is the NVIDIA Jetson AGX Orin 64GB best used for?
NVIDIA Jetson AGX Orin 64GB is a Jetson Orin-family integrated CPU+GPU SoC. Use it for mainstream desktops and gaming-focused builds. Check the synthetic benchmark scores below for at-a-glance comparison.
When was the NVIDIA Jetson AGX Orin 64GB released, and what was its launch MSRP?
NVIDIA Jetson AGX Orin 64GB launched in 2022 at a $1,999 MSRP. Street prices diverge from launch pricing over a product's lifetime — check the linked Amazon listings on this page for current availability.
Where do the benchmark numbers on this page come from?
Synthetic benchmarks are scraped from public databases (TechPowerUp, PassMark, Geekbench Browser, Cinebench leaderboards). AI inference numbers come from the LocalLLaMA community (Reddit threads, llama.cpp / Ollama discussion logs, and Phoronix when available). Every benchmark row carries an inline source citation — click through to verify the original number.
How does the NVIDIA Jetson AGX Orin 64GB compare to its predecessor?
Compare NVIDIA Jetson AGX Orin 64GB side-by-side against other APUs on the Compare tool below. Synthetic benchmark scores let you place this SKU within its generation; the spec table shows the architectural and process-node differences from one generation to the next.
Where can I buy the NVIDIA Jetson AGX Orin 64GB?
Active Amazon listings aren't on file for this exact SKU yet. See the linked benchmark sources and the Compare tool for adjacent parts that may be in stock — and check the /benchmarks index for the latest curated picks in this category.

Buying guides that rank the NVIDIA Jetson AGX Orin 64GB's class

This page is the raw performance data. The guides below turn it into a ranked pick for a specific build.

Related APUs

Editorial guides covering the NVIDIA Jetson AGX Orin 64GB

In-depth SpecPicks reviews, build guides, and head-to-heads referencing this APU.

More guides & deep dives from the SpecPicks archive

Browse all articles & guides →

More reviews from the SpecPicks archive

Browse all reviews →

More buying guides from SpecPicks

Browse all buying guides →