NVIDIA · APU · Jetson Orin
NVIDIA Jetson AGX Orin 64GB — Benchmarks & Specs
$1,999 MSRP2022
Synthetic Benchmarks
| Benchmark | Score | Unit | Source |
|---|---|---|---|
| MLPerf Inference v4.0 Edge - YOLOv8n | 383 | FPS | lowtouch.ai |
| YOLOv8l (TensorRT, 60W) | 95 | FPS | lowtouch.ai |
| GPT-J 6B (MLPerf) | 0.15 | samples/sec | lowtouch.ai |
AI Inference Performance
| Model | Quantization | Tokens/sec | Source |
|---|---|---|---|
| Mistral-7B | unspecified | 300.0 | NVIDIA Developer Forums |
| gpt-oss-20b | unspecified | 40.0 | NVIDIA Developer Blog |
| Llama 7B (MAXN mode) | unspecified | 21.5 | DEV Community |
| Llama-3.2-7B (default power mode) | unspecified | 8.0 | DEV Community |
| Llama-2-7B | 2-bit | 1.8 | DFRobot |
| Llama-2-7B | 4-bit | 1.6 | DFRobot |
Full Specifications
| ram gb | 64 |
|---|---|
| ai tops | 275 |
| cpu cores | 12 |
| gpu cores | 2048 |