Leaderboard / NVIDIA
Nemotron 3 Nano 30B-A3B
NVIDIA · Nemotron 3 · released 2025-12-15 · data checked 2026-11-01
Nemotron 3 Nano 30B-A3B is a 31.6B-parameter Mixture-of-Experts model (3.5B active per token) from NVIDIA (United States), released 2025-12-15 under the NVIDIA Open Model license. It scores 62.6 on the Small LM Index, #16 of 34 medium models. It needs about 20.3 GB of memory at 4-bit with an 8K-token context and costs $0.10 per million tokens through the cheapest API provider.
Benchmarks
Each bar shows this model's score. The tick marks the best medium model on that benchmark. Sources: 8 reported by NVIDIA. How we label sources.
Specifications
- Lab
- NVIDIA (US · United States)
- Architecture
- Mixture-of-Experts
- Total parameters
- 31.6B
- Active parameters
- 3.5B
- Size class
- Medium
- Context window
- 1M tokens
- Input modalities
- text
- Reasoning
- Hybrid (thinking on/off)
- License
- NVIDIA Open Model
- Openness
- Open weights
- Memory to run
- ~20.3 GB at 4-bit, 8K context (more sizes)
- Hugging Face
- 1.7M downloads (30 days) · 840 likes
- API providers
- 1 on OpenRouter
- API price
- $0.060 in / $0.24 out per 1M (OpenRouter, 2026-11-03)
Compare with
- Nemotron 3 Nano 30B-A3B vs Nemotron 3.5 Lightning (31.6B, index 63.6)
- Nemotron 3 Nano 30B-A3B vs EXAONE 4.0 32B (32B, index 62.0)
- Nemotron 3 Nano 30B-A3B vs Sarvam 30B (32.2B, index 61.6)
- Nemotron 3 Nano 30B-A3B vs OLMo 3.1 32B Think (32.2B, index 57.0)
Ranked in
Sources
Something wrong here? Report it.
Run it locally
Uses ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF (Q4_K_M). Swap the tag for another size: BF16, Q4_K_M, Q8_0.
ollama run hf.co/ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF:Q4_K_Mllama-server -hf ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF:Q4_K_Mpip install -U mlx-lm
mlx_lm.chat --model mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bitvllm serve nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16Memory needed: weights, context cache and runtime buffers.
| Quantization | 4K context | 32K context | 256K context |
|---|---|---|---|
| 16-bit F16 | 64 GB | 65 GB | 66 GB |
| 8-bit Q8_0 | 35 GB | 35 GB | 36 GB |
| 4-bit Q4_K_M | 20 GB | 20 GB | 22 GB |