Leaderboard / OpenAI
gpt-oss-20b
OpenAI · gpt-oss · released 2025-08-05 · data checked 2026-11-01
gpt-oss-20b is a 20.9B-parameter Mixture-of-Experts model (3.6B active per token) from OpenAI (United States), released 2025-08-05 under the Apache-2.0 license. It scores 64.0 on the Small LM Index, #13 of 34 medium models. It needs about 13.8 GB of memory at 4-bit with an 8K-token context and costs $0.020 per million tokens through the cheapest API provider.
Runs in ~16 GB of memory thanks to native MXFP4 weights.
Benchmarks
Each bar shows this model's score. The tick marks the best medium model on that benchmark. Sources: 4 reported by OpenAI, 3 measured by another lab. How we label sources.
Specifications
- Lab
- OpenAI (US · United States)
- Architecture
- Mixture-of-Experts
- Total parameters
- 20.9B
- Active parameters
- 3.6B
- Size class
- Medium
- Context window
- 131K tokens
- Input modalities
- text
- Reasoning
- Reasoning (thinking)
- License
- Apache-2.0
- Openness
- Open weights
- Memory to run
- ~13.8 GB at 4-bit, 8K context (more sizes)
- Hugging Face
- 6M downloads (30 days) · 5.3K likes
- API providers
- 9 on OpenRouter
- API price
- $0.011 in / $0.045 out per 1M (OpenRouter, 2026-11-03)
Compare with
- gpt-oss-20b vs Tri-21B Think (20.7B, index 43.6)
- gpt-oss-20b vs EuroLLM 22B Instruct (22.6B, index 19.2)
- gpt-oss-20b vs LFM2.5 24B-A2B (24B, index 61.4)
- gpt-oss-20b vs Magistral Small 1.2 (24B, index 55.9)
Ranked in
- #8 in Best small open models for math
- #4 in Best LLMs that run on a 16 GB GPU
- #6 in Best cheap LLM APIs (open models)
- #7 in Best American open models under 100B
Sources
- https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
- https://openai.com/index/introducing-gpt-oss/
Something wrong here? Report it.
Run it locally
Uses ggml-org/gpt-oss-20b-GGUF (MXFP4). Swap the tag for another size: BF16, MXFP4, Q8_0.
ollama run hf.co/ggml-org/gpt-oss-20b-GGUF:MXFP4llama-server -hf ggml-org/gpt-oss-20b-GGUF:MXFP4pip install -U mlx-lm
mlx_lm.chat --model mlx-community/gpt-oss-20b-OptiQ-4bitvllm serve openai/gpt-oss-20bMemory needed: weights, context cache and runtime buffers.
| Quantization | 4K context | 32K context | 131K context |
|---|---|---|---|
| 16-bit F16 | 43 GB | 44 GB | 46 GB |
| 8-bit Q8_0 | 23 GB | 24 GB | 26 GB |
| 4-bit Q4_K_M | 14 GB | 14 GB | 17 GB |