Leaderboard / Google
Gemma 4 31B
Google · Gemma 4 · released 2026-04-02 · data checked 2026-11-01
Gemma 4 31B is a 30.7B-parameter dense model from Google (United States), released 2026-04-02 under the Apache-2.0 license. It scores 70.1 on the Small LM Index, #8 of 34 medium models. It needs about 21.9 GB of memory at 4-bit with an 8K-token context and costs $0.16 per million tokens through the cheapest API provider.
Benchmarks
Each bar shows this model's score. The tick marks the best medium model on that benchmark. Sources: 7 reported by Google, 2 measured by another lab. How we label sources.
Specifications
- Lab
- Google (US · United States)
- Architecture
- Dense transformer
- Total parameters
- 30.7B
- Active parameters
- All (dense)
- Size class
- Medium
- Context window
- 256K tokens
- Input modalities
- text, image
- Reasoning
- Hybrid (thinking on/off)
- License
- Apache-2.0
- Openness
- Open weights
- Memory to run
- ~21.9 GB at 4-bit, 8K context (more sizes)
- Hugging Face
- 8M downloads (30 days) · 4.3K likes
- API providers
- 14 on OpenRouter
- API price
- $0.10 in / $0.34 out per 1M (OpenRouter, 2026-11-03)
Compare with
- Gemma 4 31B vs Muse Glimmer 30B (29.6B, index 72.6)
- Gemma 4 31B vs Kanana-2 30B-A3B Thinking (30.7B, index 50.7)
- Gemma 4 31B vs Qwen3 30B-A3B Thinking 2507 (30.5B, index 59.3)
- Gemma 4 31B vs GLM-4.7-Flash (31B, index 66.1)
- Gemma 4 31B vs Granite 4.2 30B (30B, index 67.0)
Ranked in
- #9 in Best LLMs for a 24 GB GPU (RTX 4090, RTX 3090)
- #3 in Best cheap LLM APIs (open models)
- #8 in Best small open vision-language models
- #9 in Best open models with an Apache 2.0 or MIT license
- #4 in Best American open models under 100B
Sources
Something wrong here? Report it.
Run it locally
Uses ggml-org/gemma-4-31B-it-GGUF (Q4_0). Swap the tag for another size: BF16, Q4_0, Q8_0.
ollama run hf.co/ggml-org/gemma-4-31B-it-GGUF:Q4_0llama-server -hf ggml-org/gemma-4-31B-it-GGUF:Q4_0pip install -U mlx-lm
mlx_lm.chat --model mlx-community/gemma-4-31b-it-4bitvllm serve google/gemma-4-31B-itMemory needed: weights, context cache and runtime buffers.
| Quantization | 4K context | 32K context | 256K context |
|---|---|---|---|
| 16-bit F16 | 64 GB | 69 GB | 105 GB |
| 8-bit Q8_0 | 35 GB | 40 GB | 77 GB |
| 4-bit Q4_K_M | 21 GB | 26 GB | 63 GB |