Leaderboard / Alibaba (Qwen)
Qwen3.5 0.8B
Alibaba (Qwen) · Qwen3.5 · released 2026-03-02 · data checked 2026-11-02
Qwen3.5 0.8B is a 900M-parameter dense model from Alibaba (Qwen) (China), released 2026-03-02 under the Apache-2.0 license. It scores 10.7 on the Small LM Index, #20 of 21 tiny models, with 1 independently measured benchmark. It needs about 1.2 GB of memory at 4-bit with an 8K-token context.
Benchmarks
Each bar shows this model's score. The tick marks the best tiny model on that benchmark. Sources: 9 reported by Alibaba (Qwen), 1 independently measured. How we label sources.
Not reported: estimated
What the index model expects from this model's other scores. Not a measurement.
Specifications
- Lab
- Alibaba (Qwen) (CN · China)
- Architecture
- Dense transformer
- Total parameters
- 900M
- Active parameters
- All (dense)
- Size class
- Tiny
- Context window
- 262K tokens
- Input modalities
- text, image, video
- Reasoning
- Hybrid (thinking on/off)
- License
- Apache-2.0
- Openness
- Open weights
- Memory to run
- ~1.2 GB at 4-bit, 8K context (more sizes)
- Hugging Face
- 3.7M downloads (30 days) · 801 likes
Compare with
- Qwen3.5 0.8B vs LFM2.5 1.2B Thinking (1.2B, index 30.1)
- Qwen3.5 0.8B vs LFM2.5 1.2B Instruct (1.2B, index 20.6)
- Qwen3.5 0.8B vs LFM2.5 350M (350M, index 12.6)
- Qwen3.5 0.8B vs Gemma 3 1B (1B, index 6.1)
- Qwen3.5 0.8B vs EXAONE 4.0 1.2B (1.3B, index 36.1)
Sources
Something wrong here? Report it.
Run it locally
Uses ggml-org/Qwen3.5-0.8B-GGUF (Q4_0). Swap the tag for another size: BF16, Q4_0, Q8_0.
ollama run hf.co/ggml-org/Qwen3.5-0.8B-GGUF:Q4_0llama-server -hf ggml-org/Qwen3.5-0.8B-GGUF:Q4_0pip install -U mlx-lm
mlx_lm.chat --model mlx-community/Qwen3.5-0.8B-MLX-4bitvllm serve Qwen/Qwen3.5-0.8BMemory needed: weights, context cache and runtime buffers.
| Quantization | 4K context | 32K context | 256K context |
|---|---|---|---|
| 16-bit F16 | 2.4 GB | 2.7 GB | 5.5 GB |
| 8-bit Q8_0 | 1.5 GB | 1.9 GB | 4.7 GB |
| 4-bit Q4_K_M | 1.1 GB | 1.5 GB | 4.3 GB |