Leaderboard / Alibaba (Qwen)
Qwen3.6 35B-A3B
Alibaba (Qwen) · Qwen3.6 · released 2026-04-16 · data checked 2026-11-01
Qwen3.6 35B-A3B is a 35B-parameter Mixture-of-Experts model (3B active per token) from Alibaba (Qwen) (China), released 2026-04-16 under the Apache-2.0 license. It scores 72.2 on the Small LM Index, #6 of 34 medium models. It needs about 22.6 GB of memory at 4-bit with an 8K-token context and costs $0.031 per million tokens through the cheapest API provider.
Benchmarks
Each bar shows this model's score. The tick marks the best medium model on that benchmark. Sources: 8 reported by Alibaba (Qwen). How we label sources.
Specifications
- Lab
- Alibaba (Qwen) (CN · China)
- Architecture
- Mixture-of-Experts
- Total parameters
- 35B
- Active parameters
- 3B
- Size class
- Medium
- Context window
- 262K tokens
- Input modalities
- text, image, video
- Reasoning
- Hybrid (thinking on/off)
- License
- Apache-2.0
- Openness
- Open weights
- Memory to run
- ~22.6 GB at 4-bit, 8K context (more sizes)
- Hugging Face
- 4.5M downloads (30 days) · 3.1K likes
- API providers
- 10 on OpenRouter
- API price
- $0.010 in / $0.092 out per 1M (OpenRouter, 2026-11-03)
Compare with
- Qwen3.6 35B-A3B vs Qwen3.5 35B-A3B (35B, index 69.9)
- Qwen3.6 35B-A3B vs MiniCPM-V 4.7 35B-A3B (35.2B, index 54.5)
- Qwen3.6 35B-A3B vs Edge0 35B-A3B (preview) (34.7B, index 62.8)
- Qwen3.6 35B-A3B vs Seed-OSS 36B Instruct (36.2B, index 60.3)
- Qwen3.6 35B-A3B vs Hermes 4.3 36B (36.2B, index 51.4)
Ranked in
- #6 in Best small open models for coding
- #6 in Best small open models for math
- #6 in Best LLMs for a 24 GB GPU (RTX 4090, RTX 3090)
- #2 in Best cheap LLM APIs (open models)
- #6 in Best small open vision-language models
- #6 in Best open models with an Apache 2.0 or MIT license
Sources
Something wrong here? Report it.
Run it locally
Uses ggml-org/Qwen3.6-35B-A3B-GGUF (Q4_K_M). Swap the tag for another size: BF16, Q4_0, Q4_K_M, Q8_0.
ollama run hf.co/ggml-org/Qwen3.6-35B-A3B-GGUF:Q4_K_Mllama-server -hf ggml-org/Qwen3.6-35B-A3B-GGUF:Q4_K_Mpip install -U mlx-lm
mlx_lm.chat --model mlx-community/Qwen3.6-35B-A3B-4bitvllm serve Qwen/Qwen3.6-35B-A3BMemory needed: weights, context cache and runtime buffers.
| Quantization | 4K context | 32K context | 256K context |
|---|---|---|---|
| 16-bit F16 | 71 GB | 72 GB | 77 GB |
| 8-bit Q8_0 | 38 GB | 39 GB | 44 GB |
| 4-bit Q4_K_M | 23 GB | 23 GB | 28 GB |