Best small open language models

Small language models with 4 billion parameters or fewer can run on modest hardware, including laptops and phones. They answer quickly, and they are a common base for fine-tuning on a narrow task.

Last updated 3 November 2026 · refreshed after every Hugging Face sync · 15 models

#ModelSizeMemoryLicenseDownloads (30 days)Likes
1Qwen3-0.6B
Qwen
600M · FP16~2 GBApache 2.023.2M1.9K
2Qwen3-4B
Qwen
4B · FP16~10 GBApache 2.08.4M780
3Qwen2.5-1.5B-Instruct
Qwen
1.5B · FP16~4 GBApache 2.04.6M926
4Qwen2.5-0.5B-Instruct
Qwen
500M · FP16~2 GBApache 2.04.9M726
5Qwen3-1.7B
Qwen
1.7B · FP16~5 GBApache 2.04.2M611
6Qwen3-4B-Instruct-2507
Qwen
4B · FP16~10 GBApache 2.02.6M1K
7opt-125m
facebook
125M · FP16~1 GBCustom (other)4.5M333
8Llama-3.2-1B-Instruct
meta-llama
1B · FP16~3 GBLlama 3.2 license1.8M1.9K
9Qwen2.5-3B-Instruct
Qwen
3B · FP16~8 GBCustom (other)3.1M631
10Llama-3.2-3B-Instruct
meta-llama
3B · FP16~8 GBLlama 3.2 license995.2K2.9K
11MiniCPM5-2B
openbmb
2B · FP16~5 GBApache 2.01.1M1.8K
12TinyLlama-1.1B-Chat-v1.0
TinyLlama
1.1B · FP16~3 GBApache 2.0929.6K1.9K
13SmolLM2-135M
HuggingFaceTB
135M · FP16~1 GBApache 2.02.4M266
14DeepSeek-R1-Distill-Qwen-1.5B
deepseek-ai
1.5B · FP16~4 GBMIT784.6K1.7K
15gemma-3-1b-it
google
1B · FP16~3 GBGemma license826.6K1.3K

How we rank

Text-generation models with 4 billion parameters or fewer. We include models seen on Hugging Face in the last 14 days with at least 10,000 downloads in the last 30 days. Score = log10(30-day downloads) + ½ × log10(likes + 1), so popularity leads and likes break near-ties. We keep one entry per model name and leave out adult and uncensored builds. Memory is estimated from parameter count and the published file format (16-bit ≈ 2 bytes per parameter, 4-bit ≈ 0.5) plus 20% headroom; long contexts need more. A quantised copy of a bigger model may also fit — check the model page.

More lists

Find a model for your exact hardware →