Qwen3.8-27B-SLQ-GGUF
by kaitchup
- Task
- Text generation
- Category
- Language
- License
- Apache 2.0
- Commercial use
- Yes
Permissive license: commercial use is allowed; keep the copyright and license notice. - Size
- About 27 billion parameters
- Memory to load
- ~17 GB (estimate)
- Format
- GGUF
- Runs on
- CPU
- Access
- Open download
- Downloads (last 30 days)
- 8.4K
- Likes
- 56
- Last updated
- October 27, 2026
How to run it
This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.
Plan for roughly 17 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Where to run it
On your own computer, free
- Ollama · free app for Mac, Windows and Linux
- LM Studio · free desktop app with a chat window
This GGUF build loads directly in both.
In the cloud
Needs about 17 GB: a 24 GB GPU such as an RTX 4090 or RTX A5000 is enough.
- RunPod · rent a GPU by the hour (affiliate link)
Related text generation models
Data from Hugging Face's public API, last checked October 31, 2026. Downloads are Hugging Face's count for the last 30 days.