Qwen2.5-Coder-14B-Instruct-AWQ
- Task
- Text generation
- Category
- Language
- License
- Apache 2.0
- Commercial use
- Yes
Permissive license: commercial use is allowed; keep the copyright and license notice. - Size
- About 14 billion parameters
- Memory to load
- ~9 GB (estimate)
- Format
- AWQ
- Runs on
- GPU
- Access
- Open download
- Downloads (last 30 days)
- 977.9K
- Likes
- 25
- Last updated
- January 12, 2025
How to run it
These are 4-bit quantized weights for NVIDIA GPUs; load them with a library that supports AWQ, such as vLLM or Hugging Face Transformers.
Plan for roughly 9 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Related text generation models
Data from Hugging Face's public API, last checked September 23, 2026. Downloads are Hugging Face's count for the last 30 days.