Qwen3-VL-30B-A3B-Instruct-AWQ

by QuantTrio

Task
Text generation
Category
Language
License
Apache 2.0
Commercial use
Yes
Permissive license: commercial use is allowed; keep the copyright and license notice.
Size
About 30 billion parameters
Memory to load
~18 GB (estimate)
Format
AWQ
Runs on
GPU
Access
Open download
Downloads (last 30 days)
845.2K
Likes
45
Last updated
October 8, 2025

How to run it

These are 4-bit quantized weights for NVIDIA GPUs; load them with a library that supports AWQ, such as vLLM or Hugging Face Transformers.

Plan for roughly 18 GB of memory to load it (our estimate from its size and format).

The model card on Hugging Face has the exact usage code.

Related text generation models

Data from Hugging Face's public API, last checked September 30, 2026. Downloads are Hugging Face's count for the last 30 days.