by openai-community
⬇ 29.8M♥ 3.9K
meta-llama_Llama-3.1-8B-auto_awq-int4-gs64-sym
- Task
- Text generation
- Category
- Language
- License
- Llama 3.1 license
- Commercial use
- Yes, with conditions
The publisher's own model license: commercial use is allowed under its terms, which include limits; read them before shipping. - Size
- About 8 billion parameters
- Memory to load
- ~5 GB (estimate)
- Format
- AWQ
- Runs on
- GPU
- Access
- Open download
- Downloads (last 30 days)
- 0
- Likes
- 0
- Last updated
- October 30, 2026
How to run it
These are 4-bit quantized weights for NVIDIA GPUs; load them with a library that supports AWQ, such as vLLM or Hugging Face Transformers.
Plan for roughly 5 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Where to run it
On your own computer, free
Both load GGUF builds; for other formats, look for a GGUF version of this model.
In the cloud
Needs about 5 GB: a 24 GB GPU such as an RTX 4090 or RTX A5000 is enough.
- RunPod · rent a GPU by the hour (affiliate link)
Related text generation models
Data from Hugging Face's public API, last checked October 30, 2026. Downloads are Hugging Face's count for the last 30 days.