by openai-community
⬇ 29.8M♥ 3.9K
Llama-3.1-70B-Instruct-DASHQ-Q2-GGUF
- Task
- Text generation
- Category
- Language
- License
- Llama 3.1 license
- Commercial use
- Yes, with conditions
The publisher's own model license: commercial use is allowed under its terms, which include limits; read them before shipping. - Size
- About 70 billion parameters
- Memory to load
- ~42 GB (estimate)
- Format
- GGUF
- Runs on
- CPU
- Access
- Open download
- Downloads (last 30 days)
- 0
- Likes
- 0
- Last updated
- October 3, 2026
How to run it
This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.
Plan for roughly 42 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Where to run it
In the cloud
Needs about 42 GB: use a 48 GB GPU such as an RTX A6000 or L40S.
- RunPod · rent a GPU by the hour (affiliate link)
Related text generation models
Data from Hugging Face's public API, last checked October 3, 2026. Downloads are Hugging Face's count for the last 30 days.