Llama-3.1-8B-Instruct-4bit
- Task
- Text generation
- Category
- Language
- License
- Llama 3.1 license
- Commercial use
- Yes, with conditions
The publisher's own model license: commercial use is allowed under its terms, which include limits; read them before shipping. - Size
- About 8 billion parameters
- Memory to load
- ~5 GB (estimate)
- Format
- MLX
- Runs on
- CPU
- Access
- Open download
- Downloads (last 30 days)
- 930.1K
- Likes
- 11
- Last updated
- February 15, 2025
How to run it
This is an MLX build for Apple silicon Macs; run it with Apple's MLX framework (mlx-lm for language models).
Plan for roughly 5 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Related text generation models
Data from Hugging Face's public API, last checked September 28, 2026. Downloads are Hugging Face's count for the last 30 days.