by openai-community
⬇ 29.8M♥ 3.9K
Mistral-7B-Instruct-v0.2_rai_1.9.0_npu
- Task
- Text generation
- Category
- Language
- License
- Apache 2.0
- Commercial use
- Yes
Permissive license: commercial use is allowed; keep the copyright and license notice. - Size
- About 7 billion parameters
- Memory to load
- ~34 GB (estimate)
- Format
- ONNX
- Runs on
- CPU
- Access
- Gated: accept the publisher's terms on Hugging Face
- Downloads (last 30 days)
- 0
- Likes
- 0
- Last updated
- November 2, 2026
How to run it
This is an ONNX export; run it with ONNX Runtime on a CPU or GPU, including in the browser or on mobile.
Plan for roughly 34 GB of memory to load it (our estimate from its size and format).
Downloads are gated: accept the publisher's terms on Hugging Face first.
The model card on Hugging Face has the exact usage code.
Where to run it
In the cloud
Needs about 34 GB: use a 48 GB GPU such as an RTX A6000 or L40S.
- RunPod · rent a GPU by the hour (affiliate link)
Related text generation models
Data from Hugging Face's public API, last checked November 3, 2026. Downloads are Hugging Face's count for the last 30 days.