by openai-community
⬇ 29.8M♥ 3.9K
This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.
Plan for roughly 106 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Needs about 106 GB: more than one GPU, for example 2 × 80 GB A100 or H100.
Data from Hugging Face's public API, last checked October 5, 2026. Downloads are Hugging Face's count for the last 30 days.