by openai-community
⬇ 29.3M♥ 3.9K
This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.
The model card on Hugging Face has the exact usage code.
Check the model card for its memory needs; cloud GPUs range from 16 GB to 80 GB and beyond.
Data from Hugging Face's public API, last checked November 2, 2026. Downloads are Hugging Face's count for the last 30 days.