orpheus-3b-0.1-ft-Q4_K_M-GGUF

by isaiahbjork

Task
Text to speech
Category
Audio
License
Apache 2.0
Commercial use
Yes
Permissive license: commercial use is allowed; keep the copyright and license notice.
Size
About 3 billion parameters
Memory to load
~2 GB (estimate)
Format
GGUF
Runs on
CPU
Access
Open download
Downloads (last 30 days)
10.7K
Likes
73
Last updated
March 20, 2025

How to run it

This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.

Plan for roughly 2 GB of memory to load it (our estimate from its size and format).

The model card on Hugging Face has the exact usage code.

Related text to speech models

Data from Hugging Face's public API, last checked October 8, 2026. Downloads are Hugging Face's count for the last 30 days.