Qwen3.5-88B-YMQ-GGUF

by zerodigest

Task
Not stated
Category
Other
License
Not stated
Commercial use
Check the license
The license isn't a standard one; read the model card on Hugging Face before using it commercially.
Size
About 88 billion parameters
Memory to load
~53 GB (estimate)
Format
GGUF
Runs on
CPU
Access
Open download
Downloads (last 30 days)
0
Likes
0
Last updated
September 29, 2026

How to run it

This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.

Plan for roughly 53 GB of memory to load it (our estimate from its size and format).

The model card on Hugging Face has the exact usage code.

Where to run it

In the cloud

Needs about 53 GB: use an 80 GB GPU such as an A100 or H100.

  • RunPod · rent a GPU by the hour (affiliate link)

Data from Hugging Face's public API, last checked September 29, 2026. Downloads are Hugging Face's count for the last 30 days.