Ternary-Bonsai-2-9B-gguf

by prism-ml

Task
Vision-language (image + text to text)
Category
Image
License
Apache 2.0
Commercial use
Yes
Permissive license: commercial use is allowed; keep the copyright and license notice.
Size
About 9 billion parameters
Memory to load
~6 GB (estimate)
Format
GGUF
Runs on
CPU
Access
Open download
Downloads (last 30 days)
77.8K
Likes
101
Last updated
October 15, 2026

How to run it

This is a GGUF build, the format llama.cpp uses. It runs locally on a CPU or GPU with llama.cpp, Ollama or LM Studio, which load GGUF files directly.

Plan for roughly 6 GB of memory to load it (our estimate from its size and format).

The model card on Hugging Face has the exact usage code.

Related vision-language (image + text to text) models

Data from Hugging Face's public API, last checked October 19, 2026. Downloads are Hugging Face's count for the last 30 days.