Ternary-Bonsai-2-27B-Crystal

by tfwnotops

Task
Text generation
Category
Language
License
Apache 2.0
Commercial use
Yes
Permissive license: commercial use is allowed; keep the copyright and license notice.
Size
About 27 billion parameters
Memory to load
~17 GB (estimate)
Format
MLX
Runs on
CPU
Access
Open download
Downloads (last 30 days)
0
Likes
1
Last updated
September 29, 2026

How to run it

This is an MLX build for Apple silicon Macs; run it with Apple's MLX framework (mlx-lm for language models).

Plan for roughly 17 GB of memory to load it (our estimate from its size and format).

The model card on Hugging Face has the exact usage code.

Where to run it

On your own computer, free

  • Ollama · free app for Mac, Windows and Linux
  • LM Studio · free desktop app with a chat window

Both load GGUF builds; for other formats, look for a GGUF version of this model.

In the cloud

Needs about 17 GB: a 24 GB GPU such as an RTX 4090 or RTX A5000 is enough.

  • RunPod · rent a GPU by the hour (affiliate link)

Related text generation models

Data from Hugging Face's public API, last checked September 29, 2026. Downloads are Hugging Face's count for the last 30 days.