gemma-4-12B-it_rai_1.9.0_npu

by amd

Task
Text generation
Category
Language
License
Gemma license
Commercial use
Yes, with conditions
The publisher's own model license: commercial use is allowed under its terms, which include limits; read them before shipping.
Size
About 12 billion parameters
Memory to load
~58 GB (estimate)
Format
ONNX
Runs on
CPU
Access
Gated: accept the publisher's terms on Hugging Face
Downloads (last 30 days)
0
Likes
0
Last updated
November 2, 2026

How to run it

This is an ONNX export; run it with ONNX Runtime on a CPU or GPU, including in the browser or on mobile.

Plan for roughly 58 GB of memory to load it (our estimate from its size and format).

Downloads are gated: accept the publisher's terms on Hugging Face first.

The model card on Hugging Face has the exact usage code.

Where to run it

In the cloud

Needs about 58 GB: use an 80 GB GPU such as an A100 or H100.

  • RunPod · rent a GPU by the hour (affiliate link)

Related text generation models

Data from Hugging Face's public API, last checked November 3, 2026. Downloads are Hugging Face's count for the last 30 days.