GLM-5.3-NF4I8-GPTQ-H32-g128

by HawkBearPig

Task
Text generation
Category
Language
License
Custom (other)
Commercial use
Check the license
The license isn't a standard one; read the model card on Hugging Face before using it commercially.
Size
Not stated
Memory to load
Not enough data
Format
GPTQ
Runs on
GPU
Access
Open download
Downloads (last 30 days)
0
Likes
0
Last updated
October 8, 2026

How to run it

These are 4-bit quantized weights for NVIDIA GPUs; load them with a library that supports GPTQ, such as vLLM or Hugging Face Transformers.

The model card on Hugging Face has the exact usage code.

Where to run it

In the cloud

Check the model card for its memory needs; cloud GPUs range from 16 GB to 80 GB and beyond.

  • RunPod · rent a GPU by the hour (affiliate link)

Related text generation models

Data from Hugging Face's public API, last checked October 8, 2026. Downloads are Hugging Face's count for the last 30 days.