NVIDIA-Nemotron-3.5-Bolt-74B-A9B-W4A16-g64-AutoRound-GPTQ
- Task
- Not stated
- Category
- Other
- License
- Not stated
- Commercial use
- Check the license
The license isn't a standard one; read the model card on Hugging Face before using it commercially. - Size
- About 74 billion parameters
- Memory to load
- ~45 GB (estimate)
- Format
- GPTQ
- Runs on
- GPU
- Access
- Open download
- Downloads (last 30 days)
- 0
- Likes
- 0
- Last updated
- October 24, 2026
How to run it
These are 4-bit quantized weights for NVIDIA GPUs; load them with a library that supports GPTQ, such as vLLM or Hugging Face Transformers.
Plan for roughly 45 GB of memory to load it (our estimate from its size and format).
The model card on Hugging Face has the exact usage code.
Where to run it
In the cloud
Needs about 45 GB: use a 48 GB GPU such as an RTX A6000 or L40S.
- RunPod · rent a GPU by the hour (affiliate link)
Data from Hugging Face's public API, last checked October 24, 2026. Downloads are Hugging Face's count for the last 30 days.