NVIDIA-Nemotron-3.5-Lightning-30B-A3B-FP8

by RedHatAI

Task
Text generation
Category
Language
License
Not stated
Commercial use
Check the license
The license isn't a standard one; read the model card on Hugging Face before using it commercially.
Size
About 30 billion parameters
Memory to load
~72 GB (estimate)
Format
FP16
Runs on
GPU
Access
Open download
Downloads (last 30 days)
960K
Likes
11
Last updated
September 17, 2026

How to run it

These are full-precision weights, usually loaded with Hugging Face Transformers or Diffusers on a GPU.

Plan for roughly 72 GB of memory to load it (our estimate from its size and format).

The model card on Hugging Face has the exact usage code.

Related text generation models

Data from Hugging Face's public API, last checked October 19, 2026. Downloads are Hugging Face's count for the last 30 days.