by openai-community
⬇ 29.8M♥ 3.9K
flint-NVFP4
- Task
- Text generation
- Category
- Language
- License
- Apache 2.0
- Commercial use
- Yes
Permissive license: commercial use is allowed; keep the copyright and license notice. - Size
- Not stated
- Memory to load
- Not enough data
- Format
- GPTQ
- Runs on
- GPU
- Access
- Open download
- Downloads (last 30 days)
- 0
- Likes
- 1
- Last updated
- October 22, 2026
How to run it
These are 4-bit quantized weights for NVIDIA GPUs; load them with a library that supports GPTQ, such as vLLM or Hugging Face Transformers.
The model card on Hugging Face has the exact usage code.
Where to run it
In the cloud
Check the model card for its memory needs; cloud GPUs range from 16 GB to 80 GB and beyond.
- RunPod · rent a GPU by the hour (affiliate link)
Related text generation models
Data from Hugging Face's public API, last checked October 22, 2026. Downloads are Hugging Face's count for the last 30 days.