Dark-Scarlett-v1.0-31B-FP8mlp-W4attn-multilingualby Ful3π₯οΈ GPUGPTQ~19 GB31B paramsβ¬ 0β₯ 0OthermultilingualView on Hugging Face
Dark-Scarlett-v1.0-31B-W4A16-multilingualby Ful3π₯οΈ GPUGPTQ~19 GB31B paramsβ¬ 0β₯ 0OthermultilingualView on Hugging Face
Dark-Scarlett-v1.0-31B-hybrid12-multilingualby Ful3π₯οΈ GPUGPTQ~19 GB31B paramsβ¬ 0β₯ 0OthermultilingualView on Hugging Face
Gemma-3-1B-it-GPTQ-a16w4-4kby florianvossπ₯οΈ GPUGPTQ~1 GB1B paramsβ¬ 0β₯ 0text-generationLanguagegemmalicense:gemmaView on Hugging Face
LFM2.5-24B-A2B-TT-Mixed-BFP4-BFP8-P150by Lottolabsπ₯οΈ GPUGPTQ~15 GB24B paramsβ¬ 0β₯ 0text-generationLanguageotherlicense:otherView on Hugging Face
shieldgemma-9b-smoothquant-w8a8by marcusnogueiraπ₯οΈ GPUGPTQ~6 GB9B paramsβ¬ 0β₯ 0OtherView on Hugging Face
Llama-3.1-8B-Instruct-GPTQ-a16w4by florianvossπ₯οΈ GPUGPTQ~5 GB8B paramsβ¬ 0β₯ 0text-generationLanguagellama3.1license:llama3.1View on Hugging Face
EdgeRock-4B-GPTQby hkust-aaronπ₯οΈ GPUGPTQ~3 GB4B paramsβ¬ 0β₯ 0text-generationLanguageotherreasoningconversationallicense:otherView on Hugging Face
Nanbeige4.3-33B-Base-W4A16-AutoRoundby stuchapinπ₯οΈ GPUGPTQ~20 GB33B paramsβ¬ 0β₯ 0text-generationLanguageotherreasoninglicense:otherView on Hugging Face
Nanbeige4.3-33B-Base-W8A16-AutoRoundby stuchapinπ₯οΈ GPUGPTQ~20 GB33B paramsβ¬ 0β₯ 0text-generationLanguageotherconversationallicense:otherView on Hugging Face
meta-llama_Llama-3.1-8B-auto_gptq-int8-gs64-symNEWby fbaldassarriπ₯οΈ GPUGPTQ~5 GB8B paramsβ¬ 0β₯ 0text-generationLanguagellama3.1license:llama3.1View on Hugging Face
meta-llama_Llama-3.1-8B-auto_gptq-int4-gs64-symNEWby fbaldassarriπ₯οΈ GPUGPTQ~5 GB8B paramsβ¬ 0β₯ 0text-generationLanguagellama3.1license:llama3.1View on Hugging Face
LFM3-1.7B-TT-Mixed-BFP4-BFP8-P150NEWby Lottolabsπ₯οΈ GPUGPTQ~2 GB1.7B paramsβ¬ 0β₯ 0text-generationLanguageotherlicense:otherView on Hugging Face
meta-llama_Llama-3.1-8B-auto_gptq-int4-gs64-asymNEWby fbaldassarriπ₯οΈ GPUGPTQ~5 GB8B paramsβ¬ 0β₯ 0text-generationLanguagellama3.1license:llama3.1View on Hugging Face