All GGUF quants that I have made so far, and demos too.
-
Fu01978/Llama-3.2-3B-MoE-4Expert-Q4_K_M-GGUF
Text Generation • 10B • Updated • 348 -
Fu01978/Hunyuan-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 2.18k • 1 -
Hunyuan-0.5B-Instruct-GGUF Demo
⚡Demo of Fu01978/Hunyuan-0.5B-Instruct-GGUF
-
Fu01978/OLMo-2-1B-openai-gsm8k-GGUF
Text Generation • 1B • Updated • 252