Intel Neural Compressor

INC4AI 's models 17

Sort:  Recently updated

INC4AI/DeepSeek-Math-V2-int4-AutoRound

3B • Updated 3 days ago • 3

INC4AI/DeepSeek-V3.2-Speciale-int4-AutoRound

3B • Updated 4 days ago • 2

INC4AI/unsloth-DeepSeek-R1-BF16-4Layers-Test-Only

15B • Updated 5 days ago • 39

INC4AI/Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only

8B • Updated 6 days ago • 9

INC4AI/Youtu-LLM-2B-int4-AutoRound

Text Generation • 0.5B • Updated 10 days ago • 22

INC4AI/WeDLM-8B-Instruct-int4-AutoRound

Text Generation • 1B • Updated 10 days ago • 15

INC4AI/MiniMax-M2.1-int4-AutoRound

Text Generation • 1B • Updated 10 days ago • 29

INC4AI/Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only

0.5B • Updated 12 days ago • 13

INC4AI/ds-v32-exp-w4a16-test-only

3B • Updated 15 days ago • 11

INC4AI/DS-V3.2-fp8-w4a16-test-only

3B • Updated 15 days ago • 14

INC4AI/DeepSeek-R1_mxfp8

Updated 23 days ago

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated 24 days ago • 9

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated Dec 29, 2025 • 832

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 8

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated Dec 19, 2025

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated Dec 19, 2025

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025