Intel Neural Compressor

INC4AI 's models 19

Sort:  Recently updated

INC4AI/Step-3.5-Flash-int4-AutoRound

193B • Updated about 18 hours ago • 3

INC4AI/Qwen3-Coder-Next-Base-AutoRound

12B • Updated 2 days ago • 5

INC4AI/Qwen3-30B-A3B-Instruct-2507-FP8-2Layers

2B • Updated 8 days ago • 123

INC4AI/DeepSeek-Math-V2-int4-AutoRound

Text Generation • 3B • Updated 9 days ago • 9

INC4AI/unsloth-DeepSeek-R1-BF16-4Layers-Test-Only

15B • Updated 15 days ago • 39

INC4AI/Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only

8B • Updated 16 days ago • 131

INC4AI/Youtu-LLM-2B-int4-AutoRound

Text Generation • 0.5B • Updated 21 days ago • 27

INC4AI/WeDLM-8B-Instruct-int4-AutoRound

Text Generation • 1B • Updated 21 days ago • 15

INC4AI/MiniMax-M2.1-int4-AutoRound

Text Generation • 1B • Updated 21 days ago • 30

INC4AI/Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only

0.5B • Updated 22 days ago • 13

INC4AI/ds-v32-exp-w4a16-test-only

3B • Updated 25 days ago • 11

INC4AI/DS-V3.2-fp8-w4a16-test-only

3B • Updated 25 days ago • 14

INC4AI/DeepSeek-R1_mxfp8

Updated Jan 8

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated Jan 7 • 7

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated Dec 29, 2025 • 1.46k

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 8

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated Dec 19, 2025

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated Dec 19, 2025

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025