Qwen3 Quantized - a RedHatAI Collection

RedHatAI 's Collections

Red Hat AI validated models - October 2025

Red Hat AI validated models - September 2025

Speculator Models

Red Hat AI validated models - May 2025

Gemma-3 Quantized

Whisper Quantized

Llama 4 Quantized

Qwen3 Quantized

Mistral-Small-3.1 (2503) Instruct Quantized

Phi-4 Quantized

Llama 3.3 70B Instruct Quantized

Qwen 2.5 Quantized

Granite Quantized

Qwen3 Quantized

updated Nov 10

Collection of quantized Qwen 3 models from Alibaba Cloud.

RedHatAI/Qwen3-4B-quantized.w4a16

Text Generation • 1B • Updated May 13 • 1.19k • 4
RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • 33B • Updated May 13 • 5.33k • 15
RedHatAI/Qwen3-0.6B-FP8-dynamic

Text Generation • 0.8B • Updated May 12 • 3.2k • 1
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated Sep 22 • 9.96k • 9
RedHatAI/Qwen3-14B-FP8-dynamic

Text Generation • 15B • Updated May 13 • 543 • 4
RedHatAI/Qwen3-4B-FP8-dynamic

Text Generation • 4B • Updated Sep 10 • 292
RedHatAI/Qwen3-1.7B-FP8-dynamic

Text Generation • 2B • Updated May 12 • 181
RedHatAI/Qwen3-1.7B-quantized.w4a16

Text Generation • 0.8B • Updated May 12 • 523 • 3
RedHatAI/Qwen3-0.6B-quantized.w4a16

Text Generation • 0.4B • Updated May 12 • 239
RedHatAI/Qwen3-30B-A3B-FP8-dynamic

Text Generation • 31B • Updated May 13 • 4.02k • 3
RedHatAI/Qwen3-14B-quantized.w4a16

Text Generation • 3B • Updated May 13 • 520
RedHatAI/Qwen3-235B-A22B-FP8-dynamic

Text Generation • 235B • Updated May 6 • 231 • 2
RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • 6B • Updated May 13 • 494 • 11
RedHatAI/Qwen3-8B-quantized.w4a16

Text Generation • 2B • Updated May 13 • 6.67k • 3