Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

839

Full-text search

Active filters: quantization

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated 6 days ago • 90 • 4

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated 24 days ago • 10.4k • 21

webxos/microclaw-for-openclaw-version-2026.2.17

Text Generation • Updated 5 days ago • 346 • 5

Em-80/Qwen3-coder-REAP-25B-A3B-Rust-GGUF

Text Generation • 25B • Updated Jan 27 • 1.82k • 7

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated 5 days ago • 51 • 2

Shifusen/Qwen3.5-122B-A10B-abliterated-FP8

Text Generation • 123B • Updated 1 day ago • 10 • 2

ai-in-projectmanagement/ProjectManagementLLM

Text Generation • Updated Jun 19, 2025 • 11

btaskel/RWKV7-2.9B-v3-UnlimitedRP-mini-novel-chat-preview-GGML

Updated Mar 9, 2025 • 5 • 2

gpahal/bge-m3-onnx-int8

Feature Extraction • Updated Jun 25, 2025 • 1.74k • 1

pkhairkh/qwen3-coreml-palettized

Text Generation • Updated Dec 9, 2025 • 19 • 2

Akicou/GLM-4.7-Flash-REAP-39-GGUF

19B • Updated Jan 23 • 188 • 1

tonera/oneObsession_v16Noobai

Text-to-Image • Updated Jan 23 • 12 • 1

nota-ai/Solar-Open-100B-NotaMoEQuant-Int4

Text Generation • Updated Jan 26 • 3.1k • 42

Akicou/glm-edge-v-5b-GGUF

4B • Updated 20 days ago • 411 • 1

servic/gpt-oss-20b-reap-0.4-mxfp4-heretic

Text Generation • 2B • Updated 11 days ago • 15 • 2

Joysulem/FireEcho

Text Generation • Updated 11 days ago • 12 • 1

groxaxo/Qwen3-4B-Instruct-2507-heretic-W8A16

Text Generation • 4B • Updated about 9 hours ago • 7 • 1

tobleron900/Nanbeige-4.1-3B-Instruct-GGUF

Updated 1 day ago • 105 • 1

groxaxo/qwen3-embed-8b-gptq

Feature Extraction • 2B • Updated 1 day ago • 26 • 1

luigicfilho/intento-v1-edge

504k • Updated 4 days ago • 1

Shifusen/Qwen3.5-122B-A10B-FP8

Image-Text-to-Text • 123B • Updated 3 days ago • 1.81k • 1

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • 6B • Updated Jan 10, 2025 • 5 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • 6B • Updated Dec 25, 2024 • 13 • 4

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 6

leumastai/t5-large-quantized

Updated Mar 16, 2023 • 1 • 1

pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g

Text Generation • Updated Dec 29, 2025 • 1 • 3

limcheekin/flan-t5-small-ct2

Updated May 24, 2023 • 6

limcheekin/flan-t5-xl-ct2

Updated Jun 3, 2023 • 3 • 1

limcheekin/flan-t5-xxl-ct2

Updated May 30, 2023 • 2 • 1

limcheekin/fastchat-t5-3b-ct2

Text Generation • Updated Jun 28, 2023 • 4 • 2