Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

26,503

Full-text search

Active filters: 8-bit

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 2

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 3

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 2

Adeptschneider/dyu_to_fr_v8.0_flan-t5-8bit

0.2B • Updated Jul 12, 2024 • 3

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 3

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 2

nhotin/vistral7B-legalbizai-q8-gguf

Text Generation • 7B • Updated Jul 12, 2024 • 2

RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8

Text Generation • 0.6B • Updated Oct 9, 2024 • 83

RedHatAI/Qwen2-7B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Oct 9, 2024 • 9

PrunaAI/In2Training-FILM-7B-bnb-4bit-smashed

4B • Updated Jul 13, 2024 • 7

Xu-Ouyang/pythia-160m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-160m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024 • 2

Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024 • 1

Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024 • 1

Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024 • 3

myrulezzzz/newdata_mistral4bit

Text Generation • 4B • Updated Jul 13, 2024 • 3

ZeZanZiet/blip2_image_captioning_v1

Updated Sep 18, 2024 • 5

bullerwins/Big-Tiger-Gemma-27B-v1-exl2_8.0bpw

Text Generation • Updated Jul 14, 2024 • 5 • 1

smokxy/agri_bert_classifier_quantized

Text Classification • 0.1B • Updated Jul 14, 2024 • 9

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Oct 9, 2024 • 31