-
-
-
-
-
-
Inference Providers
Active filters:
8-bit
Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2
Text Generation
•
2B
•
Updated
•
5
nhotin/vistral7B-legalbizai-q8-gguf
Text Generation
•
7B
•
Updated
•
6
XelotX/WizardLM-2-8x22B-XelotX-iQuants
Text Generation
•
141B
•
Updated
•
207
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8
Text Generation
•
0.6B
•
Updated
•
134
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
30
PrunaAI/In2Training-FILM-7B-bnb-4bit-smashed
4B
•
Updated
•
14
Xu-Ouyang/pythia-160m-deduped-int8-step36000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
5
Xu-Ouyang/pythia-160m-deduped-int8-step71000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
6
Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
4
Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
5
Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
5
Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
4
Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
4
Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
6
Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
5
Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
7
myrulezzzz/newdata_mistral4bit
Text Generation
•
4B
•
Updated
•
6
ZeZanZiet/blip2_image_captioning_v1
Updated
•
20
bullerwins/Big-Tiger-Gemma-27B-v1-exl2_8.0bpw
Text Generation
•
Updated
•
4
•
1
smokxy/agri_bert_classifier_quantized
Text Classification
•
0.1B
•
Updated
•
8
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation
•
71B
•
Updated
•
25
smokxy/roberta-base-squad2-quantized
Question Answering
•
0.1B
•
Updated
•
9
Aung2024/labour_law
Text Generation
•
0.7B
•
Updated
•
8
dphn/dolphin-2.9.2-qwen2-72b-eetq
Text Generation
•
73B
•
Updated
•
11
•
1
HRuiii/Llama-2-7b-GPTQ-8bit
Text Generation
•
Updated
•
4
Ksgk-fy/maria_v113_gptq_prompt
Text Generation
•
3B
•
Updated
•
5
FuturisticVibes/Llama-3-Chatty-2x8B-8.0bpw-h8-exl2
Text Generation
•
Updated
•
4
FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-DPO-8.0bpw-h8-exl2
Text Generation
•
Updated
•
5
FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-SFT-8.0bpw-h8-exl2
Text Generation
•
Updated
•
6
MaziyarPanahi/mathstral-7B-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
105k
•
7