ElliotGao

tclf90's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in QuantTrio/GLM-5-AWQ 1 day ago

Great work

5

#1 opened 1 day ago by

JoeyHwong

New activity in QuantTrio/Qwen3.5-35B-A3B-AWQ 1 day ago

How run this model on Sglang?

1

#2 opened 1 day ago by

Salvadori

New activity in QuantTrio/Qwen3.5-397B-A17B-AWQ 1 day ago

Anyone else getting only exclamation marks?

15

#3 opened 3 days ago by

Halbin

QuantTrio/Qwen3.5-397B-A17B-AWQ reponse is !

6

#5 opened 2 days ago by

duyuting

New activity in QuantTrio/Qwen3.5-397B-A17B-AWQ 2 days ago

GPTQ int4-int8 mixed

2

#4 opened 3 days ago by

darkstar3537

New activity in QuantTrio/Qwen3.5-35B-A3B-AWQ 3 days ago

Can't get vLLM running on 1xRTX 4090

1

#1 opened 4 days ago by

slyfox1186

New activity in QuantTrio/GLM-4.7-Flash-AWQ about 1 month ago

--max-model-len 32768 ?

1

#1 opened about 1 month ago by

pathosethoslogos

New activity in QuantTrio/DeepSeek-V3.2-AWQ about 2 months ago

The model startup using vllm failed.

10

#5 opened 2 months ago by

beausoft

New activity in QuantTrio/GLM-4.7-GPTQ-Int4-Int8Mix 2 months ago

Accessing LLM, response without<think>start tag

5

#2 opened 2 months ago by

sudage

New activity in QuantTrio/MiniMax-M2-AWQ 2 months ago

Minimax-M2.1 AWQ Please

2

#6 opened 2 months ago by

mtcl

New activity in QuantTrio/GLM-4.7-GPTQ-Int4-Int8Mix 2 months ago

How do you run this?

3

#1 opened 2 months ago by

mtcl

New activity in QuantTrio/GLM-4.7-AWQ 2 months ago

Once again Thanks, here is my review for 8 x RTX 5090 setup

17

#2 opened 2 months ago by

crystech

New activity in QuantTrio/DeepSeek-V3.2-AWQ 2 months ago

can this model be Quantized?

3

#4 opened 2 months ago by

tinging

New activity in QuantTrio/GLM-4.6-AWQ 2 months ago

endless response

3

#5 opened 3 months ago by

ramidahbash

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

[request] DeepSeek-V3.1-Terminus

4

#3 opened 3 months ago by

willfalco

New activity in QuantTrio/MiniMax-M2-AWQ 3 months ago

Quickly degrades

29

#3 opened 4 months ago by

ehartford

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

ooof this fits in 4x96gb can we get this for the new 3.2 Speciale ase well please :)

16

#2 opened 3 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.2-AWQ 3 months ago

Aww Man!

20

#1 opened 3 months ago by

mtcl

New activity in QuantTrio/Qwen3-VL-32B-Instruct-AWQ 3 months ago

Issues with structured output

3

#1 opened 3 months ago by

cormak

New activity in QuantTrio/MiniMax-M2-AWQ 4 months ago

Entry Not Found ... model-00027-of-00041.safetensors.

➕ 🔥 3

4

#4 opened 4 months ago by

richardhundt