Zheng Han

traphix's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic about 13 hours ago

Creation details?

#2 opened about 13 hours ago by

traphix

New activity in nivvis/Qwen3.5-122B-A10B-heretic-v2-FP8 about 14 hours ago

Which framework was used for FP8 quantization? LLM-compressor?

2

#1 opened 1 day ago by

traphix

New activity in huihui-ai/Huihui-Qwen3-Coder-Next-abliterated 1 day ago

GPTQ quantization

2

#2 opened about 1 month ago by

ArtemSultanov

New activity in win10/Huihui-Qwen3.5-27B-abliterated-FP8 1 day ago

Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?

#1 opened 1 day ago by

traphix

New activity in edp1096/Huihui-Qwen3.5-27B-abliterated-FP8 1 day ago

Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?

#2 opened 1 day ago by

traphix

New activity in inference-optimization/Qwen3-Coder-Next.w4a16 11 days ago

Question about weight_observer？

2

#1 opened 11 days ago by

traphix

New activity in RedHatAI/MiniMax-M2.5 21 days ago

INT4 w4a16 quantinization？

➕ 1

#1 opened 21 days ago by

traphix

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic 22 days ago

Quantization code for int4(w4a16) ?

#6 opened 22 days ago by

traphix

W4A16 quant

👍 2

4

#1 opened about 1 month ago by

timroethig

New activity in RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16 2 months ago

Tokenizer you are loading with an incorrect regex pattern

1

#2 opened 3 months ago by

traphix

New activity in Intel/Qwen3-Next-80B-A3B-Instruct-int4-AutoRound 3 months ago

Failed to find a kernel that can implement the WNA16 linear layer

#1 opened 3 months ago by

traphix

New activity in RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16 3 months ago

vllm error: Extra inputs are not permitted

#1 opened 3 months ago by

traphix

New activity in RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4 4 months ago

Can A100 run Qwen3-235B-A22B-Instruct-2507-NVFP4?

#1 opened 4 months ago by

traphix

New activity in Qwen/Qwen3-Next-80B-A3B-Instruct-FP8 6 months ago

Error on 4 x L40s

➕ 2

1

#4 opened 6 months ago by

traphix

I got ValueError

👀 2

10

#3 opened 6 months ago by

spow12

New activity in shanjiaz/qwen3-80b-fp8-dynamic 6 months ago

How to run this model via vllm？

11

#2 opened 6 months ago by

traphix

New activity in Qwen/Qwen3-Next-80B-A3B-Instruct 6 months ago

FP8 please

👀➕ 16

8

#18 opened 6 months ago by

aliquis-pe

New activity in DevQuasar/Qwen.Qwen3-Next-80B-A3B-Instruct-FP8-Dynamic 6 months ago

vllm v0.10.2 error

❤️ 1

#2 opened 6 months ago by

traphix

New activity in DevQuasar/Qwen.Qwen3-Next-80B-A3B-Instruct-FP8 6 months ago

VLLM compatibility?

9

#1 opened 6 months ago by

aidendle94

New activity in shanjiaz/qwen3-80b-fp8-dynamic 6 months ago

Instruct or Thinking?

#1 opened 6 months ago by

traphix