unsloth
/

GLM-4.7-Flash-FP8-Dynamic

Text Generation

compressed-tensors

Model card Files Files and versions

Resources

View closed (0)

Trying to serve with vllm, got this error: ValueError: There is no module or parameter named 'model.layers.1.mlp.gate.e_score_correction_bias' in TransformersMoEForCausalLM

#4 opened 3 days ago by

vllm nightly currently not supporting Blackwell with this model

#3 opened 5 days ago by

Severe Looping/Repetitive Output when using --kv-cache-dtype fp8 with GLM-4.7-Flash-FP8-Dynamic on vLLM

#2 opened 5 days ago by

dual 3090 inference

#1 opened 6 days ago by