Transformers
GGUF
programming
code generation
code
codeqwen
Mixture of Experts
coding
coder
qwen2
chat
qwen
qwen-coder
Qwen3-Coder-30B-A3B-Instruct
Qwen3-30B-A3B
mixture of experts
128 experts
10 active experts
256k context
qwen3
finetune
brainstorm 40x
brainstorm
optional thinking
qwen3_moe
imatrix
conversational
Repetition Loops
#1
by
chrisoutwright
- opened
Have you tried adjusting Repetition penalty/Frequency penalty/Presence penalty? Sometimes this help but if it is that extreme it could also just be the that the model wasn't trained/merged well.
These are my params:
{
"repeat_penalty": 1.05,
"stop": ["<|im_start|>", "<|im_end|>", "<|endoftext|>"],
"temperature": 0.7,
"top_k": 20,
"top_p": 0.8,
"num_gpu":91,
"num_ctx":90000
}
