How to stop reasoning?
#16
by
yuchenxie
- opened
I want to use this model as a reasoning and non reasoning model. How do I stop reasoning? /no_think does not work even for glm 4.5 I tried
If you want to disable reasoning, you should add extra_body={"chat_template_kwargs": {"enable_thinking": False}} when using vLLM or sglang.
What about in llama.cpp situation? Having to type /nothink can get tedious sometimes.