宋小猫
SongXiaoMao
·
AI & ML interests
None yet
Recent Activity
new activity
5 days ago
Qwen/QwQ-32B:When will you fix the model replies missing</think>\n start tags
new activity
6 days ago
Qwen/QwQ-32B:missing opening <think>
Organizations
None yet
SongXiaoMao's activity
missing opening <think>
18
#4 opened 10 days ago
by
getfit

非常感谢您的量化 求一个其他的量化模型可以吗?
#1 opened 12 days ago
by
SongXiaoMao

非常喜欢这个模型
#9 opened 14 days ago
by
SongXiaoMao

这个模型真的太好用了
#7 opened 14 days ago
by
SongXiaoMao

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?
9
#24 opened about 1 month ago
by
SongXiaoMao

No think tokens visible
6
#15 opened about 1 month ago
by
sudkamath
How to Pair with Larger Models
4
#7 opened 2 months ago
by
windkkk
Very easy to use
#2 opened 3 months ago
by
SongXiaoMao

multi GPU inferencing
2
#18 opened 4 months ago
by
cjj2003
Use sample code to start error reporting
1
#45 opened 3 months ago
by
SongXiaoMao

vllm reply garbled
3
#29 opened 4 months ago
by
SongXiaoMao

vllm has problems running this model
3
#46 opened 3 months ago
by
SongXiaoMao

Can you officially support VLLM?
1
#48 opened 3 months ago
by
SongXiaoMao

Does vllm support this model yet?
#63 opened 7 months ago
by
SongXiaoMao

The model can be started using vllm, but no dialogue is possible.
3
#2 opened 8 months ago
by
SongXiaoMao

How should vllm start it?
2
#24 opened 8 months ago
by
SongXiaoMao

请问这个4bit模型支持vllm启动吗?
#11 opened 8 months ago
by
SongXiaoMao
