missing last token
#2
by
paperplanedeemo
- opened
Hi I'm using this model with mlx-lm 0.16.1 and the model output using mlx_lm.server always missing the last token just like this
And it's weird that if I use curl to contact with api, everything is fine
It seems like it’s mlx_server problem.
Please open an issue on their GH repo
prince-canuma
changed discussion status to
closed