add_prefix_space warning
Hello! I'm fairly new to MLX, and I earlier tried converting this in my learning process—my first attempt converting/sharing an MLX model. I put it in my personal namespace rather than mlx-community, just until I'm a bit more confident I know what I'm doing: https://huggingface.co/ucheog/h2o-danube2-1.8b-chat-MLX-4bit . ANy differences between that and this will help guide my learning.
One of the things that gave me pause was the following warning:
You set
add_prefix_space. The tokenizer needs to be converted from the slow tokenizers
I just tried this version by Prince Canuma and it has the same warning.
Is this maybe just a warning to be ignored? Does anyone know whether it actually represents a performance hit? I tried looking around in transformers code, but I couldn't find any quick answer to this.
Awesome, well done!
It's a normal warning, you can ignore it :)
Great. The tidbit that it's a normal warning was what I needed; thanks!
BTW, I've written up my experience: https://github.com/uogbuji/mlx-notes/blob/main/2024/conversion-etc.md