phi-4 / converted_tokenizer_128k /tokenizer.model

tokenizer trained on 128k - not sure if it'll be better for RoPE or not

b6d69b7 verified 12 days ago

2.04 MB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.