phi-4 / converted_tokenizer_128k /tokenizer.vocab

Commit History

tokenizer trained on 128k - not sure if it'll be better for RoPE or not
b6d69b7
verified

smcleod commited on