internlm2-math-base-7b / tokenization_internlm2_fast.py

Commit History

fix no white space when using stream_chat with fast tokenizer
d097bac

x54-729 commited on

update name to internlm2
f57f2d4

x54-729 commited on