internlm
/

internlm2-base-7b

Text Generation

Model card Files Files and versions Community

internlm2-base-7b / tokenization_internlm2_fast.py

Commit History

fix no white space when using stream_chat with fast tokenizer

8c7f44e

x54-729 commited on Feb 28, 2024

fast tokenizer and stream_chat fix (#1)

bff2446
verified

x54-729 commited on Jan 24, 2024