Qwen
/

Qwen-7B

Text Generation

Model card Files Files and versions Community

Qwen-7B / tokenization_qwen.py

Commit History

refactor tokenization and update readme

7bd1639

yangapku commited on Aug 5, 2023

revert convert_tokens_to_string

d3abbdb

yangapku commited on Aug 4, 2023

update cpu support, readme and convert_tokens_to_string

e7ecd2a

yangapku commited on Aug 4, 2023

update fast usage

4339056

yangapku commited on Aug 3, 2023

implement _convert_id_to_token

a4200b0

yangapku commited on Aug 3, 2023

update tokenization_qwen.py

7e110da

yangapku commited on Aug 3, 2023

update tokenization_qwen.py

af9914c

yangapku commited on Aug 3, 2023

upload resource files

580a183

yangapku commited on Aug 3, 2023