qwerrwe / tests /test_tokenizers.py

Commit History

optionally define whether to use_fast tokenizer
47d601f

winglian commited on