Changes for fast tokenizer

#7
jonatanklosko changed pull request status to open
ArthurZ changed pull request status to merged

Sign up or log in to comment