Missing tokenizer.json

#1
by amitgalor - opened

When working offline (after downloading this model repo) it tries to download an external tokenizer. It would be helpful to have this tokenizer.config in the repo, to obviate outside requirements.

ivrit.ai org

Done

benderrodriguez changed discussion status to closed

Sign up or log in to comment