

TITLE
ByT5 model

COMMENTS
12

REACTIONS
+1: 2
-1: 0
laugh: 0
hooray: 0
heart: 2
rocket: 0
eyes: 0

BODY
## ByT5

- Code: https://github.com/google-research/byt5
- Paper: https://arxiv.org/abs/2105.13626
- Twitter: https://twitter.com/colinraffel/status/1399525871678103552

- Ported checkpoints: https://huggingface.co/models?filter=arxiv:1907.06292

This model only requires a new tokenizer (and a tiny change to TFT5). New tokenizer does not require a vocab file as model just uses raw bytes.