spm-tokenizer / spiece.model

tokenizer: add config, model and model config

63f65be about 2 years ago

816 kB

This file is stored with Xet . It is too big to display, but you can still download it.

( Raw pointer file )

SHA256:: d799691b97504ab38b8a089f8fcab40b2ed68db93a2ca2a3113bbba6b11ad5ff
Pointer size:: 131 Bytes
Size of remote file:: 816 kB
Xet backed hash:: 8d26687e93a320d0cb8c02205fe09cfb1eaa6b4ff15b2a321b18bbff17d6efd7

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.