AravindaHWK commited on
Commit
6b02398
1 Parent(s): 2e52e6b

Uploaded updated Sinhala tokenizer

Browse files
Files changed (2) hide show
  1. tokenizer.json +2 -2
  2. tokenizer_config.json +0 -0
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d12549d916c9738baf0c33dc577c9fc6cde93f7b4fff7c113c8630c7b91ea69
3
- size 11013198
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0aa128f93a40e67c29d7d57d92f8d5c5215cb01aa1a1084722338a99380c9ea1
3
+ size 11213816
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff