Hugging Face's logo

hadidev
/
gpt2-urdu-tokenizer

Model card Files Community
hadidev commited on
Commit
3ea7fbf
•
1 Parent(s): 683b61c

add tokenizer

Browse files
Files changed (3) hide show
  1. merges.txt +0 -0
  2. tokenizer.json +2 -2
  3. vocab.json +0 -0
merges.txt CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3e1c6a259ddbdfd2b6632b5bb4b86d1113f2db6794bf1b68a51718760695574f
3
- size 22270233
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d03f7101a8b2908a2ce5721985f4772f6b13ae2f05ad64354cd9c598fa68ac6
3
+ size 22197328
vocab.json CHANGED
The diff for this file is too large to render. See raw diff