arxyzan commited on
Commit
8ef8c5e
1 Parent(s): 59d5467

Hezar: Upload tokenizer and config

Browse files
preprocessor/normalizer_config.yaml CHANGED
@@ -1,4 +1,4 @@
1
  name: normalizer
2
- config_type: PREPROCESSOR
3
- nfkd: true
4
- nfkc: true
 
1
  name: normalizer
2
+ config_type: preprocessor
3
+ nfkd: 'True'
4
+ nfkc: 'True'