Xenova
/

nucleotide-transformer-500m-1000g

Feature Extraction

Transformers.js

Model card Files Files and versions Community

Xenova HF staff commited on Dec 10, 2023

Commit

4d01dfc

·

1 Parent(s): a7f38b6

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +1 -1

tokenizer.json CHANGED Viewed

@@ -36969,7 +36969,7 @@
   ],
   "normalizer": null,
   "pre_tokenizer": {
-    "type": "BertPreTokenizer"
   },
   "post_processor": {
     "type": "TemplateProcessing",

   ],
   "normalizer": null,
   "pre_tokenizer": {
+    "type": "WhitespaceSplit"
   },
   "post_processor": {
     "type": "TemplateProcessing",