sbintuitions
/

sarashina2-7b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Update tokenizer_config.json

#1

by kajyuuen - opened Aug 26

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -131,5 +131,5 @@
   "add_dummy_prefix_space": false,
   "legacy": false,
   "add_bos_token": false,
-  "add_eos_token": true
 }

   "add_dummy_prefix_space": false,
   "legacy": false,
   "add_bos_token": false,
+  "add_eos_token": false
 }