jbochi
/

madlad400-7b-mt-bt

text2text-generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jbochi commited on Nov 6, 2023

Commit

84d0753

•

1 Parent(s): b12242f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -447,7 +447,7 @@ input_ids = tokenizer(text, return_tensors="pt").input_ids
 outputs = model.generate(
     input_ids=input_ids,
     generation_config=GenerationConfig(
-        decoder_start_token_id=1,
 ))
 tokenizer.decode(outputs[0], skip_special_tokens=True)

 outputs = model.generate(
     input_ids=input_ids,
     generation_config=GenerationConfig(
+        decoder_start_token_id=0,
 ))
 tokenizer.decode(outputs[0], skip_special_tokens=True)