change max_new_tokens

README.md

@@ -107,7 +107,7 @@ for data in tqdm(datasets):
       outputs = model.generate(
           tokenized_input,
           attention_mask=attention_mask,
-          max_new_tokens=512,
+          max_new_tokens=1024,
           do_sample=False,
           repetition_penalty=1.2,
           pad_token_id=tokenizer.eos_token_id