Max Length of 32768

#18
by hugginghugging - opened

Thank you for open-sourcing this great model! In the example code, max_length is set to 32768. Is there a reason for setting the max length to this large number? I took a look at the paper and this argument is set to 512 for fair comparison with baselines.

What is the token length for this model?

Sign up or log in to comment