Why is the model_max_length so big?

#8
by nbertagnolli - opened

Why is model_max_length set to 1000000000000000019884624838656? Should this be 512? When I run experiments using this model it seems to not take into account information from sequences over this length. Are you open to a PR to fix this?

Sign up or log in to comment