tokens

#20
by ali00 - opened

LLama is supposed to have 2048 tokens but i keep getting error for more than 512 tokens . I am prompting to write summary of text which has greater lengths, any solution

image_2023-08-14_144552629.png

Increase your context size. Try passing n_ctx=4096 to the Llama()

it works , thanks

Sign up or log in to comment