Max input tokens

#3
by yunsxie - opened

Hello, thank you for the great work. I'm wondering what is the maximum input token number does this model support? Evidentially, according to https://huggingface.co/01-ai/Yi-34B the baseline model is able to support 32K token input. Have you happened to test it?

Southern university of science and technology org

The base model only support 4K token input

facat changed discussion status to closed

Sign up or log in to comment