What is the context size of this model?
#1
by
CR2022
- opened
Hello, What is the context size of this model?
Hello! If I remember correctly, base context is 8k (8,192), however they can be pushed higher by RoPE, however I can't guarantee it'll work well