Appreciate the model drop!
#2
by
Nitral-AI
- opened
But why is it only 4k? Its 2024 man, those are rookie numbers.
Hey @Nitral-AI , an extended context length version is forthcoming. Also, our models were trained with RoPE which allows them to accept inputs beyond 4K tokens in their current state.