Where's the 13B version of v1.5 or v2.0? ๐Ÿค”

#2
by MatthewK - opened

I see the newer versions for 70B and 7B, but not 13B.. ๐Ÿฅบ

Also, thanks for all your hard work on these! ๐Ÿ˜Š๐Ÿ‘

Hey Matthew,
Thanks for your message. Well, itโ€™s really because of one reason. Due to the stronger Mistral-7B base model, anything that Iโ€™ll train with LLaMA-2-13B will already be lower in evals than the 7B models (based on Mistral)..
But if I get an opportunity Iโ€™ll train 13B-v2.0 and release it.
Thanks,
Migel

Sign up or log in to comment