TYSM for these incredible models !! Any plans for smaller (7-20B params range) versions ?
#5
by
NotAnArchDev
- opened
Very appreciative of your work
Cogito V1 preview is one of my favotrite to use locally
I was so happy seeing V2 coming out, any plans to release versions within the 7B to 20B param range so they can be used on more consumer hardware ?
Thank you for your answer !
I have to 2nd that. I loved V1 and its my daily driver 90% of the time. But, bumping up to 70b is a bit too much for my local GPU and would have to move to CPU.
...or has the ship sailed on smaller models for us mortals?