Request: Smaller models.
#33
by
ZeroWw
- opened
Could you please also provide smaller versions of grok.. like 8B,27B, 32B ? It would be great to experiment with them.
I am sure you already have them ready.
exactly right my friend or is it limited to being a mixture of experts ?
i wonder how small a moe can be?