for your consideration
#1
by
LaferriereJC
- opened
what of phi as well as wizardlm?
What do you mean?
Wizardlm is llama based
Idk if phi is but if it is. I see your proposing merging 8b w 7b, and phi-3 3.8b is claiming to be better than llama 3.
So I was asking if you'd consider merging those in
Currently, it's really difficult/inefficient to merge models that don't have the exact same architecture, so I'll pass for now unfortunately. It might come soon though
but wizardlm is mistral based =D