Spaces:
Sleeping
Sleeping
Apply for community grant: Personal project (gpu)
#1
by
randomblock1
- opened
I'm trying to bring Microsoft's new Phi-2 model to Spaces but it is pretty slow on CPU, even on the upgraded CPU. And that's not even considering the growing queue of other people experimenting with it. I think it'd be a good candidate for a GPU given how popular and performant Phi-2 is (since it's new) and how there isn't an official Colab notebook or quantized version.
yes, would love a faster version of this! cc @hysts
randomblock1
changed discussion status to
closed