Apply for community grant: Academic project (gpu)

#1
by BramVanroy - opened

I would like to request a GPU grant to run this small but efficient LLM for Dutch

Hi @BramVanroy , we have assigned t4-small as it was the hardware you were using. BTW, I'm wondering if this Space can run on ZeroGPU. As you are in the ZeroGPU explorers org, I think you can assign ZeroGPU yourself. Didn't ZeroGPU work for this Space?

@hysts Ah, I can enable it, yes. For testing the model out it was not ideal, though, since it kicked me out for over-using it a lot :D

@hysts I have enabled zero in the settings and then did a factory rebuild, but it seems to be still suck on a T4. Any idea why?

Got it working, I think it was a torch version mismatch.

BramVanroy changed discussion status to closed
BramVanroy changed discussion status to open

@hysts As reported on Slack, it feels like something is wrong with Zero - sharing responses incorrectly. I have therefore switched back to the T4 grant. For a single user that was enough but given the number of users, I would ask to upgrade this to something more powerful if possible. Thanks a lot!

@BramVanroy

As reported on Slack, it feels like something is wrong with Zero - sharing responses incorrectly. I have therefore switched back to the T4 grant.

Thanks for reporting the issue! Hopefully the ZeroGPU issue will be fixed soon, but yeah, we should use a normal GPU for now.

For a single user that was enough but given the number of users, I would ask to upgrade this to something more powerful if possible.

Done! I just upgraded the hardware to a10g-small.

@hysts Thanks a lot!

I switched to zero so the community grant can be revoked @hysts

BramVanroy changed discussion status to closed

Got it! Thanks!

Sign up or log in to comment