Deploy on TPU v3

#2
by naomiballball - opened

Hi gandhi,
I really appreciate that you created such a useful demo. I tried to deploy it on my Google Cloud Platform instance with TPU v3, but it didn't work. I have a question regarding this: Does the demo only run on TPU v4, or is it also compatible with TPU t3? Additionally, I would be grateful if you could provide any specific information about the environment requirements for the deployment.

It's compatible on a TPU v3. This front end actually just queries the space https://huggingface.co/spaces/sanchit-gandhi/whisper-jax (which is running on a mix of TPU v3's and TPU v4's). There are instructions for duplicating the TPU space on the Whisper JAX repo: https://github.com/sanchit-gandhi/whisper-jax#creating-an-endpoint

Once you've done this, you can duplicate this diarization space, and then update the API URL with the URL of your endpoint: https://huggingface.co/spaces/sanchit-gandhi/whisper-jax-diarization/blob/16ca66760184535429d16b93e583398626597415/app.py#L17

Sign up or log in to comment