Albert Yu

Thank you ~

Yea, that's my question. I've read the docs and it says fastrtc supports concurrency. That's got me curious about the batching/others technique on the GPU when it processes multiple request at the same time.

Thank you for reply. I mean batching techniques, like dynamic batching ,static batching on GPU processors. For example , whisper stt run multple concurrent prompt in parallel on GPU.

Thx to all all. Great work!!!

I have a question for concurrency when use tts_model and stt_model. How does each type of model handle multiple requests at the same time. (e.g. batching technique ? cpu-only threading ....) @freddyaboulton