Albert Yu

MRU4913

AI & ML interests

None yet

Recent Activity

Organizations

openerotica's profile picture

MRU4913's activity

view reply

Yea, that's my question. I've read the docs and it says fastrtc supports concurrency. That's got me curious about the batching/others technique on the GPU when it processes multiple request at the same time.

view reply

Thank you for reply. I mean batching techniques, like dynamic batching ,static batching on GPU processors. For example , whisper stt run multple concurrent prompt in parallel on GPU.

view reply

Thx to all all. Great work!!!

I have a question for concurrency when use tts_model and stt_model. How does each type of model handle multiple requests at the same time. (e.g. batching technique ? cpu-only threading ....) @freddyaboulton

upvoted an article 9 days ago
view article
Article

FastRTC: The Real-Time Communication Library for Python

126
New activity in CohereForAI/c4ai-command-r7b-12-2024 3 months ago

How was r7b?

6
#3 opened 3 months ago by
MRU4913